May 29 01:55:52.527435 ip-10-0-141-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 29 01:55:52.527447 ip-10-0-141-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 29 01:55:52.527455 ip-10-0-141-250 systemd[1]: kubelet.service: Failed with result 'resources'.
May 29 01:55:52.527667 ip-10-0-141-250 systemd[1]: Failed to start Kubernetes Kubelet.
May 29 01:56:03.747772 ip-10-0-141-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 29 01:56:03.747790 ip-10-0-141-250 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a588277b855048688c16527dbdf700dc --
May 29 01:58:22.900454 ip-10-0-141-250 systemd[1]: Starting Kubernetes Kubelet...
May 29 01:58:23.363948 ip-10-0-141-250 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 01:58:23.363948 ip-10-0-141-250 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 29 01:58:23.363948 ip-10-0-141-250 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 01:58:23.363948 ip-10-0-141-250 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 29 01:58:23.363948 ip-10-0-141-250 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 01:58:23.364917 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.364824    2550 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 29 01:58:23.370493 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370474    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 01:58:23.370493 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370490    2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 01:58:23.370493 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370494    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370498    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370501    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370506    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370510    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370514    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370518    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370521    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370523    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370527    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370530    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370533    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370535    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370538    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370540    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370543    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370546    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370549    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370552    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370555    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 01:58:23.370587 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370558    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370561    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370563    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370566    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370568    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370571    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370574    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370576    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370579    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370581    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370584    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370586    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370589    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370592    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370595    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370597    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370600    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370603    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370606    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370608    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 01:58:23.371058 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370611    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370614    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370617    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370619    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370621    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370624    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370626    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370629    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370631    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370633    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370636    2550 feature_gate.go:328] unrecognized feature gate: Example2
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370640    2550 feature_gate.go:328] unrecognized feature gate: Example
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370642    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370645    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370648    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370651    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370653    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370656    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370659    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370661    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 01:58:23.371598 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370664    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370667    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370669    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370672    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370675    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370677    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370680    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370683    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370685    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370688    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370691    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370693    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370696    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370699    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370702    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370704    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370706    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370709    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370712    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370714    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 01:58:23.372109 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370717    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370720    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370724    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.370728    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371146    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371152    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371156    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371160    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371163    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371166    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371168    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371171    2550 feature_gate.go:328] unrecognized feature gate: Example
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371174    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371177    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371179    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371182    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371184    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371187    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371189    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371192    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 01:58:23.372588 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371195    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371197    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371201    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371203    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371206    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371209    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371211    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371213    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371216    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371219    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371221    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371224    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371226    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371229    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371231    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371234    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371237    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371239    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371242    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371245    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 01:58:23.373081 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371248    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371250    2550 feature_gate.go:328] unrecognized feature gate: Example2
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371253    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371257    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371261    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371264    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371267    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371270    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371273    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371276    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371279    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371282    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371284    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371287    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371290    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371294    2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371297    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371299    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371302    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 01:58:23.373584 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371305    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371307    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371310    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371313    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371315    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371317    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371320    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371322    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371325    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371327    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371330    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371334    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371337    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371339    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371342    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371344    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371348    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371353    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371356    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 01:58:23.374070 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371358    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371361    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371363    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371366    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371368    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371371    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371373    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371376    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371378    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371381    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371386    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.371389    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.372980    2550 flags.go:64] FLAG: --address="0.0.0.0"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.372990    2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.372998    2550 flags.go:64] FLAG: --anonymous-auth="true"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373003    2550 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373007    2550 flags.go:64] FLAG: --authentication-token-webhook="false"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373010    2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373015    2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373020    2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373023    2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373026    2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 29 01:58:23.374549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373030    2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373033    2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373038    2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373041    2550 flags.go:64] FLAG: --cgroup-root=""
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373044    2550 flags.go:64] FLAG: --cgroups-per-qos="true"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373047    2550 flags.go:64] FLAG: --client-ca-file=""
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373050    2550 flags.go:64] FLAG: --cloud-config=""
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373053    2550 flags.go:64] FLAG: --cloud-provider="external"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373056    2550 flags.go:64] FLAG: --cluster-dns="[]"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373074    2550 flags.go:64] FLAG: --cluster-domain=""
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373079    2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373083    2550 flags.go:64] FLAG: --config-dir=""
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373088    2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373092    2550 flags.go:64] FLAG: --container-log-max-files="5"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373096    2550 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373100    2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373103    2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373106    2550 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373109    2550 flags.go:64] FLAG: --contention-profiling="false"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373112    2550 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373115    2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373119    2550 flags.go:64] FLAG: --cpu-manager-policy="none"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373122    2550 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373127    2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373130    2550 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 29 01:58:23.375121 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373133    2550 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373136    2550 flags.go:64] FLAG: --enable-load-reader="false"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373139    2550 flags.go:64] FLAG: --enable-server="true"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373142    2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373147    2550 flags.go:64] FLAG: --event-burst="100"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373151    2550 flags.go:64] FLAG: --event-qps="50"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373154    2550 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373157    2550 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373161    2550 flags.go:64] FLAG: --eviction-hard=""
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373165    2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373168    2550 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373171    2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373174    2550 flags.go:64] FLAG: --eviction-soft=""
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373177    2550 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373197    2550 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373201    2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373204    2550 flags.go:64] FLAG: --experimental-mounter-path=""
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373208    2550 flags.go:64] FLAG: --fail-cgroupv1="false"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373211    2550 flags.go:64] FLAG: --fail-swap-on="true"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373214    2550 flags.go:64] FLAG: --feature-gates=""
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373218    2550 flags.go:64] FLAG: --file-check-frequency="20s"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373221    2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373224    2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373227    2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373231    2550 flags.go:64] FLAG: --healthz-port="10248"
May 29 01:58:23.375747 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373234    2550 flags.go:64] FLAG: --help="false"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373237    2550 flags.go:64] FLAG: --hostname-override="ip-10-0-141-250.ec2.internal"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373240    2550 flags.go:64] FLAG: --housekeeping-interval="10s"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373244    2550 flags.go:64] FLAG: --http-check-frequency="20s"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373248    2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373251    2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373255    2550 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373258    2550 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373261    2550 flags.go:64] FLAG: --image-service-endpoint=""
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373264    2550 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373267    2550 flags.go:64] FLAG: --kube-api-burst="100"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373270    2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373273    2550 flags.go:64] FLAG: --kube-api-qps="50"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373276    2550 flags.go:64] FLAG: --kube-reserved=""
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373280    2550 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373283    2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373286    2550 flags.go:64] FLAG: --kubelet-cgroups=""
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373289    2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373292    2550 flags.go:64] FLAG: --lock-file=""
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373296    2550 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373299    2550 flags.go:64] FLAG: --log-flush-frequency="5s"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373302    2550 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373307    2550 flags.go:64] FLAG: --log-json-split-stream="false"
May 29 01:58:23.376397 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373310    2550 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373313    2550 flags.go:64] FLAG: --log-text-split-stream="false"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373316    2550 flags.go:64] FLAG: --logging-format="text"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373319    2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373323    2550 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373326    2550 flags.go:64] FLAG: --manifest-url=""
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373328    2550 flags.go:64] FLAG: --manifest-url-header=""
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373333    2550 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373336    2550 flags.go:64] FLAG: --max-open-files="1000000"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373341    2550 flags.go:64] FLAG: --max-pods="110"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373344    2550 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373347    2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373350    2550 flags.go:64] FLAG: --memory-manager-policy="None"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373353    2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373356    2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373359    2550 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373362    2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373371    2550 flags.go:64] FLAG: --node-status-max-images="50"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373374    2550 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373377    2550 flags.go:64] FLAG: --oom-score-adj="-999"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373380    2550 flags.go:64] FLAG: --pod-cidr=""
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373383    2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373390    2550 flags.go:64] FLAG: --pod-manifest-path=""
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373393    2550 flags.go:64] FLAG: --pod-max-pids="-1"
May 29 01:58:23.376942 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373397    2550 flags.go:64] FLAG: --pods-per-core="0"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373400    2550 flags.go:64] FLAG: --port="10250"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373403    2550 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373406    2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0741eb6e33e34544c"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373410    2550 flags.go:64] FLAG: --qos-reserved=""
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373413    2550 flags.go:64] FLAG: --read-only-port="10255"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373416    2550 flags.go:64] FLAG: --register-node="true"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373419    2550 flags.go:64] FLAG: --register-schedulable="true"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373422    2550 flags.go:64] FLAG: --register-with-taints=""
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373425    2550 flags.go:64] FLAG: --registry-burst="10"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373428    2550 flags.go:64] FLAG: --registry-qps="5"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373431    2550 flags.go:64] FLAG: --reserved-cpus=""
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373434    2550 flags.go:64] FLAG: --reserved-memory=""
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373437    2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373440    2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373444    2550 flags.go:64] FLAG: --rotate-certificates="false"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373446    2550 flags.go:64] FLAG: --rotate-server-certificates="false"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373450    2550 flags.go:64] FLAG: --runonce="false"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373452    2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373456    2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373465    2550 flags.go:64] FLAG: --seccomp-default="false"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373469    2550 flags.go:64] FLAG: --serialize-image-pulls="true"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373472    2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373476    2550 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373480    2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373484    2550 flags.go:64] FLAG: --storage-driver-password="root"
May 29 01:58:23.377532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373487    2550 flags.go:64] FLAG: --storage-driver-secure="false"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373490    2550 flags.go:64] FLAG: --storage-driver-table="stats"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373493    2550 flags.go:64] FLAG: --storage-driver-user="root"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373496    2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373499    2550 flags.go:64] FLAG: --sync-frequency="1m0s"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373502    2550 flags.go:64] FLAG: --system-cgroups=""
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373505    2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373510    2550 flags.go:64] FLAG: --system-reserved-cgroup=""
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373513    2550 flags.go:64] FLAG: --tls-cert-file=""
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373516    2550 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373520    2550 flags.go:64] FLAG: --tls-min-version=""
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373523    2550 flags.go:64] FLAG: --tls-private-key-file=""
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373525    2550 flags.go:64] FLAG: --topology-manager-policy="none"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373528    2550 flags.go:64] FLAG: --topology-manager-policy-options=""
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373531    2550 flags.go:64] FLAG: --topology-manager-scope="container"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373534    2550 flags.go:64] FLAG: --v="2"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373541    2550 flags.go:64] FLAG: --version="false"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373546    2550 flags.go:64] FLAG: --vmodule=""
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373550    2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.373554    2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373652    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373656    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373659    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373662    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 01:58:23.378262 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373665    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373668    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373670    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373673    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373676    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373678    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373688    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373691    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373694    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373697    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373699    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373702    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373704    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373707    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373710    2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373712    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373715    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373717    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373720    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 01:58:23.378848 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373722    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373726    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373729    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373732    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373735    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373740    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373743    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373746    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373749    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373751    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373754    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373756    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373759    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373762    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373764    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373767    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373769    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373772    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373775    2550 feature_gate.go:328] unrecognized feature gate: Example2
May 29 01:58:23.379334 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373778    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373780    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373783    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373786    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373789    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373792    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373794    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373797    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373799    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373802    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373804    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373807    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373809    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373811    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373814    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373816    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373819    2550 feature_gate.go:328] unrecognized feature gate: Example
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373821    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373825    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373828    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 01:58:23.379816 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373830    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373833    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373835    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373838    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373840    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373843    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373845    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373848    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373850    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373852    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373855    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373859    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373861    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373864    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373867    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373870    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373873    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373875    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373878    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 01:58:23.380336 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373880    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 01:58:23.380801 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373883    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 01:58:23.380801 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373886    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 01:58:23.380801 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373888    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 01:58:23.380801 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.373891    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 01:58:23.380801 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.374515    2550 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 01:58:23.381344 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.381228    2550 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 29 01:58:23.381382 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.381345    2550 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 29 01:58:23.381413 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381396    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 01:58:23.381413 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381401    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 01:58:23.381413 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381405    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 01:58:23.381413 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381408    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 01:58:23.381413 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381411    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 01:58:23.381413 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381414    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381417    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381420    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381423    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381426    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381428    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381431    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381433    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381436    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381439    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381442    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381444    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381447    2550 feature_gate.go:328] unrecognized feature gate: Example
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381450    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381454    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381456    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381459    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381462    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381464    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381467    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 01:58:23.381567 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381469    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381472    2550 feature_gate.go:328] unrecognized feature gate: Example2
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381475    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381477    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381480    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381482    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381485    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381487    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381489    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381492    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381494    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381497    2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381500    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381502    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381507    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381511    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381514    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381517    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381519    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 01:58:23.382215 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381522    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381525    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381528    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381530    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381533    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381535    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381538    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381541    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381549    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381553    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381557    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381560    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381563    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381566    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381570    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381573    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381576    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381578    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381581    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381584    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 01:58:23.382688 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381586    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381589    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381592    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381594    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381597    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381600    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381602    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381605    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381609    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381611    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381614    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381617    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381619    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381622    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381624    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381630    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381633    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381636    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381638    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381641    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 01:58:23.383199 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381643    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381649    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.381655    2550 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381758    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381763    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381766    2550 feature_gate.go:328] unrecognized feature gate: Example
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381769    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381772    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381775    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381778    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381781    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381783    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381786    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381790    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381793    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381795    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 01:58:23.383775 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381797    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381801    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381803    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381806    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381809    2550 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381812    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381814    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381817    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381820    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381822    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381825    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381828    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381830    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381833    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381836    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381838    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381841    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381844    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381847    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381850    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 01:58:23.384188 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381852    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381855    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381857    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381860    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381862    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381865    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381867    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381871    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381874    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381877    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381880    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381882    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381885    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381888    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381891    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381894    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381897    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381899    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381902    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 01:58:23.384667 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381905    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381907    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381910    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381912    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381915    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381918    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381920    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381923    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381925    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381928    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381930    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381933    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381936    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381938    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381941    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381944    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381946    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381949    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381951    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381954    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 01:58:23.385158 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381956    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381959    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381961    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381964    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381967    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381970    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381973    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381975    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381978    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381980    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381983    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381986    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381989    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:23.381993    2550 feature_gate.go:328] unrecognized feature gate: Example2
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.381997    2550 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 01:58:23.385685 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.383668    2550 server.go:962] "Client rotation is on, will bootstrap in background"
May 29 01:58:23.386507 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.386492    2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 29 01:58:23.387436 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.387425    2550 server.go:1019] "Starting client certificate rotation"
May 29 01:58:23.387542 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.387528    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 01:58:23.387578 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.387569    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 01:58:23.410802 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.410775    2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 01:58:23.414730 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.414704    2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 01:58:23.428916 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.428893    2550 log.go:25] "Validated CRI v1 runtime API"
May 29 01:58:23.434334 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.434316    2550 log.go:25] "Validated CRI v1 image API"
May 29 01:58:23.435517 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.435501    2550 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 29 01:58:23.438683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.438663    2550 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 01:58:23.439882 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.439855    2550 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b20bdb0f-8aec-4451-8f78-763fc20df037:/dev/nvme0n1p3 c3662664-2e82-4a43-ad84-d3c7cfe77074:/dev/nvme0n1p4]
May 29 01:58:23.439929 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.439883    2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 29 01:58:23.444329 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.444209    2550 manager.go:217] Machine: {Timestamp:2026-05-29 01:58:23.443688652 +0000 UTC m=+0.422395458 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099879 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f3efd88dbc4e11682950a1dd848e SystemUUID:ec25f3ef-d88d-bc4e-1168-2950a1dd848e BootID:a588277b-8550-4868-8c16-527dbdf700dc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:6a:52:15:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:6a:52:15:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:f7:45:ff:1e:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 29 01:58:23.444329 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.444320    2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 29 01:58:23.444466 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.444449    2550 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 29 01:58:23.445634 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.445608    2550 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 29 01:58:23.445775 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.445635    2550 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 29 01:58:23.445821 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.445787    2550 topology_manager.go:138] "Creating topology manager with none policy"
May 29 01:58:23.445821 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.445796    2550 container_manager_linux.go:306] "Creating device plugin manager"
May 29 01:58:23.445821 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.445804    2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 01:58:23.446586 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.446575    2550 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 01:58:23.447446 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.447437    2550 state_mem.go:36] "Initialized new in-memory state store"
May 29 01:58:23.447554 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.447545    2550 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 29 01:58:23.449683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.449672    2550 kubelet.go:491] "Attempting to sync node with API server"
May 29 01:58:23.449724 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.449691    2550 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 29 01:58:23.449724 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.449705    2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 29 01:58:23.449724 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.449715    2550 kubelet.go:397] "Adding apiserver pod source"
May 29 01:58:23.449814 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.449725    2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 29 01:58:23.451186 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.451171    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 01:58:23.451221 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.451210    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 01:58:23.454276 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.454258    2550 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 29 01:58:23.456191 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.456176    2550 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 29 01:58:23.458322 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458307    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 29 01:58:23.458322 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458324    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458331    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458337    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458347    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458354    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458361    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458366    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458373    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458379    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458392    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 29 01:58:23.458420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.458398    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 29 01:58:23.459299 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.459288    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 29 01:58:23.459299 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.459297    2550 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 29 01:58:23.462959 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.462940    2550 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 29 01:58:23.463024 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.463011    2550 server.go:1295] "Started kubelet"
May 29 01:58:23.463177 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.463117    2550 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 29 01:58:23.463274 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.463194    2550 server_v1.go:47] "podresources" method="list" useActivePods=true
May 29 01:58:23.464034 ip-10-0-141-250 systemd[1]: Started Kubernetes Kubelet.
May 29 01:58:23.464445 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.464050    2550 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 29 01:58:23.464445 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.464052    2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 29 01:58:23.465414 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.465384    2550 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 29 01:58:23.465414 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.465386    2550 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 29 01:58:23.466304 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.466284    2550 server.go:317] "Adding debug handlers to kubelet server"
May 29 01:58:23.467019 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.467001    2550 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 29 01:58:23.467732 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.467715    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dbw9"
May 29 01:58:23.472144 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.472115    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 29 01:58:23.472245 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.471294    2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-250.ec2.internal.18b3e6abd708e46d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-250.ec2.internal,UID:ip-10-0-141-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-250.ec2.internal,},FirstTimestamp:2026-05-29 01:58:23.462958189 +0000 UTC m=+0.441664995,LastTimestamp:2026-05-29 01:58:23.462958189 +0000 UTC m=+0.441664995,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-250.ec2.internal,}"
May 29 01:58:23.472576 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.472560    2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 29 01:58:23.472664 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.472652    2550 volume_manager.go:295] "The desired_state_of_world populator starts"
May 29 01:58:23.472711 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.472666    2550 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 29 01:58:23.472711 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.472668    2550 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 29 01:58:23.472828 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.472815    2550 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 29 01:58:23.472890 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.472878    2550 reconstruct.go:97] "Volume reconstruction finished"
May 29 01:58:23.472934 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.472890    2550 reconciler.go:26] "Reconciler: start to sync state"
May 29 01:58:23.473449 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.473430    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:23.474033 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474013    2550 factory.go:55] Registering systemd factory
May 29 01:58:23.474033 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474034    2550 factory.go:223] Registration of the systemd container factory successfully
May 29 01:58:23.474267 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474253    2550 factory.go:153] Registering CRI-O factory
May 29 01:58:23.474318 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474274    2550 factory.go:223] Registration of the crio container factory successfully
May 29 01:58:23.474355 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474325    2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 29 01:58:23.474355 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474345    2550 factory.go:103] Registering Raw factory
May 29 01:58:23.474426 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474361    2550 manager.go:1196] Started watching for new ooms in manager
May 29 01:58:23.474777 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.474765    2550 manager.go:319] Starting recovery of all containers
May 29 01:58:23.475290 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.475269    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dbw9"
May 29 01:58:23.485149 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.485127    2550 manager.go:324] Recovery completed
May 29 01:58:23.490260 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.490239    2550 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 01:58:23.490336 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.490320    2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 01:58:23.492518 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.492502    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientMemory"
May 29 01:58:23.492585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.492531    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasNoDiskPressure"
May 29 01:58:23.492585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.492542    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientPID"
May 29 01:58:23.492975 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.492960    2550 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 29 01:58:23.492975 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.492970    2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 29 01:58:23.493118 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.492986    2550 state_mem.go:36] "Initialized new in-memory state store"
May 29 01:58:23.493409 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.493390    2550 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-250.ec2.internal\" not found" node="ip-10-0-141-250.ec2.internal"
May 29 01:58:23.495474 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.495463    2550 policy_none.go:49] "None policy: Start"
May 29 01:58:23.495524 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.495478    2550 memory_manager.go:186] "Starting memorymanager" policy="None"
May 29 01:58:23.495524 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.495487    2550 state_mem.go:35] "Initializing new in-memory state store"
May 29 01:58:23.526675 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.526651    2550 manager.go:341] "Starting Device Plugin manager"
May 29 01:58:23.526772 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.526726    2550 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 29 01:58:23.526772 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.526740    2550 server.go:85] "Starting device plugin registration server"
May 29 01:58:23.527034 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.527022    2550 eviction_manager.go:189] "Eviction manager: starting control loop"
May 29 01:58:23.527097 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.527037    2550 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 29 01:58:23.527178 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.527151    2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 29 01:58:23.527275 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.527246    2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 29 01:58:23.527275 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.527256    2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 29 01:58:23.528162 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.528135    2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 29 01:58:23.528263 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.528188    2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:23.575200 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.575162    2550 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 29 01:58:23.579435 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.576447    2550 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 29 01:58:23.579435 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.576464    2550 status_manager.go:230] "Starting to sync pod status with apiserver"
May 29 01:58:23.579435 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.576485    2550 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 29 01:58:23.579435 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.576500    2550 kubelet.go:2451] "Starting kubelet main sync loop"
May 29 01:58:23.579435 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.576582    2550 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 29 01:58:23.579435 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.579384    2550 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 01:58:23.627974 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.627893    2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 01:58:23.629099 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.629082    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientMemory"
May 29 01:58:23.629182 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.629112    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasNoDiskPressure"
May 29 01:58:23.629182 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.629124    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientPID"
May 29 01:58:23.629182 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.629147    2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-250.ec2.internal"
May 29 01:58:23.637763 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.637742    2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-250.ec2.internal"
May 29 01:58:23.637853 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.637769    2550 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-250.ec2.internal\": node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:23.656813 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.656787    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:23.677303 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.677279    2550 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal"]
May 29 01:58:23.677387 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.677354    2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 01:58:23.678720 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.678706    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientMemory"
May 29 01:58:23.678792 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.678733    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasNoDiskPressure"
May 29 01:58:23.678792 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.678743    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientPID"
May 29 01:58:23.679960 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.679947    2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 01:58:23.680156 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680140    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.680232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680176    2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 01:58:23.680585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680571    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientMemory"
May 29 01:58:23.680667 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680595    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasNoDiskPressure"
May 29 01:58:23.680667 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680609    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientPID"
May 29 01:58:23.680802 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680788    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientMemory"
May 29 01:58:23.680857 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680818    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasNoDiskPressure"
May 29 01:58:23.680857 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.680830    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientPID"
May 29 01:58:23.681883 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.681868    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.681955 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.681896    2550 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 01:58:23.682508 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.682489    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientMemory"
May 29 01:58:23.682564 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.682521    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasNoDiskPressure"
May 29 01:58:23.682564 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.682535    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeHasSufficientPID"
May 29 01:58:23.709741 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.709716    2550 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-250.ec2.internal\" not found" node="ip-10-0-141-250.ec2.internal"
May 29 01:58:23.714133 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.714116    2550 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-250.ec2.internal\" not found" node="ip-10-0-141-250.ec2.internal"
May 29 01:58:23.757809 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.757771    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:23.774385 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.774354    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68f5b5563c41619cccb17e027d6f4fd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal\" (UID: \"68f5b5563c41619cccb17e027d6f4fd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.774509 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.774391    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11f2ffcb97183e73f25ffbb03ac0679e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-250.ec2.internal\" (UID: \"11f2ffcb97183e73f25ffbb03ac0679e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.774509 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.774412    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68f5b5563c41619cccb17e027d6f4fd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal\" (UID: \"68f5b5563c41619cccb17e027d6f4fd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.858592 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.858558    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:23.874909 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.874885    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68f5b5563c41619cccb17e027d6f4fd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal\" (UID: \"68f5b5563c41619cccb17e027d6f4fd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.874991 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.874923    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68f5b5563c41619cccb17e027d6f4fd3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal\" (UID: \"68f5b5563c41619cccb17e027d6f4fd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.874991 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.874963    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68f5b5563c41619cccb17e027d6f4fd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal\" (UID: \"68f5b5563c41619cccb17e027d6f4fd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.874991 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.874984    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11f2ffcb97183e73f25ffbb03ac0679e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-250.ec2.internal\" (UID: \"11f2ffcb97183e73f25ffbb03ac0679e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.875131 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.875026    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/11f2ffcb97183e73f25ffbb03ac0679e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-250.ec2.internal\" (UID: \"11f2ffcb97183e73f25ffbb03ac0679e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.875131 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:23.875051    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68f5b5563c41619cccb17e027d6f4fd3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal\" (UID: \"68f5b5563c41619cccb17e027d6f4fd3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:23.959369 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:23.959302    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.012803 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.012769    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:24.017429 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.017398    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal"
May 29 01:58:24.060238 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.060199    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.160730 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.160695    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.261268 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.261181    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.328417 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.328391    2550 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 01:58:24.361968 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.361931    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.387446 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.387416    2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 29 01:58:24.388098 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.387607    2550 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 01:58:24.388098 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.387623    2550 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 01:58:24.388098 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.387623    2550 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 01:58:24.462049 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.461991    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.472861 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.472841    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 29 01:58:24.477753 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.477716    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 01:53:23 +0000 UTC" deadline="2027-11-04 15:56:24.470686721 +0000 UTC"
May 29 01:58:24.477804 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.477754    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12589h57m59.992935851s"
May 29 01:58:24.514311 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.514242    2550 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 01:58:24.562761 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.562724    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.616335 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.616305    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hgr9t"
May 29 01:58:24.631236 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.631202    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hgr9t"
May 29 01:58:24.663022 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.662977    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.704290 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:24.704053    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f2ffcb97183e73f25ffbb03ac0679e.slice/crio-b07a44ad7757002667ee9075c73373d54205db5ac560ba23a6097ca2b8e4c692 WatchSource:0}: Error finding container b07a44ad7757002667ee9075c73373d54205db5ac560ba23a6097ca2b8e4c692: Status 404 returned error can't find the container with id b07a44ad7757002667ee9075c73373d54205db5ac560ba23a6097ca2b8e4c692
May 29 01:58:24.704485 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:24.704466    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f5b5563c41619cccb17e027d6f4fd3.slice/crio-225bc97e038e123150deedeeee863f36626dea2eff54791261092dbe0b7636a9 WatchSource:0}: Error finding container 225bc97e038e123150deedeeee863f36626dea2eff54791261092dbe0b7636a9: Status 404 returned error can't find the container with id 225bc97e038e123150deedeeee863f36626dea2eff54791261092dbe0b7636a9
May 29 01:58:24.707579 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.707558    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 01:58:24.763766 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.763696    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.864251 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.864177    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.964980 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:24.964933    2550 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-250.ec2.internal\" not found"
May 29 01:58:24.986709 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:24.985503    2550 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 01:58:25.073190 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.073156    2550 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal"
May 29 01:58:25.092176 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.092145    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 01:58:25.093302 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.093285    2550 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal"
May 29 01:58:25.107085 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.107055    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 01:58:25.212169 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.212091    2550 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 01:58:25.256901 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.256871    2550 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 01:58:25.451650 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.451617    2550 apiserver.go:52] "Watching apiserver"
May 29 01:58:25.458922 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.458893    2550 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 29 01:58:25.461583 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.461551    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-7v5zh","kube-system/konnectivity-agent-fs7b9","kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2","openshift-cluster-node-tuning-operator/tuned-52f7n","openshift-image-registry/node-ca-72m4c","openshift-multus/multus-ssb7m","openshift-multus/network-metrics-daemon-l9z94","openshift-network-operator/iptables-alerter-6kzbs","kube-system/global-pull-secret-syncer-hn8pt","openshift-dns/node-resolver-dpsvs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal","openshift-multus/multus-additional-cni-plugins-6q9vq","openshift-network-diagnostics/network-check-target-gftwp"]
May 29 01:58:25.464983 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.464930    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.469355 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.469328    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.469474 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.469386    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 29 01:58:25.469474 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.469408    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 29 01:58:25.469474 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.469422    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 29 01:58:25.469745 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.469728    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rlb5k\""
May 29 01:58:25.471828 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.471621    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:25.471828 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.471694    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:25.471828 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.471726    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.472905 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.472886    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ggfxm\""
May 29 01:58:25.473015 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.472916    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 29 01:58:25.473015 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.473007    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 29 01:58:25.473280 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.473263    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 29 01:58:25.474112 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.474058    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.475786 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.475766    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 29 01:58:25.476231 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.476022    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 29 01:58:25.476231 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.476030    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 29 01:58:25.476384 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.476340    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.476750 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.476730    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zkph2\""
May 29 01:58:25.477960 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.477941    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 29 01:58:25.478316 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.478251    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 29 01:58:25.478535 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.478519    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j6f2b\""
May 29 01:58:25.478604 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.478551    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.483003 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.482980    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:25.483126 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.483050    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:25.483126 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483105    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483352    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483395    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/ac51130d-1272-49be-b72e-81eaf857f870-kube-api-access-p6vfq\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483420    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysctl-conf\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483456    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-cni-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483480    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a44aa4c-fcaf-424b-8aee-c0f141363937-cni-binary-copy\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483503    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-netns\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483534    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-multus-certs\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483578    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-sys-fs\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483604    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-cni-bin\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483647    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-cni-multus\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483671    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-kubelet\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483692    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-etc-kubernetes\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483707    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-os-release\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.483725 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483726    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483752    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-etc-selinux\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483777    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-var-lib-kubelet\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483799    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-os-release\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483828    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-k8s-cni-cncf-io\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483852    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483915    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483920    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brctd\" (UniqueName: \"kubernetes.io/projected/27416c3a-bd51-40b1-82f3-246aa67620dc-kube-api-access-brctd\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483933    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rksbl\""
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483944    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-socket-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.483994    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-modprobe-d\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484014    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysctl-d\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484029    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-sys\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484050    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-cnibin\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484095    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-socket-dir-parent\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484116    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xskb\" (UniqueName: \"kubernetes.io/projected/3a44aa4c-fcaf-424b-8aee-c0f141363937-kube-api-access-7xskb\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484131    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.484494 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484148    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-tuned\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484169    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-tmp\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484191    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7prtg\" (UniqueName: \"kubernetes.io/projected/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-kube-api-access-7prtg\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484214    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-hostroot\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484242    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-system-cni-dir\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484264    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484286    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-host\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484307    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-device-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484346    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysconfig\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484368    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-kubernetes\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484389    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-run\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484444    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-system-cni-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484475    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-conf-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484505    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-daemon-config\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484525    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484547    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-registration-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.485423 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484570    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-systemd\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.486198 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484593    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-lib-modules\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.486198 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484619    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-cnibin\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.486198 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.484980    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.488454    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4r2fk\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.488471    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.488486    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.488660    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.488734    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.488808    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.489141    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.489203    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.489207    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cfc2q\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.489419    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.489481    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 29 01:58:25.489778 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.489658    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 29 01:58:25.492047 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.491691    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.492047 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.491791    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:25.492047 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.491848    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.494442 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.494398    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:25.495522 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.495345    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 29 01:58:25.495522 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.495398    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mt659\""
May 29 01:58:25.495754 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.495736    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 29 01:58:25.497682 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.497661    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 29 01:58:25.498165 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.498145    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7r9mf\""
May 29 01:58:25.498535 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.498517    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 29 01:58:25.574396 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.574369    2550 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 29 01:58:25.581330 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.581260    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal" event={"ID":"11f2ffcb97183e73f25ffbb03ac0679e","Type":"ContainerStarted","Data":"b07a44ad7757002667ee9075c73373d54205db5ac560ba23a6097ca2b8e4c692"}
May 29 01:58:25.582412 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.582379    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal" event={"ID":"68f5b5563c41619cccb17e027d6f4fd3","Type":"ContainerStarted","Data":"225bc97e038e123150deedeeee863f36626dea2eff54791261092dbe0b7636a9"}
May 29 01:58:25.585654 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585626    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.585839 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585668    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c80ba141-974c-4344-8219-17a591c8aedc-dbus\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.585839 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585698    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-registration-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.585839 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585727    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-lib-modules\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.585839 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585751    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-cnibin\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.585839 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585776    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/ac51130d-1272-49be-b72e-81eaf857f870-kube-api-access-p6vfq\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.585839 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585801    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-etc-kubernetes\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.585839 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585824    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-os-release\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585849    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585877    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585905    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-node-log\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585932    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585956    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47539a4c-963c-40bb-8e9c-0e46eb16ff79-serviceca\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585966    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-cnibin\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585981    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-cni-bin\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.585970    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-registration-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586008    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-kubelet\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586046    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-os-release\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586035    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ee1741e-1566-4108-aee5-d7e7894466f1-iptables-alerter-script\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586127    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-kubelet\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586141    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-etc-kubernetes\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586152    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-log-socket\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586162    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586181    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.586272 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586219    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovnkube-config\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586238    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-kubelet\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586256    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-os-release\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586224    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-cni-bin\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586288    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-k8s-cni-cncf-io\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586296    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-lib-modules\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586335    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m547f\" (UniqueName: \"kubernetes.io/projected/1ee1741e-1566-4108-aee5-d7e7894466f1-kube-api-access-m547f\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586355    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-os-release\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586362    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw4j6\" (UniqueName: \"kubernetes.io/projected/1e0de9e7-453e-4a47-a70a-1112edc41370-kube-api-access-jw4j6\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586410    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-socket-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586411    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-k8s-cni-cncf-io\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586439    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-modprobe-d\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586476    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-cnibin\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586504    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-socket-dir-parent\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586540    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xskb\" (UniqueName: \"kubernetes.io/projected/3a44aa4c-fcaf-424b-8aee-c0f141363937-kube-api-access-7xskb\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586570    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-cni-bin\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586572    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-cnibin\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586538    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-socket-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.587042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586619    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-modprobe-d\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586628    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-socket-dir-parent\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586660    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-tuned\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586694    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-hostroot\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586720    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-cni-binary-copy\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586723    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586754    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-hostroot\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586753    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586808    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e0de9e7-453e-4a47-a70a-1112edc41370-tmp-dir\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586858    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c811a74b-d63a-4fb1-ac95-194f129942a9-agent-certs\") pod \"konnectivity-agent-fs7b9\" (UID: \"c811a74b-d63a-4fb1-ac95-194f129942a9\") " pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586907    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7kc6\" (UniqueName: \"kubernetes.io/projected/47539a4c-963c-40bb-8e9c-0e46eb16ff79-kube-api-access-p7kc6\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586937    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysconfig\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586966    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-run\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586937    2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.586992    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-system-cni-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587015    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-conf-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587018    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysconfig\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587053    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ee1741e-1566-4108-aee5-d7e7894466f1-host-slash\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.587887 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587084    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-conf-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587094    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-systemd\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587121    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpjt\" (UniqueName: \"kubernetes.io/projected/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-kube-api-access-dtpjt\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587140    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rjm6\" (UniqueName: \"kubernetes.io/projected/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-kube-api-access-2rjm6\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587143    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-run\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587158    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587173    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysctl-conf\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587193    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-cni-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587216    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a44aa4c-fcaf-424b-8aee-c0f141363937-cni-binary-copy\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587237    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-netns\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587245    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-systemd\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587195    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-system-cni-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587277    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-multus-certs\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587306    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-slash\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587330    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-kubelet-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587334    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-sys-fs\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587340    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-multus-certs\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.588812 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587374    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-sys-fs\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587375    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-cni-multus\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587400    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-var-lib-cni-multus\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587411    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-systemd\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587427    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-host-run-netns\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587438    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-etc-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587462    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-ovn\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587506    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovn-node-metrics-cert\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587522    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysctl-conf\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587533    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e0de9e7-453e-4a47-a70a-1112edc41370-hosts-file\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587570    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-etc-selinux\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587575    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-cni-dir\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587621    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-var-lib-kubelet\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587633    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-etc-selinux\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587698    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587726    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brctd\" (UniqueName: \"kubernetes.io/projected/27416c3a-bd51-40b1-82f3-246aa67620dc-kube-api-access-brctd\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587760    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-var-lib-kubelet\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.589683 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587850    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a44aa4c-fcaf-424b-8aee-c0f141363937-cni-binary-copy\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587915    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587951    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-env-overrides\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.587977    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588015    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c811a74b-d63a-4fb1-ac95-194f129942a9-konnectivity-ca\") pod \"konnectivity-agent-fs7b9\" (UID: \"c811a74b-d63a-4fb1-ac95-194f129942a9\") " pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588044    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysctl-d\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588091    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-sys\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588118    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588145    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-var-lib-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588166    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47539a4c-963c-40bb-8e9c-0e46eb16ff79-host\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588187    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-tmp\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588207    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27416c3a-bd51-40b1-82f3-246aa67620dc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588229    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-sysctl-d\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588279    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-sys\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588284    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7prtg\" (UniqueName: \"kubernetes.io/projected/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-kube-api-access-7prtg\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588310    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-system-cni-dir\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588350    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-systemd-units\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.590550 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588375    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-run-netns\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588426    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-cni-netd\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588462    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovnkube-script-lib\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588475    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27416c3a-bd51-40b1-82f3-246aa67620dc-system-cni-dir\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588488    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c80ba141-974c-4344-8219-17a591c8aedc-kubelet-config\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588529    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-host\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588606    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-device-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588641    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-kubernetes\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588691    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-daemon-config\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588720    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-host\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588795    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac51130d-1272-49be-b72e-81eaf857f870-device-dir\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.588885    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-kubernetes\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.589209    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3a44aa4c-fcaf-424b-8aee-c0f141363937-multus-daemon-config\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.591201    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-etc-tuned\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.591594 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.591477    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-tmp\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.605636 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.605609    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 01:58:25.605636 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.605640    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 01:58:25.605823 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.605655    2550 projected.go:194] Error preparing data for projected volume kube-api-access-l6nw9 for pod openshift-network-diagnostics/network-check-target-gftwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:25.605823 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.605745    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9 podName:d4de6ec4-d835-4663-a7e8-8cf16be6e492 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:26.105704278 +0000 UTC m=+3.084411092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l6nw9" (UniqueName: "kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9") pod "network-check-target-gftwp" (UID: "d4de6ec4-d835-4663-a7e8-8cf16be6e492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:25.608168 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.608107    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brctd\" (UniqueName: \"kubernetes.io/projected/27416c3a-bd51-40b1-82f3-246aa67620dc-kube-api-access-brctd\") pod \"multus-additional-cni-plugins-6q9vq\" (UID: \"27416c3a-bd51-40b1-82f3-246aa67620dc\") " pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.608168 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.608137    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6vfq\" (UniqueName: \"kubernetes.io/projected/ac51130d-1272-49be-b72e-81eaf857f870-kube-api-access-p6vfq\") pod \"aws-ebs-csi-driver-node-84jl2\" (UID: \"ac51130d-1272-49be-b72e-81eaf857f870\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.614171 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.614136    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xskb\" (UniqueName: \"kubernetes.io/projected/3a44aa4c-fcaf-424b-8aee-c0f141363937-kube-api-access-7xskb\") pod \"multus-ssb7m\" (UID: \"3a44aa4c-fcaf-424b-8aee-c0f141363937\") " pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.614668 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.614644    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7prtg\" (UniqueName: \"kubernetes.io/projected/89e5c49b-cc90-4667-9ae6-b0919f55c4d8-kube-api-access-7prtg\") pod \"tuned-52f7n\" (UID: \"89e5c49b-cc90-4667-9ae6-b0919f55c4d8\") " pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.632197 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.632154    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 01:53:24 +0000 UTC" deadline="2028-01-17 16:40:24.272025287 +0000 UTC"
May 29 01:58:25.632197 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.632197    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14366h41m58.639848574s"
May 29 01:58:25.689719 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689689    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-node-log\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.689910 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689727    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:25.689910 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689753    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47539a4c-963c-40bb-8e9c-0e46eb16ff79-serviceca\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.689910 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689776    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ee1741e-1566-4108-aee5-d7e7894466f1-iptables-alerter-script\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.689910 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689798    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-kubelet\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.689910 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689813    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-node-log\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.689910 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689839    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-kubelet\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.689910 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.689906    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.689957    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-log-socket\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.689992    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:26.189969418 +0000 UTC m=+3.168676230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690010    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-log-socket\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690028    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690059    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovnkube-config\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690088    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-run-ovn-kubernetes\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690108    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m547f\" (UniqueName: \"kubernetes.io/projected/1ee1741e-1566-4108-aee5-d7e7894466f1-kube-api-access-m547f\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.690232 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690134    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jw4j6\" (UniqueName: \"kubernetes.io/projected/1e0de9e7-453e-4a47-a70a-1112edc41370-kube-api-access-jw4j6\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690308    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-cni-bin\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690314    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47539a4c-963c-40bb-8e9c-0e46eb16ff79-serviceca\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690345    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690378    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e0de9e7-453e-4a47-a70a-1112edc41370-tmp-dir\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690403    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c811a74b-d63a-4fb1-ac95-194f129942a9-agent-certs\") pod \"konnectivity-agent-fs7b9\" (UID: \"c811a74b-d63a-4fb1-ac95-194f129942a9\") " pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690413    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690379    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-cni-bin\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690427    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7kc6\" (UniqueName: \"kubernetes.io/projected/47539a4c-963c-40bb-8e9c-0e46eb16ff79-kube-api-access-p7kc6\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690473    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ee1741e-1566-4108-aee5-d7e7894466f1-host-slash\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690503    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpjt\" (UniqueName: \"kubernetes.io/projected/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-kube-api-access-dtpjt\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690416    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ee1741e-1566-4108-aee5-d7e7894466f1-iptables-alerter-script\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690528    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rjm6\" (UniqueName: \"kubernetes.io/projected/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-kube-api-access-2rjm6\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690567    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-slash\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.690585 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690567    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ee1741e-1566-4108-aee5-d7e7894466f1-host-slash\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690597    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-systemd\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690581    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovnkube-config\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690620    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-etc-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690644    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-ovn\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690651    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-slash\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690665    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovn-node-metrics-cert\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690688    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e0de9e7-453e-4a47-a70a-1112edc41370-hosts-file\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690695    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-etc-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690713    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e0de9e7-453e-4a47-a70a-1112edc41370-tmp-dir\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690724    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690741    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-systemd\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690745    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-ovn\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690751    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-env-overrides\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690777    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690788    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e0de9e7-453e-4a47-a70a-1112edc41370-hosts-file\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690823    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-run-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.690844    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 01:58:25.691291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690864    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c811a74b-d63a-4fb1-ac95-194f129942a9-konnectivity-ca\") pod \"konnectivity-agent-fs7b9\" (UID: \"c811a74b-d63a-4fb1-ac95-194f129942a9\") " pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690917    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-var-lib-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690950    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47539a4c-963c-40bb-8e9c-0e46eb16ff79-host\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.690994    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-systemd-units\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:25.691009    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret podName:c80ba141-974c-4344-8219-17a591c8aedc nodeName:}" failed. No retries permitted until 2026-05-29 01:58:26.190991248 +0000 UTC m=+3.169698059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret") pod "global-pull-secret-syncer-hn8pt" (UID: "c80ba141-974c-4344-8219-17a591c8aedc") : object "kube-system"/"original-pull-secret" not registered
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691038    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-systemd-units\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691056    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-run-netns\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691101    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-cni-netd\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691127    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovnkube-script-lib\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691135    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47539a4c-963c-40bb-8e9c-0e46eb16ff79-host\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691154    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c80ba141-974c-4344-8219-17a591c8aedc-kubelet-config\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691180    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-cni-netd\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691102    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-var-lib-openvswitch\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691181    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-env-overrides\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691202    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c80ba141-974c-4344-8219-17a591c8aedc-dbus\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691230    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-host-run-netns\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691251    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c80ba141-974c-4344-8219-17a591c8aedc-dbus\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.692052 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691250    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c80ba141-974c-4344-8219-17a591c8aedc-kubelet-config\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:25.692650 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691394    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c811a74b-d63a-4fb1-ac95-194f129942a9-konnectivity-ca\") pod \"konnectivity-agent-fs7b9\" (UID: \"c811a74b-d63a-4fb1-ac95-194f129942a9\") " pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:25.692650 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.691748    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovnkube-script-lib\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.693247 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.693228    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c811a74b-d63a-4fb1-ac95-194f129942a9-agent-certs\") pod \"konnectivity-agent-fs7b9\" (UID: \"c811a74b-d63a-4fb1-ac95-194f129942a9\") " pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:25.693471 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.693454    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-ovn-node-metrics-cert\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.708721 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.708691    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m547f\" (UniqueName: \"kubernetes.io/projected/1ee1741e-1566-4108-aee5-d7e7894466f1-kube-api-access-m547f\") pod \"iptables-alerter-6kzbs\" (UID: \"1ee1741e-1566-4108-aee5-d7e7894466f1\") " pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.708849 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.708729    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rjm6\" (UniqueName: \"kubernetes.io/projected/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-kube-api-access-2rjm6\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:25.709424 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.709401    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw4j6\" (UniqueName: \"kubernetes.io/projected/1e0de9e7-453e-4a47-a70a-1112edc41370-kube-api-access-jw4j6\") pod \"node-resolver-dpsvs\" (UID: \"1e0de9e7-453e-4a47-a70a-1112edc41370\") " pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.709570 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.709547    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpjt\" (UniqueName: \"kubernetes.io/projected/3bcad6ba-25c6-4f4f-a565-5659a0e0adf1-kube-api-access-dtpjt\") pod \"ovnkube-node-7v5zh\" (UID: \"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.710739 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.710722    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7kc6\" (UniqueName: \"kubernetes.io/projected/47539a4c-963c-40bb-8e9c-0e46eb16ff79-kube-api-access-p7kc6\") pod \"node-ca-72m4c\" (UID: \"47539a4c-963c-40bb-8e9c-0e46eb16ff79\") " pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.779128 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.779012    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ssb7m"
May 29 01:58:25.789240 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.789217    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6q9vq"
May 29 01:58:25.798117 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.798093    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2"
May 29 01:58:25.803726 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.803704    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52f7n"
May 29 01:58:25.811045 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.811026    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-72m4c"
May 29 01:58:25.820194 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.820167    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6kzbs"
May 29 01:58:25.827935 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.827913    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:25.835583 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.835559    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpsvs"
May 29 01:58:25.847140 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:25.847121    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:26.194626 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.194549    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:26.194626 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.194624    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:26.194827 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.194652    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:26.194827 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194692    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:26.194827 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194753    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 01:58:26.194827 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194763    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:27.194744794 +0000 UTC m=+4.173451598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:26.194827 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194809    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret podName:c80ba141-974c-4344-8219-17a591c8aedc nodeName:}" failed. No retries permitted until 2026-05-29 01:58:27.194791191 +0000 UTC m=+4.173498000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret") pod "global-pull-secret-syncer-hn8pt" (UID: "c80ba141-974c-4344-8219-17a591c8aedc") : object "kube-system"/"original-pull-secret" not registered
May 29 01:58:26.194827 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194755    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 01:58:26.195144 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194857    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 01:58:26.195144 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194871    2550 projected.go:194] Error preparing data for projected volume kube-api-access-l6nw9 for pod openshift-network-diagnostics/network-check-target-gftwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:26.195144 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.194915    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9 podName:d4de6ec4-d835-4663-a7e8-8cf16be6e492 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:27.194904908 +0000 UTC m=+4.173611704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6nw9" (UniqueName: "kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9") pod "network-check-target-gftwp" (UID: "d4de6ec4-d835-4663-a7e8-8cf16be6e492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:26.460689 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.460661    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac51130d_1272_49be_b72e_81eaf857f870.slice/crio-76f55f22c57915bac70c40575a65e1072bc8b230480a5feedcb13186d3339467 WatchSource:0}: Error finding container 76f55f22c57915bac70c40575a65e1072bc8b230480a5feedcb13186d3339467: Status 404 returned error can't find the container with id 76f55f22c57915bac70c40575a65e1072bc8b230480a5feedcb13186d3339467
May 29 01:58:26.461351 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.461263    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bcad6ba_25c6_4f4f_a565_5659a0e0adf1.slice/crio-62262261d030c5430d99554c387e4cffe0d466fc74ffa1391dfcfa0e3ad1e41a WatchSource:0}: Error finding container 62262261d030c5430d99554c387e4cffe0d466fc74ffa1391dfcfa0e3ad1e41a: Status 404 returned error can't find the container with id 62262261d030c5430d99554c387e4cffe0d466fc74ffa1391dfcfa0e3ad1e41a
May 29 01:58:26.463439 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.463415    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27416c3a_bd51_40b1_82f3_246aa67620dc.slice/crio-d3c5479aed30d1613148d8b9e9bee755734c3ff2647217d2bf6be266371241f4 WatchSource:0}: Error finding container d3c5479aed30d1613148d8b9e9bee755734c3ff2647217d2bf6be266371241f4: Status 404 returned error can't find the container with id d3c5479aed30d1613148d8b9e9bee755734c3ff2647217d2bf6be266371241f4
May 29 01:58:26.464608 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.464519    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a44aa4c_fcaf_424b_8aee_c0f141363937.slice/crio-210e714da1e6a3004b5da2f9b251539ddb628739ff2c27044163b147f10af9e2 WatchSource:0}: Error finding container 210e714da1e6a3004b5da2f9b251539ddb628739ff2c27044163b147f10af9e2: Status 404 returned error can't find the container with id 210e714da1e6a3004b5da2f9b251539ddb628739ff2c27044163b147f10af9e2
May 29 01:58:26.469421 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.469394    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc811a74b_d63a_4fb1_ac95_194f129942a9.slice/crio-df0f58877286226f0fd66986cf4e6f8b09756b43af326132358d719a75491465 WatchSource:0}: Error finding container df0f58877286226f0fd66986cf4e6f8b09756b43af326132358d719a75491465: Status 404 returned error can't find the container with id df0f58877286226f0fd66986cf4e6f8b09756b43af326132358d719a75491465
May 29 01:58:26.469972 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.469938    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e5c49b_cc90_4667_9ae6_b0919f55c4d8.slice/crio-03d25a692c32f0f46ecd45c6dee5af61b7292e236e3357b5185a3bc218265c3c WatchSource:0}: Error finding container 03d25a692c32f0f46ecd45c6dee5af61b7292e236e3357b5185a3bc218265c3c: Status 404 returned error can't find the container with id 03d25a692c32f0f46ecd45c6dee5af61b7292e236e3357b5185a3bc218265c3c
May 29 01:58:26.470671 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.470639    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47539a4c_963c_40bb_8e9c_0e46eb16ff79.slice/crio-a247c6b51f0e961aa38a2da6fa39f0052996b7381018da52970fd6443af0a80f WatchSource:0}: Error finding container a247c6b51f0e961aa38a2da6fa39f0052996b7381018da52970fd6443af0a80f: Status 404 returned error can't find the container with id a247c6b51f0e961aa38a2da6fa39f0052996b7381018da52970fd6443af0a80f
May 29 01:58:26.471482 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.471385    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0de9e7_453e_4a47_a70a_1112edc41370.slice/crio-8c3adf35046bc86c15c2d83f7cc0f62241712049bae3359acf9df9dc1d5ed62e WatchSource:0}: Error finding container 8c3adf35046bc86c15c2d83f7cc0f62241712049bae3359acf9df9dc1d5ed62e: Status 404 returned error can't find the container with id 8c3adf35046bc86c15c2d83f7cc0f62241712049bae3359acf9df9dc1d5ed62e
May 29 01:58:26.472570 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:58:26.472545    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee1741e_1566_4108_aee5_d7e7894466f1.slice/crio-2f37c1dfc271ac90643a52d8cef4f086e0cbe938fc818c2af56bbdc4f207081f WatchSource:0}: Error finding container 2f37c1dfc271ac90643a52d8cef4f086e0cbe938fc818c2af56bbdc4f207081f: Status 404 returned error can't find the container with id 2f37c1dfc271ac90643a52d8cef4f086e0cbe938fc818c2af56bbdc4f207081f
May 29 01:58:26.495853 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.495833    2550 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 01:58:26.577025 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.576996    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:26.577145 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.576996    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:26.577145 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.576995    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:26.577217 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.577188    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:26.577396 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.577359    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:26.577509 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:26.577446    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:26.586447 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.586424    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ssb7m" event={"ID":"3a44aa4c-fcaf-424b-8aee-c0f141363937","Type":"ContainerStarted","Data":"210e714da1e6a3004b5da2f9b251539ddb628739ff2c27044163b147f10af9e2"}
May 29 01:58:26.587322 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.587300    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2" event={"ID":"ac51130d-1272-49be-b72e-81eaf857f870","Type":"ContainerStarted","Data":"76f55f22c57915bac70c40575a65e1072bc8b230480a5feedcb13186d3339467"}
May 29 01:58:26.588129 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.588109    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6kzbs" event={"ID":"1ee1741e-1566-4108-aee5-d7e7894466f1","Type":"ContainerStarted","Data":"2f37c1dfc271ac90643a52d8cef4f086e0cbe938fc818c2af56bbdc4f207081f"}
May 29 01:58:26.588938 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.588919    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpsvs" event={"ID":"1e0de9e7-453e-4a47-a70a-1112edc41370","Type":"ContainerStarted","Data":"8c3adf35046bc86c15c2d83f7cc0f62241712049bae3359acf9df9dc1d5ed62e"}
May 29 01:58:26.589754 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.589725    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-72m4c" event={"ID":"47539a4c-963c-40bb-8e9c-0e46eb16ff79","Type":"ContainerStarted","Data":"a247c6b51f0e961aa38a2da6fa39f0052996b7381018da52970fd6443af0a80f"}
May 29 01:58:26.595958 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.595935    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fs7b9" event={"ID":"c811a74b-d63a-4fb1-ac95-194f129942a9","Type":"ContainerStarted","Data":"df0f58877286226f0fd66986cf4e6f8b09756b43af326132358d719a75491465"}
May 29 01:58:26.601640 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.601619    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"62262261d030c5430d99554c387e4cffe0d466fc74ffa1391dfcfa0e3ad1e41a"}
May 29 01:58:26.603103 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.603083    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerStarted","Data":"d3c5479aed30d1613148d8b9e9bee755734c3ff2647217d2bf6be266371241f4"}
May 29 01:58:26.606908 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.606889    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal" event={"ID":"11f2ffcb97183e73f25ffbb03ac0679e","Type":"ContainerStarted","Data":"a45535028e5ccb82b947b9cb0a3ef09a8f990d429b2adf3cce4459cdf4676061"}
May 29 01:58:26.607893 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.607873    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52f7n" event={"ID":"89e5c49b-cc90-4667-9ae6-b0919f55c4d8","Type":"ContainerStarted","Data":"03d25a692c32f0f46ecd45c6dee5af61b7292e236e3357b5185a3bc218265c3c"}
May 29 01:58:26.632861 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.632832    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 01:53:24 +0000 UTC" deadline="2027-12-30 17:59:43.249206162 +0000 UTC"
May 29 01:58:26.632861 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:26.632860    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13936h1m16.61634904s"
May 29 01:58:27.202217 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:27.201783    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:27.202217 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:27.201830    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:27.202217 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:27.201874    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:27.202217 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202006    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:27.202217 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202149    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 01:58:27.202217 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202222    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:29.202047249 +0000 UTC m=+6.180754058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:27.202694 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202247    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 01:58:27.202694 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202275    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 01:58:27.202694 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202289    2550 projected.go:194] Error preparing data for projected volume kube-api-access-l6nw9 for pod openshift-network-diagnostics/network-check-target-gftwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:27.202694 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202258    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret podName:c80ba141-974c-4344-8219-17a591c8aedc nodeName:}" failed. No retries permitted until 2026-05-29 01:58:29.20224441 +0000 UTC m=+6.180951220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret") pod "global-pull-secret-syncer-hn8pt" (UID: "c80ba141-974c-4344-8219-17a591c8aedc") : object "kube-system"/"original-pull-secret" not registered
May 29 01:58:27.202694 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:27.202349    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9 podName:d4de6ec4-d835-4663-a7e8-8cf16be6e492 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:29.202331707 +0000 UTC m=+6.181038509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6nw9" (UniqueName: "kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9") pod "network-check-target-gftwp" (UID: "d4de6ec4-d835-4663-a7e8-8cf16be6e492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:27.616876 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:27.616793    2550 generic.go:358] "Generic (PLEG): container finished" podID="68f5b5563c41619cccb17e027d6f4fd3" containerID="99354fed6bfbf01d923c8f44070e6672f9d829bc88f154e7be2508ca07fe1ce1" exitCode=0
May 29 01:58:27.617365 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:27.617133    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal" event={"ID":"68f5b5563c41619cccb17e027d6f4fd3","Type":"ContainerDied","Data":"99354fed6bfbf01d923c8f44070e6672f9d829bc88f154e7be2508ca07fe1ce1"}
May 29 01:58:27.638512 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:27.638455    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-250.ec2.internal" podStartSLOduration=2.638437043 podStartE2EDuration="2.638437043s" podCreationTimestamp="2026-05-29 01:58:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 01:58:26.635284309 +0000 UTC m=+3.613991125" watchObservedRunningTime="2026-05-29 01:58:27.638437043 +0000 UTC m=+4.617143859"
May 29 01:58:28.578042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:28.576948    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:28.578042 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:28.577095    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:28.578042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:28.577493    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:28.578042 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:28.577595    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:28.578042 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:28.577650    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:28.578042 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:28.577716    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:28.631523 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:28.631485    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal" event={"ID":"68f5b5563c41619cccb17e027d6f4fd3","Type":"ContainerStarted","Data":"01c1cc4cecf72d03d2cbc7c44b073c4b7e6972b7f84a1ad0455724cf91f49b3a"}
May 29 01:58:28.657552 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:28.656945    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-250.ec2.internal" podStartSLOduration=3.6569223429999997 podStartE2EDuration="3.656922343s" podCreationTimestamp="2026-05-29 01:58:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 01:58:28.656511488 +0000 UTC m=+5.635218317" watchObservedRunningTime="2026-05-29 01:58:28.656922343 +0000 UTC m=+5.635629160"
May 29 01:58:29.217744 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:29.217710    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:29.217941 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:29.217762    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:29.217941 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:29.217805    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:29.218058 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.217942    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:29.218058 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.218004    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:33.217984178 +0000 UTC m=+10.196690972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:29.218454 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.218433    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 01:58:29.218544 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.218491    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret podName:c80ba141-974c-4344-8219-17a591c8aedc nodeName:}" failed. No retries permitted until 2026-05-29 01:58:33.218474586 +0000 UTC m=+10.197181382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret") pod "global-pull-secret-syncer-hn8pt" (UID: "c80ba141-974c-4344-8219-17a591c8aedc") : object "kube-system"/"original-pull-secret" not registered
May 29 01:58:29.218606 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.218584    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 01:58:29.218606 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.218597    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 01:58:29.218702 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.218609    2550 projected.go:194] Error preparing data for projected volume kube-api-access-l6nw9 for pod openshift-network-diagnostics/network-check-target-gftwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:29.218702 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:29.218645    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9 podName:d4de6ec4-d835-4663-a7e8-8cf16be6e492 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:33.218633092 +0000 UTC m=+10.197339888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6nw9" (UniqueName: "kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9") pod "network-check-target-gftwp" (UID: "d4de6ec4-d835-4663-a7e8-8cf16be6e492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:30.576999 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:30.576959    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:30.577526 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:30.577116    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:30.577598 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:30.577557    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:30.577694 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:30.577642    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:30.577759 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:30.577698    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:30.577812 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:30.577796    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:32.577016 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:32.576917    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:32.577484 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:32.577043    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:32.577484 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:32.577116    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:32.577484 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:32.577237    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:32.577484 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:32.577302    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:32.577484 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:32.577372    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:33.250458 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:33.250414    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:33.250711 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:33.250473    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:33.250711 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:33.250524    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:33.250711 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250594    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 01:58:33.250711 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250662    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:33.250711 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250672    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret podName:c80ba141-974c-4344-8219-17a591c8aedc nodeName:}" failed. No retries permitted until 2026-05-29 01:58:41.250650717 +0000 UTC m=+18.229357525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret") pod "global-pull-secret-syncer-hn8pt" (UID: "c80ba141-974c-4344-8219-17a591c8aedc") : object "kube-system"/"original-pull-secret" not registered
May 29 01:58:33.250711 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250714    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:41.250696511 +0000 UTC m=+18.229403309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:33.251044 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250796    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 01:58:33.251044 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250812    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 01:58:33.251044 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250825    2550 projected.go:194] Error preparing data for projected volume kube-api-access-l6nw9 for pod openshift-network-diagnostics/network-check-target-gftwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:33.251044 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:33.250858    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9 podName:d4de6ec4-d835-4663-a7e8-8cf16be6e492 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:41.250846831 +0000 UTC m=+18.229553624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6nw9" (UniqueName: "kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9") pod "network-check-target-gftwp" (UID: "d4de6ec4-d835-4663-a7e8-8cf16be6e492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:34.577482 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:34.576883    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:34.577482 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:34.577015    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:34.577482 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:34.577202    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:34.577482 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:34.577308    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:34.577482 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:34.577399    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:34.578176 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:34.577551    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:36.576723 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:36.576685    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:36.577202 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:36.576726    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:36.577202 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:36.576774    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:36.577202 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:36.576913    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:36.577202 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:36.576996    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:36.577202 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:36.577099    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:38.576905 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:38.576868    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:38.576905 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:38.576894    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:38.577445 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:38.576994    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:38.577445 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:38.577083    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:38.577445 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:38.577214    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:38.577445 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:38.577325    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:40.576881 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:40.576838    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:40.577329 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:40.576838    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:40.577329 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:40.576980    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:40.577329 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:40.576863    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:40.577329 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:40.577052    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:40.577329 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:40.577115    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:41.312914 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:41.312878    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:41.312960    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:41.312991    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313058    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313127    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313144    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313158    2550 projected.go:194] Error preparing data for projected volume kube-api-access-l6nw9 for pod openshift-network-diagnostics/network-check-target-gftwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313058    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 01:58:41.313199 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313147    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:57.313124609 +0000 UTC m=+34.291831406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:41.313534 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313215    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9 podName:d4de6ec4-d835-4663-a7e8-8cf16be6e492 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:57.313200237 +0000 UTC m=+34.291907042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6nw9" (UniqueName: "kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9") pod "network-check-target-gftwp" (UID: "d4de6ec4-d835-4663-a7e8-8cf16be6e492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:41.313534 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:41.313229    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret podName:c80ba141-974c-4344-8219-17a591c8aedc nodeName:}" failed. No retries permitted until 2026-05-29 01:58:57.313222045 +0000 UTC m=+34.291928838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret") pod "global-pull-secret-syncer-hn8pt" (UID: "c80ba141-974c-4344-8219-17a591c8aedc") : object "kube-system"/"original-pull-secret" not registered
May 29 01:58:42.577525 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:42.577489    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:42.577999 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:42.577546    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:42.577999 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:42.577510    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:42.577999 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:42.577618    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:42.577999 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:42.577713    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:42.577999 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:42.577849    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:44.576890 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.576664    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:44.576890 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:44.576781    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:44.577595 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.576908    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:44.577595 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.576908    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:44.577595 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:44.577043    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:44.577595 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:44.577097    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:44.664548 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.664322    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52f7n" event={"ID":"89e5c49b-cc90-4667-9ae6-b0919f55c4d8","Type":"ContainerStarted","Data":"73cb4573f36d1bbd9d92d0b1346276b5a6e82266488c99a7f3393f331195f5ea"}
May 29 01:58:44.667223 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.667193    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2" event={"ID":"ac51130d-1272-49be-b72e-81eaf857f870","Type":"ContainerStarted","Data":"3dc86ef732427bf3192255b3337ad1225c2fa3ca3a2587ed5a6b1952cf89e889"}
May 29 01:58:44.669438 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.668682    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpsvs" event={"ID":"1e0de9e7-453e-4a47-a70a-1112edc41370","Type":"ContainerStarted","Data":"e14e3cdaf84e4c27999d9bd1c272fa757df376615404ae01cfb38656487559e9"}
May 29 01:58:44.674115 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.674017    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-72m4c" event={"ID":"47539a4c-963c-40bb-8e9c-0e46eb16ff79","Type":"ContainerStarted","Data":"78aa1801ea3ebf0aaea2c0a258df947ccb657e3ec2a50843cdbfc2962510dbb9"}
May 29 01:58:44.675718 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.675687    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fs7b9" event={"ID":"c811a74b-d63a-4fb1-ac95-194f129942a9","Type":"ContainerStarted","Data":"7ec77c3425fc4ca49d306098d35ac034c36d36fdc8b0d94b7468db3f3d1bd16d"}
May 29 01:58:44.684592 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.684556    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-52f7n" podStartSLOduration=3.758959248 podStartE2EDuration="21.684546277s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.471629143 +0000 UTC m=+3.450335937" lastFinishedPulling="2026-05-29 01:58:44.397216172 +0000 UTC m=+21.375922966" observedRunningTime="2026-05-29 01:58:44.684361726 +0000 UTC m=+21.663068542" watchObservedRunningTime="2026-05-29 01:58:44.684546277 +0000 UTC m=+21.663253092"
May 29 01:58:44.703282 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.703199    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-72m4c" podStartSLOduration=11.812576051 podStartE2EDuration="21.703185232s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.472663885 +0000 UTC m=+3.451370682" lastFinishedPulling="2026-05-29 01:58:36.363272869 +0000 UTC m=+13.341979863" observedRunningTime="2026-05-29 01:58:44.703130655 +0000 UTC m=+21.681837473" watchObservedRunningTime="2026-05-29 01:58:44.703185232 +0000 UTC m=+21.681892083"
May 29 01:58:44.735327 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.735287    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dpsvs" podStartSLOduration=2.81228997 podStartE2EDuration="20.735272127s" podCreationTimestamp="2026-05-29 01:58:24 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.473620844 +0000 UTC m=+3.452327653" lastFinishedPulling="2026-05-29 01:58:44.396603017 +0000 UTC m=+21.375309810" observedRunningTime="2026-05-29 01:58:44.719532884 +0000 UTC m=+21.698239685" watchObservedRunningTime="2026-05-29 01:58:44.735272127 +0000 UTC m=+21.713978942"
May 29 01:58:44.735602 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:44.735579    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fs7b9" podStartSLOduration=2.810275067 podStartE2EDuration="20.735573609s" podCreationTimestamp="2026-05-29 01:58:24 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.470918248 +0000 UTC m=+3.449625055" lastFinishedPulling="2026-05-29 01:58:44.396216792 +0000 UTC m=+21.374923597" observedRunningTime="2026-05-29 01:58:44.735025698 +0000 UTC m=+21.713732515" watchObservedRunningTime="2026-05-29 01:58:44.735573609 +0000 UTC m=+21.714280425"
May 29 01:58:45.679584 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.679551    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6kzbs" event={"ID":"1ee1741e-1566-4108-aee5-d7e7894466f1","Type":"ContainerStarted","Data":"1007f457ba637f4bef0a5b74ec592fd1a487fd37dfac443730a35c510adcc4be"}
May 29 01:58:45.681823 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.681804    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 01:58:45.682086 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.682052    2550 generic.go:358] "Generic (PLEG): container finished" podID="3bcad6ba-25c6-4f4f-a565-5659a0e0adf1" containerID="230dd5b577008266f32a665efa4d980e7c097afca37011f5850e2d40594d1c69" exitCode=1
May 29 01:58:45.682161 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.682088    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"0b46e4258aede5a5097e82753a3c6ce388691ce0df2f4bc5bbf006deabe92cf7"}
May 29 01:58:45.682161 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.682112    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"e3345b8a7f5ce9e0c764ef270229f6545704a9e59177f5d89768ffb950dcd7e6"}
May 29 01:58:45.682161 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.682129    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"f081d95cee01fd1e2d3fd4556be2ce1858a250698ec89efeadb80319f5f51296"}
May 29 01:58:45.682161 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.682142    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"bf6ee828fefab121db556e4d78a8d4024774f92165d31e4b478aad3ca3df0009"}
May 29 01:58:45.682161 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.682152    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerDied","Data":"230dd5b577008266f32a665efa4d980e7c097afca37011f5850e2d40594d1c69"}
May 29 01:58:45.682365 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.682165    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"77ffd09e0164897fc6fda7401653b9bd9550e8467b361c1fea243421cf8a8b88"}
May 29 01:58:45.683363 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.683341    2550 generic.go:358] "Generic (PLEG): container finished" podID="27416c3a-bd51-40b1-82f3-246aa67620dc" containerID="5dd548928b9bbd13daa0cfa2c16d3804757284c2288159f13b4bc8d721475e28" exitCode=0
May 29 01:58:45.683456 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.683414    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerDied","Data":"5dd548928b9bbd13daa0cfa2c16d3804757284c2288159f13b4bc8d721475e28"}
May 29 01:58:45.684857 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.684829    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ssb7m" event={"ID":"3a44aa4c-fcaf-424b-8aee-c0f141363937","Type":"ContainerStarted","Data":"30cd8619907138499febbbcce8deda188a92aa7351d2db489e1b064df16572af"}
May 29 01:58:45.726246 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.726211    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6kzbs" podStartSLOduration=4.804360367 podStartE2EDuration="22.726196691s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.474328003 +0000 UTC m=+3.453034810" lastFinishedPulling="2026-05-29 01:58:44.396164326 +0000 UTC m=+21.374871134" observedRunningTime="2026-05-29 01:58:45.698979571 +0000 UTC m=+22.677686383" watchObservedRunningTime="2026-05-29 01:58:45.726196691 +0000 UTC m=+22.704903507"
May 29 01:58:45.741309 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.741290    2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 29 01:58:45.743697 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:45.743662    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ssb7m" podStartSLOduration=4.794542747 podStartE2EDuration="22.743650682s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.468022679 +0000 UTC m=+3.446729485" lastFinishedPulling="2026-05-29 01:58:44.417130614 +0000 UTC m=+21.395837420" observedRunningTime="2026-05-29 01:58:45.743340417 +0000 UTC m=+22.722047231" watchObservedRunningTime="2026-05-29 01:58:45.743650682 +0000 UTC m=+22.722357497"
May 29 01:58:46.537532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.537369    2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T01:58:45.741304293Z","UUID":"dababe9a-ee98-42bb-9187-02edf0080540","Handler":null,"Name":"","Endpoint":""}
May 29 01:58:46.539420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.539392    2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 29 01:58:46.539420 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.539426    2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 29 01:58:46.559868 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.559816    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:46.560510 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.560485    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:46.576718 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.576634    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:46.576718 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.576671    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:46.577034 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:46.576742    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:46.577034 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.576814    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:46.577034 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:46.576920    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:46.577034 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:46.576989    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:46.688421 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.688380    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2" event={"ID":"ac51130d-1272-49be-b72e-81eaf857f870","Type":"ContainerStarted","Data":"cf3d0e9ea792fad28e83eecd49aee7e868896b8031a4d6dc9f0a48d0bc0a80c2"}
May 29 01:58:46.688943 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.688653    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:46.689147 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:46.689124    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fs7b9"
May 29 01:58:47.692283 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:47.692228    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2" event={"ID":"ac51130d-1272-49be-b72e-81eaf857f870","Type":"ContainerStarted","Data":"15b492ea13a8c75d617c5f742dd816ba6979b5449e2104a4f404a668522c234b"}
May 29 01:58:47.695291 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:47.695270    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 01:58:47.695700 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:47.695675    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"2c16eb04fd9abf3177c450bf3ac3f9d93f087b5bdf9bf7b4471d8a3bb8e3b14e"}
May 29 01:58:47.712860 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:47.712815    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-84jl2" podStartSLOduration=4.4003567310000005 podStartE2EDuration="24.71280211s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.462553565 +0000 UTC m=+3.441260375" lastFinishedPulling="2026-05-29 01:58:46.774998946 +0000 UTC m=+23.753705754" observedRunningTime="2026-05-29 01:58:47.712084331 +0000 UTC m=+24.690791150" watchObservedRunningTime="2026-05-29 01:58:47.71280211 +0000 UTC m=+24.691508924"
May 29 01:58:48.577674 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:48.577645    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:48.577859 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:48.577645    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:48.577859 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:48.577774    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:48.577859 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:48.577655    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:48.578011 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:48.577855    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:48.578011 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:48.577919    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:49.703258 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.703037    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 01:58:49.703702 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.703612    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"878aba364a738041ff9a4285bc488c8d6bfb32fe61da8d3a2c0f98811fc0d789"}
May 29 01:58:49.704327 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.704162    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:49.704327 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.704263    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:49.704327 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.704324    2550 scope.go:117] "RemoveContainer" containerID="230dd5b577008266f32a665efa4d980e7c097afca37011f5850e2d40594d1c69"
May 29 01:58:49.704606 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.704323    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:49.706580 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.706557    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerStarted","Data":"1c3f7091607457574a6a275a29747c9feabd6a9a95ce56f630c72484ceee0c29"}
May 29 01:58:49.722390 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.722365    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:49.722807 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:49.722789    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:58:50.576689 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.576654    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:50.576874 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.576655    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:50.576874 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.576774    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:50.576874 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:50.576774    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:50.576874 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:50.576839    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:50.577056 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:50.576901    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:50.709806 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.709773    2550 generic.go:358] "Generic (PLEG): container finished" podID="27416c3a-bd51-40b1-82f3-246aa67620dc" containerID="1c3f7091607457574a6a275a29747c9feabd6a9a95ce56f630c72484ceee0c29" exitCode=0
May 29 01:58:50.710238 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.709851    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerDied","Data":"1c3f7091607457574a6a275a29747c9feabd6a9a95ce56f630c72484ceee0c29"}
May 29 01:58:50.713040 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.713023    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 01:58:50.713335 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.713313    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" event={"ID":"3bcad6ba-25c6-4f4f-a565-5659a0e0adf1","Type":"ContainerStarted","Data":"6cc5664ff52af46cace1e41b29f5644ec1a797ed692b7c14b39eec91126d8a1f"}
May 29 01:58:50.780046 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:50.779986    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh" podStartSLOduration=9.797589412 podStartE2EDuration="27.779969452s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.463260065 +0000 UTC m=+3.441966872" lastFinishedPulling="2026-05-29 01:58:44.445640119 +0000 UTC m=+21.424346912" observedRunningTime="2026-05-29 01:58:50.774517961 +0000 UTC m=+27.753224779" watchObservedRunningTime="2026-05-29 01:58:50.779969452 +0000 UTC m=+27.758676267"
May 29 01:58:51.546948 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.546765    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9z94"]
May 29 01:58:51.547134 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.547037    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:51.547201 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:51.547174    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:51.552538 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.552509    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gftwp"]
May 29 01:58:51.552712 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.552629    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:51.552814 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:51.552762    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:51.553430 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.553409    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hn8pt"]
May 29 01:58:51.553526 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.553495    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:51.553620 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:51.553597    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:51.717395 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.717363    2550 generic.go:358] "Generic (PLEG): container finished" podID="27416c3a-bd51-40b1-82f3-246aa67620dc" containerID="bfb00ecda53449f32625092b2b4a64f8ac3848f00822cdc0aefb19f6d83ad6d7" exitCode=0
May 29 01:58:51.717769 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:51.717437    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerDied","Data":"bfb00ecda53449f32625092b2b4a64f8ac3848f00822cdc0aefb19f6d83ad6d7"}
May 29 01:58:52.721324 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:52.721299    2550 generic.go:358] "Generic (PLEG): container finished" podID="27416c3a-bd51-40b1-82f3-246aa67620dc" containerID="ee496a2f035ceb92745481275268003bdfd653fe8b3bcfd12088152c8f3ed5eb" exitCode=0
May 29 01:58:52.721696 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:52.721333    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerDied","Data":"ee496a2f035ceb92745481275268003bdfd653fe8b3bcfd12088152c8f3ed5eb"}
May 29 01:58:53.577824 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:53.577792    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:53.577990 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:53.577904    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:53.577990 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:53.577926    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:53.578145 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:53.577984    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:53.578145 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:53.578029    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:53.578145 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:53.578114    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:55.576782 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:55.576732    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:55.576782 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:55.576769    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:55.577546 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:55.576732    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:55.577546 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:55.576890    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9z94" podUID="0cfe0b02-2217-4c1c-a6e1-6f432167e1c1"
May 29 01:58:55.577546 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:55.577002    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gftwp" podUID="d4de6ec4-d835-4663-a7e8-8cf16be6e492"
May 29 01:58:55.577546 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:55.577119    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hn8pt" podUID="c80ba141-974c-4344-8219-17a591c8aedc"
May 29 01:58:57.342093 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.342040    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.342108    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.342153    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342205    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342247    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342267    2550 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342278    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret podName:c80ba141-974c-4344-8219-17a591c8aedc nodeName:}" failed. No retries permitted until 2026-05-29 01:59:29.342259694 +0000 UTC m=+66.320966506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret") pod "global-pull-secret-syncer-hn8pt" (UID: "c80ba141-974c-4344-8219-17a591c8aedc") : object "kube-system"/"original-pull-secret" not registered
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342280    2550 projected.go:194] Error preparing data for projected volume kube-api-access-l6nw9 for pod openshift-network-diagnostics/network-check-target-gftwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342319    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9 podName:d4de6ec4-d835-4663-a7e8-8cf16be6e492 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:29.342309026 +0000 UTC m=+66.321015832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6nw9" (UniqueName: "kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9") pod "network-check-target-gftwp" (UID: "d4de6ec4-d835-4663-a7e8-8cf16be6e492") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342278    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:57.342603 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.342353    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:29.342344081 +0000 UTC m=+66.321050878 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 01:58:57.374310 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.374284    2550 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-250.ec2.internal" event="NodeReady"
May 29 01:58:57.374482 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.374415    2550 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 29 01:58:57.475836 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.475753    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4sqjp"]
May 29 01:58:57.534711 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.534670    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gs4fc"]
May 29 01:58:57.534889 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.534869    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.538930 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.538906    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7t46n\""
May 29 01:58:57.539086 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.538907    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 29 01:58:57.539813 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.539785    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 29 01:58:57.547383 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.547364    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gs4fc"]
May 29 01:58:57.547474 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.547388    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4sqjp"]
May 29 01:58:57.547532 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.547474    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:57.550766 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.550748    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 29 01:58:57.551413 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.551392    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 29 01:58:57.551534 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.551504    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 29 01:58:57.552142 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.552121    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fmgpb\""
May 29 01:58:57.577757 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.577726    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:58:57.577926 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.577726    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:58:57.578000 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.577728    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:58:57.583199 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.583152    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 01:58:57.584204 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.584185    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 01:58:57.584343 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.584244    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 01:58:57.584343 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.584288    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cbkht\""
May 29 01:58:57.584343 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.584296    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27b64\""
May 29 01:58:57.584343 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.584340    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 01:58:57.644792 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.644754    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:57.644968 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.644799    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c76f1fdf-243d-43d9-a2db-3221ff958fe8-config-volume\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.644968 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.644856    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.644968 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.644888    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76f1fdf-243d-43d9-a2db-3221ff958fe8-tmp-dir\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.644968 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.644919    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tpn2\" (UniqueName: \"kubernetes.io/projected/a1366c6d-ab3a-4885-863c-afc4c22d7330-kube-api-access-2tpn2\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:57.645180 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.645052    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8pxj\" (UniqueName: \"kubernetes.io/projected/c76f1fdf-243d-43d9-a2db-3221ff958fe8-kube-api-access-r8pxj\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.745763 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.745670    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76f1fdf-243d-43d9-a2db-3221ff958fe8-tmp-dir\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.745763 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.745716    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tpn2\" (UniqueName: \"kubernetes.io/projected/a1366c6d-ab3a-4885-863c-afc4c22d7330-kube-api-access-2tpn2\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:57.745986 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.745792    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8pxj\" (UniqueName: \"kubernetes.io/projected/c76f1fdf-243d-43d9-a2db-3221ff958fe8-kube-api-access-r8pxj\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.745986 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.745815    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:57.745986 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.745899    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 01:58:57.745986 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.745968    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:58.245947157 +0000 UTC m=+35.224653953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 01:58:57.746216 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.746104    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c76f1fdf-243d-43d9-a2db-3221ff958fe8-config-volume\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.746216 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.746158    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c76f1fdf-243d-43d9-a2db-3221ff958fe8-tmp-dir\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.746216 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.746172    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.746366 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.746247    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 01:58:57.746366 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:57.746306    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:58.246289447 +0000 UTC m=+35.224996241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 01:58:57.746646 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.746622    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c76f1fdf-243d-43d9-a2db-3221ff958fe8-config-volume\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.759828 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.759658    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8pxj\" (UniqueName: \"kubernetes.io/projected/c76f1fdf-243d-43d9-a2db-3221ff958fe8-kube-api-access-r8pxj\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:57.762627 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:57.762603    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tpn2\" (UniqueName: \"kubernetes.io/projected/a1366c6d-ab3a-4885-863c-afc4c22d7330-kube-api-access-2tpn2\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:58.251083 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:58.251042    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:58.251257 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:58.251198    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 01:58:58.251257 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:58.251215    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:58.251257 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:58.251259    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:59.251243476 +0000 UTC m=+36.229950268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 01:58:58.251418 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:58.251298    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 01:58:58.251418 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:58.251347    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 01:58:59.251336485 +0000 UTC m=+36.230043278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 01:58:58.735424 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:58.735396    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerStarted","Data":"7c08b8cc94dad7bf9fb6e8a585f757391a1af7dacedafe81e98fed6ae1712859"}
May 29 01:58:59.257659 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:59.257621    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:58:59.257827 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:59.257672    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:58:59.257827 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:59.257774    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 01:58:59.257827 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:59.257777    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 01:58:59.257924 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:59.257831    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:01.257816644 +0000 UTC m=+38.236523442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 01:58:59.257924 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:58:59.257844    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:01.257838592 +0000 UTC m=+38.236545390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 01:58:59.739621 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:59.739588    2550 generic.go:358] "Generic (PLEG): container finished" podID="27416c3a-bd51-40b1-82f3-246aa67620dc" containerID="7c08b8cc94dad7bf9fb6e8a585f757391a1af7dacedafe81e98fed6ae1712859" exitCode=0
May 29 01:58:59.739981 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:58:59.739628    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerDied","Data":"7c08b8cc94dad7bf9fb6e8a585f757391a1af7dacedafe81e98fed6ae1712859"}
May 29 01:59:00.743916 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:00.743882    2550 generic.go:358] "Generic (PLEG): container finished" podID="27416c3a-bd51-40b1-82f3-246aa67620dc" containerID="3599ed7b1a3cb9ea9c9440b8eeab8f7c9632dced8a12923408bb822399781c43" exitCode=0
May 29 01:59:00.744337 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:00.743933    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerDied","Data":"3599ed7b1a3cb9ea9c9440b8eeab8f7c9632dced8a12923408bb822399781c43"}
May 29 01:59:01.273563 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:01.273529    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:59:01.273705 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:01.273577    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:59:01.273705 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:01.273664    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 01:59:01.273705 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:01.273667    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 01:59:01.273808 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:01.273712    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:05.273698038 +0000 UTC m=+42.252404830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 01:59:01.273808 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:01.273723    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:05.273717932 +0000 UTC m=+42.252424724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 01:59:01.748813 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:01.748778    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" event={"ID":"27416c3a-bd51-40b1-82f3-246aa67620dc","Type":"ContainerStarted","Data":"f18a31b83cb1eeab721530be80493dbc9f2254a570dbd2a3a85b6e9ff6537637"}
May 29 01:59:01.798577 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:01.798526    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6q9vq" podStartSLOduration=6.802580094 podStartE2EDuration="38.798511645s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:58:26.467773191 +0000 UTC m=+3.446479984" lastFinishedPulling="2026-05-29 01:58:58.463704741 +0000 UTC m=+35.442411535" observedRunningTime="2026-05-29 01:59:01.798420907 +0000 UTC m=+38.777127721" watchObservedRunningTime="2026-05-29 01:59:01.798511645 +0000 UTC m=+38.777218470"
May 29 01:59:05.302950 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:05.302903    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:59:05.302950 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:05.302960    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:59:05.303382 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:05.303087    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 01:59:05.303382 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:05.303110    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 01:59:05.303382 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:05.303142    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:13.303127236 +0000 UTC m=+50.281834030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 01:59:05.303382 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:05.303176    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:13.30316183 +0000 UTC m=+50.281868623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 01:59:13.360244 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:13.360201    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:59:13.360244 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:13.360254    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:59:13.360846 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:13.360348    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 01:59:13.360846 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:13.360367    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 01:59:13.360846 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:13.360411    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:29.3603968 +0000 UTC m=+66.339103593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 01:59:13.360846 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:13.360435    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 01:59:29.360416708 +0000 UTC m=+66.339123517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 01:59:21.734368 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:21.734338    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7v5zh"
May 29 01:59:29.366666 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.366613    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 01:59:29.366666 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.366672    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:59:29.367361 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.366692    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:59:29.367361 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.366715    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 01:59:29.367361 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.366734    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 01:59:29.367361 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:29.366788    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 01:59:29.367361 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:29.366860    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:01.366842793 +0000 UTC m=+98.345549588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 01:59:29.367361 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:29.366880    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 01:59:29.367361 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:29.366938    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:01.366920741 +0000 UTC m=+98.345627548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 01:59:29.370056 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.370041    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 01:59:29.371015 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.371002    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 01:59:29.371080 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.371004    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 01:59:29.377135 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:29.377117    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 01:59:29.377266 ip-10-0-141-250 kubenswrapper[2550]: E0529 01:59:29.377181    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs podName:0cfe0b02-2217-4c1c-a6e1-6f432167e1c1 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:33.377165242 +0000 UTC m=+130.355872035 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs") pod "network-metrics-daemon-l9z94" (UID: "0cfe0b02-2217-4c1c-a6e1-6f432167e1c1") : secret "metrics-daemon-secret" not found
May 29 01:59:29.379824 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.379808    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 01:59:29.380256 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.380238    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c80ba141-974c-4344-8219-17a591c8aedc-original-pull-secret\") pod \"global-pull-secret-syncer-hn8pt\" (UID: \"c80ba141-974c-4344-8219-17a591c8aedc\") " pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:59:29.390120 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.390099    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6nw9\" (UniqueName: \"kubernetes.io/projected/d4de6ec4-d835-4663-a7e8-8cf16be6e492-kube-api-access-l6nw9\") pod \"network-check-target-gftwp\" (UID: \"d4de6ec4-d835-4663-a7e8-8cf16be6e492\") " pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:59:29.390210 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.390194    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hn8pt"
May 29 01:59:29.401126 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.401105    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27b64\""
May 29 01:59:29.408692 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.408672    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:59:29.558847 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.558812    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gftwp"]
May 29 01:59:29.561964 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:59:29.561934    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4de6ec4_d835_4663_a7e8_8cf16be6e492.slice/crio-4e239c331174be0777855895e847cec65e543e7daab7661dd9df375af28dcd26 WatchSource:0}: Error finding container 4e239c331174be0777855895e847cec65e543e7daab7661dd9df375af28dcd26: Status 404 returned error can't find the container with id 4e239c331174be0777855895e847cec65e543e7daab7661dd9df375af28dcd26
May 29 01:59:29.580549 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.580525    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hn8pt"]
May 29 01:59:29.583411 ip-10-0-141-250 kubenswrapper[2550]: W0529 01:59:29.583388    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80ba141_974c_4344_8219_17a591c8aedc.slice/crio-9a2e6bf6667cc46b4fa81f97ef21b13c6a07013ab4c82a7a2954e8a76a1868ae WatchSource:0}: Error finding container 9a2e6bf6667cc46b4fa81f97ef21b13c6a07013ab4c82a7a2954e8a76a1868ae: Status 404 returned error can't find the container with id 9a2e6bf6667cc46b4fa81f97ef21b13c6a07013ab4c82a7a2954e8a76a1868ae
May 29 01:59:29.801197 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.801090    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gftwp" event={"ID":"d4de6ec4-d835-4663-a7e8-8cf16be6e492","Type":"ContainerStarted","Data":"4e239c331174be0777855895e847cec65e543e7daab7661dd9df375af28dcd26"}
May 29 01:59:29.802020 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:29.801998    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hn8pt" event={"ID":"c80ba141-974c-4344-8219-17a591c8aedc","Type":"ContainerStarted","Data":"9a2e6bf6667cc46b4fa81f97ef21b13c6a07013ab4c82a7a2954e8a76a1868ae"}
May 29 01:59:34.813087 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:34.813030    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hn8pt" event={"ID":"c80ba141-974c-4344-8219-17a591c8aedc","Type":"ContainerStarted","Data":"05475854e7df381a0691c90ad95abb2321d1ba75ef89fd80176667b1c8d3e9f2"}
May 29 01:59:34.814393 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:34.814371    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gftwp" event={"ID":"d4de6ec4-d835-4663-a7e8-8cf16be6e492","Type":"ContainerStarted","Data":"25dc15798b47022e923000f4ba470a8687203fd923b5829941f24f5ec7d16669"}
May 29 01:59:34.814509 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:34.814498    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 01:59:34.874940 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:34.874887    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gftwp" podStartSLOduration=67.576456443 podStartE2EDuration="1m11.87487088s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 01:59:29.563700967 +0000 UTC m=+66.542407760" lastFinishedPulling="2026-05-29 01:59:33.862115404 +0000 UTC m=+70.840822197" observedRunningTime="2026-05-29 01:59:34.874381461 +0000 UTC m=+71.853088278" watchObservedRunningTime="2026-05-29 01:59:34.87487088 +0000 UTC m=+71.853577694"
May 29 01:59:34.875354 ip-10-0-141-250 kubenswrapper[2550]: I0529 01:59:34.875329    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hn8pt" podStartSLOduration=66.595479075 podStartE2EDuration="1m10.875322869s" podCreationTimestamp="2026-05-29 01:58:24 +0000 UTC" firstStartedPulling="2026-05-29 01:59:29.584972316 +0000 UTC m=+66.563679108" lastFinishedPulling="2026-05-29 01:59:33.864816109 +0000 UTC m=+70.843522902" observedRunningTime="2026-05-29 01:59:34.844668466 +0000 UTC m=+71.823375280" watchObservedRunningTime="2026-05-29 01:59:34.875322869 +0000 UTC m=+71.854029684"
May 29 02:00:01.398127 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:01.398055    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 02:00:01.398127 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:01.398134    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 02:00:01.398591 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:01.398231    2550 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:00:01.398591 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:01.398305    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert podName:a1366c6d-ab3a-4885-863c-afc4c22d7330 nodeName:}" failed. No retries permitted until 2026-05-29 02:01:05.398288405 +0000 UTC m=+162.376995201 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert") pod "ingress-canary-gs4fc" (UID: "a1366c6d-ab3a-4885-863c-afc4c22d7330") : secret "canary-serving-cert" not found
May 29 02:00:01.398591 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:01.398231    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:00:01.398591 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:01.398371    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls podName:c76f1fdf-243d-43d9-a2db-3221ff958fe8 nodeName:}" failed. No retries permitted until 2026-05-29 02:01:05.398357437 +0000 UTC m=+162.377064230 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls") pod "dns-default-4sqjp" (UID: "c76f1fdf-243d-43d9-a2db-3221ff958fe8") : secret "dns-default-metrics-tls" not found
May 29 02:00:05.818752 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:05.818719    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gftwp"
May 29 02:00:13.593194 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.593161    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"]
May 29 02:00:13.595443 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.595421    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fb8c7d575-f74tc"]
May 29 02:00:13.595623 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.595602    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"
May 29 02:00:13.597278 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.597255    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.598651 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.598628    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qqf4b\""
May 29 02:00:13.599439 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.599423    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 29 02:00:13.599659 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.599644    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 29 02:00:13.599715 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.599644    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lgt9q\""
May 29 02:00:13.599910 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.599895    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 29 02:00:13.604790 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.604772    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 29 02:00:13.608693 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.608670    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"]
May 29 02:00:13.609447 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.609428    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fb8c7d575-f74tc"]
May 29 02:00:13.677884 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.677841    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk5p6\" (UniqueName: \"kubernetes.io/projected/5f735939-dae5-4d7f-853a-9565a9c4c6df-kube-api-access-dk5p6\") pod \"network-check-source-7f44b6dd87-x6vdm\" (UID: \"5f735939-dae5-4d7f-853a-9565a9c4c6df\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"
May 29 02:00:13.677884 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.677883    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a00798-c6de-4340-bd6f-69332665c897-ca-trust-extracted\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.678179 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.677903    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-bound-sa-token\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.678179 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.678013    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-trusted-ca\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.678179 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.678081    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-registry-certificates\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.678179 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.678116    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-988bm\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-kube-api-access-988bm\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.678179 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.678149    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.678362 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.678214    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-image-registry-private-configuration\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.678362 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.678240    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-installation-pull-secrets\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.679988 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.679962    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"]
May 29 02:00:13.682108 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.682094    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.683745 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.683695    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-wkc46"]
May 29 02:00:13.684502 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.684478    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 29 02:00:13.685431 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.685416    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.685975 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.685958    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 29 02:00:13.686047 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.685998    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 29 02:00:13.686111 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.686081    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 29 02:00:13.686153 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.686126    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gntwd\""
May 29 02:00:13.688489 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.688467    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 29 02:00:13.688735 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.688721    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rcbgq\""
May 29 02:00:13.688972 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.688957    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 29 02:00:13.689054 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.688970    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 29 02:00:13.689758 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.689739    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 29 02:00:13.696280 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.696248    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 29 02:00:13.697395 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.697365    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"]
May 29 02:00:13.700843 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.700818    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-wkc46"]
May 29 02:00:13.779135 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779096    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a1987b3-8d48-403a-8c6b-c0f077176fca-serving-cert\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.779135 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779138    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh28f\" (UniqueName: \"kubernetes.io/projected/9a1987b3-8d48-403a-8c6b-c0f077176fca-kube-api-access-kh28f\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.779398 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779240    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dk5p6\" (UniqueName: \"kubernetes.io/projected/5f735939-dae5-4d7f-853a-9565a9c4c6df-kube-api-access-dk5p6\") pod \"network-check-source-7f44b6dd87-x6vdm\" (UID: \"5f735939-dae5-4d7f-853a-9565a9c4c6df\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"
May 29 02:00:13.779398 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779279    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a00798-c6de-4340-bd6f-69332665c897-ca-trust-extracted\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779398 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779305    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-bound-sa-token\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779398 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779350    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1987b3-8d48-403a-8c6b-c0f077176fca-service-ca-bundle\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.779398 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779383    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.779612 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779436    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-trusted-ca\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779612 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779508    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-registry-certificates\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779612 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779565    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9a1987b3-8d48-403a-8c6b-c0f077176fca-snapshots\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.779722 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779620    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-988bm\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-kube-api-access-988bm\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779722 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779655    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdh82\" (UniqueName: \"kubernetes.io/projected/a041f7bf-9420-4d09-b7c3-6897933d87ea-kube-api-access-mdh82\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.779722 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779688    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a041f7bf-9420-4d09-b7c3-6897933d87ea-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.779722 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779709    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a00798-c6de-4340-bd6f-69332665c897-ca-trust-extracted\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779722 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779719    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779941 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779746    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1987b3-8d48-403a-8c6b-c0f077176fca-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.779941 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779777    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a1987b3-8d48-403a-8c6b-c0f077176fca-tmp\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.779941 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779809    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-image-registry-private-configuration\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779941 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:13.779813    2550 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:00:13.779941 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:13.779829    2550 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb8c7d575-f74tc: secret "image-registry-tls" not found
May 29 02:00:13.779941 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.779835    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-installation-pull-secrets\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.779941 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:13.779889    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls podName:53a00798-c6de-4340-bd6f-69332665c897 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:14.279868309 +0000 UTC m=+111.258575102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls") pod "image-registry-6fb8c7d575-f74tc" (UID: "53a00798-c6de-4340-bd6f-69332665c897") : secret "image-registry-tls" not found
May 29 02:00:13.780460 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.780441    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-trusted-ca\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.780665 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.780646    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-registry-certificates\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.782095 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.782076    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-installation-pull-secrets\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.782281 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.782265    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-image-registry-private-configuration\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.788880 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.788848    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-bound-sa-token\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.789056 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.789039    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-988bm\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-kube-api-access-988bm\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:13.789680 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.789664    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk5p6\" (UniqueName: \"kubernetes.io/projected/5f735939-dae5-4d7f-853a-9565a9c4c6df-kube-api-access-dk5p6\") pod \"network-check-source-7f44b6dd87-x6vdm\" (UID: \"5f735939-dae5-4d7f-853a-9565a9c4c6df\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"
May 29 02:00:13.880511 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880480    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1987b3-8d48-403a-8c6b-c0f077176fca-service-ca-bundle\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.880661 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880516    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.880661 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880556    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9a1987b3-8d48-403a-8c6b-c0f077176fca-snapshots\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.880661 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:13.880655    2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:00:13.880869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880680    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdh82\" (UniqueName: \"kubernetes.io/projected/a041f7bf-9420-4d09-b7c3-6897933d87ea-kube-api-access-mdh82\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.880869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880720    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a041f7bf-9420-4d09-b7c3-6897933d87ea-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.880869 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:13.880734    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls podName:a041f7bf-9420-4d09-b7c3-6897933d87ea nodeName:}" failed. No retries permitted until 2026-05-29 02:00:14.380713961 +0000 UTC m=+111.359420776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tx59c" (UID: "a041f7bf-9420-4d09-b7c3-6897933d87ea") : secret "cluster-monitoring-operator-tls" not found
May 29 02:00:13.880869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880774    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1987b3-8d48-403a-8c6b-c0f077176fca-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.880869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880803    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a1987b3-8d48-403a-8c6b-c0f077176fca-tmp\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.880869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880853    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a1987b3-8d48-403a-8c6b-c0f077176fca-serving-cert\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.881187 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.880928    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh28f\" (UniqueName: \"kubernetes.io/projected/9a1987b3-8d48-403a-8c6b-c0f077176fca-kube-api-access-kh28f\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.881297 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.881271    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9a1987b3-8d48-403a-8c6b-c0f077176fca-snapshots\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.881297 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.881285    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a1987b3-8d48-403a-8c6b-c0f077176fca-tmp\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.881392 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.881318    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1987b3-8d48-403a-8c6b-c0f077176fca-service-ca-bundle\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.881531 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.881515    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a041f7bf-9420-4d09-b7c3-6897933d87ea-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.881616 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.881599    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a1987b3-8d48-403a-8c6b-c0f077176fca-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.883182 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.883165    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a1987b3-8d48-403a-8c6b-c0f077176fca-serving-cert\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.891894 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.891865    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh28f\" (UniqueName: \"kubernetes.io/projected/9a1987b3-8d48-403a-8c6b-c0f077176fca-kube-api-access-kh28f\") pod \"insights-operator-78bdfb888c-wkc46\" (UID: \"9a1987b3-8d48-403a-8c6b-c0f077176fca\") " pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:13.892024 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.891898    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdh82\" (UniqueName: \"kubernetes.io/projected/a041f7bf-9420-4d09-b7c3-6897933d87ea-kube-api-access-mdh82\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:13.905711 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:13.905683    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"
May 29 02:00:14.001549 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.001522    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-wkc46"
May 29 02:00:14.025986 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.025956    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm"]
May 29 02:00:14.029241 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:14.029211    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f735939_dae5_4d7f_853a_9565a9c4c6df.slice/crio-c249ee41df93833ce86668a6cf529c443df61dab562f27f242fa95d0cf2018d1 WatchSource:0}: Error finding container c249ee41df93833ce86668a6cf529c443df61dab562f27f242fa95d0cf2018d1: Status 404 returned error can't find the container with id c249ee41df93833ce86668a6cf529c443df61dab562f27f242fa95d0cf2018d1
May 29 02:00:14.124853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.124811    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-wkc46"]
May 29 02:00:14.127873 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:14.127832    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1987b3_8d48_403a_8c6b_c0f077176fca.slice/crio-cdb9bd52d2c3aa0fe5295f4c81ed923489eca4740034b73c76c8aed58112c498 WatchSource:0}: Error finding container cdb9bd52d2c3aa0fe5295f4c81ed923489eca4740034b73c76c8aed58112c498: Status 404 returned error can't find the container with id cdb9bd52d2c3aa0fe5295f4c81ed923489eca4740034b73c76c8aed58112c498
May 29 02:00:14.284765 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.284731    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:14.284940 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:14.284884    2550 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:00:14.284940 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:14.284899    2550 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb8c7d575-f74tc: secret "image-registry-tls" not found
May 29 02:00:14.285012 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:14.284956    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls podName:53a00798-c6de-4340-bd6f-69332665c897 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:15.284937984 +0000 UTC m=+112.263644794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls") pod "image-registry-6fb8c7d575-f74tc" (UID: "53a00798-c6de-4340-bd6f-69332665c897") : secret "image-registry-tls" not found
May 29 02:00:14.385955 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.385862    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:14.386117 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:14.386038    2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:00:14.386162 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:14.386137    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls podName:a041f7bf-9420-4d09-b7c3-6897933d87ea nodeName:}" failed. No retries permitted until 2026-05-29 02:00:15.386116274 +0000 UTC m=+112.364823070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tx59c" (UID: "a041f7bf-9420-4d09-b7c3-6897933d87ea") : secret "cluster-monitoring-operator-tls" not found
May 29 02:00:14.888448 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.888406    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm" event={"ID":"5f735939-dae5-4d7f-853a-9565a9c4c6df","Type":"ContainerStarted","Data":"4c12df9b06d8b6d40edd2aa6117d436a96e58a0eebe6388fb6b6126d1dc7b86b"}
May 29 02:00:14.888448 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.888452    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm" event={"ID":"5f735939-dae5-4d7f-853a-9565a9c4c6df","Type":"ContainerStarted","Data":"c249ee41df93833ce86668a6cf529c443df61dab562f27f242fa95d0cf2018d1"}
May 29 02:00:14.889795 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.889754    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wkc46" event={"ID":"9a1987b3-8d48-403a-8c6b-c0f077176fca","Type":"ContainerStarted","Data":"cdb9bd52d2c3aa0fe5295f4c81ed923489eca4740034b73c76c8aed58112c498"}
May 29 02:00:14.903181 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:14.903123    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x6vdm" podStartSLOduration=1.903106101 podStartE2EDuration="1.903106101s" podCreationTimestamp="2026-05-29 02:00:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:00:14.902537296 +0000 UTC m=+111.881244111" watchObservedRunningTime="2026-05-29 02:00:14.903106101 +0000 UTC m=+111.881812955"
May 29 02:00:15.292466 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:15.292378    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:15.292623 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:15.292543    2550 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:00:15.292623 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:15.292564    2550 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb8c7d575-f74tc: secret "image-registry-tls" not found
May 29 02:00:15.292623 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:15.292622    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls podName:53a00798-c6de-4340-bd6f-69332665c897 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:17.292606805 +0000 UTC m=+114.271313617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls") pod "image-registry-6fb8c7d575-f74tc" (UID: "53a00798-c6de-4340-bd6f-69332665c897") : secret "image-registry-tls" not found
May 29 02:00:15.393220 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:15.393178    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:15.393400 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:15.393313    2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:00:15.393400 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:15.393385    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls podName:a041f7bf-9420-4d09-b7c3-6897933d87ea nodeName:}" failed. No retries permitted until 2026-05-29 02:00:17.39336849 +0000 UTC m=+114.372075283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tx59c" (UID: "a041f7bf-9420-4d09-b7c3-6897933d87ea") : secret "cluster-monitoring-operator-tls" not found
May 29 02:00:15.893887 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:15.893605    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wkc46" event={"ID":"9a1987b3-8d48-403a-8c6b-c0f077176fca","Type":"ContainerStarted","Data":"d39b5dbe33f4839d6a6e10f8bd930991dd9b625db3fe11474b51ef64b26dc634"}
May 29 02:00:15.909976 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:15.909924    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-wkc46" podStartSLOduration=1.289653628 podStartE2EDuration="2.90991039s" podCreationTimestamp="2026-05-29 02:00:13 +0000 UTC" firstStartedPulling="2026-05-29 02:00:14.132245336 +0000 UTC m=+111.110952136" lastFinishedPulling="2026-05-29 02:00:15.75250209 +0000 UTC m=+112.731208898" observedRunningTime="2026-05-29 02:00:15.908936397 +0000 UTC m=+112.887643212" watchObservedRunningTime="2026-05-29 02:00:15.90991039 +0000 UTC m=+112.888617204"
May 29 02:00:17.309503 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:17.309465    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:17.309975 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:17.309631    2550 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:00:17.309975 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:17.309657    2550 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb8c7d575-f74tc: secret "image-registry-tls" not found
May 29 02:00:17.309975 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:17.309727    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls podName:53a00798-c6de-4340-bd6f-69332665c897 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:21.309704302 +0000 UTC m=+118.288411112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls") pod "image-registry-6fb8c7d575-f74tc" (UID: "53a00798-c6de-4340-bd6f-69332665c897") : secret "image-registry-tls" not found
May 29 02:00:17.410312 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:17.410277    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:17.410483 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:17.410421    2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:00:17.410524 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:17.410501    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls podName:a041f7bf-9420-4d09-b7c3-6897933d87ea nodeName:}" failed. No retries permitted until 2026-05-29 02:00:21.410484408 +0000 UTC m=+118.389191201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tx59c" (UID: "a041f7bf-9420-4d09-b7c3-6897933d87ea") : secret "cluster-monitoring-operator-tls" not found
May 29 02:00:18.428963 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:18.428936    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpsvs_1e0de9e7-453e-4a47-a70a-1112edc41370/dns-node-resolver/0.log"
May 29 02:00:19.428499 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:19.428475    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-72m4c_47539a4c-963c-40bb-8e9c-0e46eb16ff79/node-ca/0.log"
May 29 02:00:20.354781 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.354747    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ttsmn"]
May 29 02:00:20.356783 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.356766    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.359358 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.359334    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 29 02:00:20.359464 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.359376    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 29 02:00:20.360647 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.360627    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 29 02:00:20.360738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.360625    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 29 02:00:20.360738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.360636    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6xt6g\""
May 29 02:00:20.364182 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.364153    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ttsmn"]
May 29 02:00:20.433827 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.433783    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c3af8daa-79ec-4389-b4d6-a907ca803106-signing-key\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.434020 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.433836    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpm4d\" (UniqueName: \"kubernetes.io/projected/c3af8daa-79ec-4389-b4d6-a907ca803106-kube-api-access-xpm4d\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.434020 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.433930    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c3af8daa-79ec-4389-b4d6-a907ca803106-signing-cabundle\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.535078 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.535041    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c3af8daa-79ec-4389-b4d6-a907ca803106-signing-key\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.535229 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.535103    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpm4d\" (UniqueName: \"kubernetes.io/projected/c3af8daa-79ec-4389-b4d6-a907ca803106-kube-api-access-xpm4d\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.535287 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.535230    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c3af8daa-79ec-4389-b4d6-a907ca803106-signing-cabundle\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.535827 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.535807    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c3af8daa-79ec-4389-b4d6-a907ca803106-signing-cabundle\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.537495 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.537475    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c3af8daa-79ec-4389-b4d6-a907ca803106-signing-key\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.543848 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.543822    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpm4d\" (UniqueName: \"kubernetes.io/projected/c3af8daa-79ec-4389-b4d6-a907ca803106-kube-api-access-xpm4d\") pod \"service-ca-67d667c7d-ttsmn\" (UID: \"c3af8daa-79ec-4389-b4d6-a907ca803106\") " pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.665503 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.665463    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ttsmn"
May 29 02:00:20.791315 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.791279    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ttsmn"]
May 29 02:00:20.794141 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:20.794115    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3af8daa_79ec_4389_b4d6_a907ca803106.slice/crio-3149d4ac2b41374ce10ba2846c41945e06fb8d871adf850d5fcf966fb61dbe0c WatchSource:0}: Error finding container 3149d4ac2b41374ce10ba2846c41945e06fb8d871adf850d5fcf966fb61dbe0c: Status 404 returned error can't find the container with id 3149d4ac2b41374ce10ba2846c41945e06fb8d871adf850d5fcf966fb61dbe0c
May 29 02:00:20.904766 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:20.904722    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ttsmn" event={"ID":"c3af8daa-79ec-4389-b4d6-a907ca803106","Type":"ContainerStarted","Data":"3149d4ac2b41374ce10ba2846c41945e06fb8d871adf850d5fcf966fb61dbe0c"}
May 29 02:00:21.341890 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:21.341854    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:21.342098 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:21.342036    2550 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:00:21.342098 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:21.342059    2550 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb8c7d575-f74tc: secret "image-registry-tls" not found
May 29 02:00:21.342190 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:21.342148    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls podName:53a00798-c6de-4340-bd6f-69332665c897 nodeName:}" failed. No retries permitted until 2026-05-29 02:00:29.342124468 +0000 UTC m=+126.320831286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls") pod "image-registry-6fb8c7d575-f74tc" (UID: "53a00798-c6de-4340-bd6f-69332665c897") : secret "image-registry-tls" not found
May 29 02:00:21.443295 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:21.443244    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:21.443824 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:21.443422    2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:00:21.443824 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:21.443521    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls podName:a041f7bf-9420-4d09-b7c3-6897933d87ea nodeName:}" failed. No retries permitted until 2026-05-29 02:00:29.443499165 +0000 UTC m=+126.422205975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tx59c" (UID: "a041f7bf-9420-4d09-b7c3-6897933d87ea") : secret "cluster-monitoring-operator-tls" not found
May 29 02:00:22.910786 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:22.910744    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ttsmn" event={"ID":"c3af8daa-79ec-4389-b4d6-a907ca803106","Type":"ContainerStarted","Data":"bc74f74fb90946b1eeeaf207675689e06d3fff3bf09f0ed1824950ec61b585a6"}
May 29 02:00:22.928008 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:22.927957    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-ttsmn" podStartSLOduration=1.180286375 podStartE2EDuration="2.927941305s" podCreationTimestamp="2026-05-29 02:00:20 +0000 UTC" firstStartedPulling="2026-05-29 02:00:20.795989237 +0000 UTC m=+117.774696029" lastFinishedPulling="2026-05-29 02:00:22.543644153 +0000 UTC m=+119.522350959" observedRunningTime="2026-05-29 02:00:22.927783585 +0000 UTC m=+119.906490402" watchObservedRunningTime="2026-05-29 02:00:22.927941305 +0000 UTC m=+119.906648121"
May 29 02:00:29.403053 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.403008    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:29.405354 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.405331    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"image-registry-6fb8c7d575-f74tc\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") " pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:29.503869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.503831    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:29.504018 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:29.504000    2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:00:29.504115 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:00:29.504104    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls podName:a041f7bf-9420-4d09-b7c3-6897933d87ea nodeName:}" failed. No retries permitted until 2026-05-29 02:00:45.504083962 +0000 UTC m=+142.482790778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-tx59c" (UID: "a041f7bf-9420-4d09-b7c3-6897933d87ea") : secret "cluster-monitoring-operator-tls" not found
May 29 02:00:29.513544 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.513519    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lgt9q\""
May 29 02:00:29.521708 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.521687    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:29.646608 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.646579    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fb8c7d575-f74tc"]
May 29 02:00:29.649699 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:29.649667    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a00798_c6de_4340_bd6f_69332665c897.slice/crio-f096de6f5ee1f07ed35af8335b58390a2372ac64777a95b64eca53366809b173 WatchSource:0}: Error finding container f096de6f5ee1f07ed35af8335b58390a2372ac64777a95b64eca53366809b173: Status 404 returned error can't find the container with id f096de6f5ee1f07ed35af8335b58390a2372ac64777a95b64eca53366809b173
May 29 02:00:29.929130 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.929038    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc" event={"ID":"53a00798-c6de-4340-bd6f-69332665c897","Type":"ContainerStarted","Data":"8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea"}
May 29 02:00:29.929130 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.929088    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc" event={"ID":"53a00798-c6de-4340-bd6f-69332665c897","Type":"ContainerStarted","Data":"f096de6f5ee1f07ed35af8335b58390a2372ac64777a95b64eca53366809b173"}
May 29 02:00:29.929315 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.929174    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:00:29.953467 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:29.953405    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc" podStartSLOduration=16.953382354 podStartE2EDuration="16.953382354s" podCreationTimestamp="2026-05-29 02:00:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:00:29.952441766 +0000 UTC m=+126.931148582" watchObservedRunningTime="2026-05-29 02:00:29.953382354 +0000 UTC m=+126.932089170"
May 29 02:00:33.436104 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:33.436027    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 02:00:33.438304 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:33.438281    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cfe0b02-2217-4c1c-a6e1-6f432167e1c1-metrics-certs\") pod \"network-metrics-daemon-l9z94\" (UID: \"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1\") " pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 02:00:33.606048 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:33.606013    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cbkht\""
May 29 02:00:33.614433 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:33.614403    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9z94"
May 29 02:00:33.739463 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:33.739421    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9z94"]
May 29 02:00:33.742127 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:33.742096    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfe0b02_2217_4c1c_a6e1_6f432167e1c1.slice/crio-9cff8609d027a069f563ea6c4b6de53a0ed197bfa6db0ef3525fe75b885bf1cd WatchSource:0}: Error finding container 9cff8609d027a069f563ea6c4b6de53a0ed197bfa6db0ef3525fe75b885bf1cd: Status 404 returned error can't find the container with id 9cff8609d027a069f563ea6c4b6de53a0ed197bfa6db0ef3525fe75b885bf1cd
May 29 02:00:33.940814 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:33.940778    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9z94" event={"ID":"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1","Type":"ContainerStarted","Data":"9cff8609d027a069f563ea6c4b6de53a0ed197bfa6db0ef3525fe75b885bf1cd"}
May 29 02:00:35.949146 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:35.949103    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9z94" event={"ID":"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1","Type":"ContainerStarted","Data":"e6a694dd026d6347a5ce90c8c7bd7517a6986e93d34a56bcbe2ebe32d87e6aab"}
May 29 02:00:35.949146 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:35.949145    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9z94" event={"ID":"0cfe0b02-2217-4c1c-a6e1-6f432167e1c1","Type":"ContainerStarted","Data":"87c3bd0c07aaa685d5e8e5cca1f821d9078b97a1f3ea5d8f5c663850bced2101"}
May 29 02:00:35.966926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:35.966863    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l9z94" podStartSLOduration=131.655445082 podStartE2EDuration="2m12.966840685s" podCreationTimestamp="2026-05-29 01:58:23 +0000 UTC" firstStartedPulling="2026-05-29 02:00:33.744088791 +0000 UTC m=+130.722795591" lastFinishedPulling="2026-05-29 02:00:35.055484398 +0000 UTC m=+132.034191194" observedRunningTime="2026-05-29 02:00:35.965218151 +0000 UTC m=+132.943924963" watchObservedRunningTime="2026-05-29 02:00:35.966840685 +0000 UTC m=+132.945547500"
May 29 02:00:40.047905 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.047868    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"]
May 29 02:00:40.049986 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.049969    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.053085 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.053040    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 29 02:00:40.053323 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.053306    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 29 02:00:40.054391 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.054376    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vttjd\""
May 29 02:00:40.061119 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.061057    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"]
May 29 02:00:40.091259 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.091226    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kh8m5"]
May 29 02:00:40.093480 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.093456    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.096272 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.096246    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wczvh\""
May 29 02:00:40.096405 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.096250    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 29 02:00:40.097373 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.097355    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 29 02:00:40.111401 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.111374    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh8m5"]
May 29 02:00:40.146019 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.145986    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fb8c7d575-f74tc"]
May 29 02:00:40.172333 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.172304    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85d6fcddcf-kgq92"]
May 29 02:00:40.174280 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.174262    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.185535 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.185510    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d6fcddcf-kgq92"]
May 29 02:00:40.185799 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.185778    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6ebdc10-821d-44f8-b9ea-d0c98cf530e7-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-bxk79\" (UID: \"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.185951 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.185933    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6ebdc10-821d-44f8-b9ea-d0c98cf530e7-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-bxk79\" (UID: \"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.287283 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287243    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/903eacee-51c0-4a5a-bb87-777ec3e63d21-installation-pull-secrets\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.287469 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287292    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cbfq\" (UniqueName: \"kubernetes.io/projected/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-kube-api-access-8cbfq\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.287469 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287351    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/903eacee-51c0-4a5a-bb87-777ec3e63d21-ca-trust-extracted\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.287469 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287408    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4npx2\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-kube-api-access-4npx2\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.287609 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287467    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.287609 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287504    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/903eacee-51c0-4a5a-bb87-777ec3e63d21-image-registry-private-configuration\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.287609 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287526    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-data-volume\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.287609 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287544    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/903eacee-51c0-4a5a-bb87-777ec3e63d21-trusted-ca\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.287609 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287566    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/903eacee-51c0-4a5a-bb87-777ec3e63d21-registry-certificates\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.287761 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287641    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-bound-sa-token\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.287761 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287675    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.287761 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287696    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-crio-socket\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.287761 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287739    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6ebdc10-821d-44f8-b9ea-d0c98cf530e7-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-bxk79\" (UID: \"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.287874 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287805    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6ebdc10-821d-44f8-b9ea-d0c98cf530e7-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-bxk79\" (UID: \"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.287874 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.287837    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-registry-tls\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.288457 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.288428    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6ebdc10-821d-44f8-b9ea-d0c98cf530e7-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-bxk79\" (UID: \"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.290117 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.290097    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6ebdc10-821d-44f8-b9ea-d0c98cf530e7-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-bxk79\" (UID: \"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.359352 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.359327    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"
May 29 02:00:40.388908 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.388872    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4npx2\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-kube-api-access-4npx2\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.389079 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.388933    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.389079 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.388974    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/903eacee-51c0-4a5a-bb87-777ec3e63d21-image-registry-private-configuration\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.389079 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389003    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-data-volume\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.389079 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389028    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/903eacee-51c0-4a5a-bb87-777ec3e63d21-trusted-ca\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.389079 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389057    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/903eacee-51c0-4a5a-bb87-777ec3e63d21-registry-certificates\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.389333 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389111    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-bound-sa-token\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.389333 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389135    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.389333 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389161    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-crio-socket\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.389333 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389287    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-crio-socket\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.389507 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389487    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-registry-tls\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.389575 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389557    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/903eacee-51c0-4a5a-bb87-777ec3e63d21-installation-pull-secrets\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.389626 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389615    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cbfq\" (UniqueName: \"kubernetes.io/projected/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-kube-api-access-8cbfq\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.389676 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389649    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/903eacee-51c0-4a5a-bb87-777ec3e63d21-ca-trust-extracted\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.390242 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389793    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-data-volume\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.390242 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.389905    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.390242 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.390160    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/903eacee-51c0-4a5a-bb87-777ec3e63d21-ca-trust-extracted\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.390601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.390281    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/903eacee-51c0-4a5a-bb87-777ec3e63d21-registry-certificates\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.390601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.390364    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/903eacee-51c0-4a5a-bb87-777ec3e63d21-trusted-ca\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.392365 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.392341    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-registry-tls\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.392455 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.392388    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.392455 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.392410    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/903eacee-51c0-4a5a-bb87-777ec3e63d21-installation-pull-secrets\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.392809 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.392790    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/903eacee-51c0-4a5a-bb87-777ec3e63d21-image-registry-private-configuration\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.404723 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.400475    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4npx2\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-kube-api-access-4npx2\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.404723 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.401010    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/903eacee-51c0-4a5a-bb87-777ec3e63d21-bound-sa-token\") pod \"image-registry-85d6fcddcf-kgq92\" (UID: \"903eacee-51c0-4a5a-bb87-777ec3e63d21\") " pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.404723 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.401436    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cbfq\" (UniqueName: \"kubernetes.io/projected/5ae808a5-a3dd-4908-ae9b-3e79845eb41d-kube-api-access-8cbfq\") pod \"insights-runtime-extractor-kh8m5\" (UID: \"5ae808a5-a3dd-4908-ae9b-3e79845eb41d\") " pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.404723 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.404539    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh8m5"
May 29 02:00:40.482693 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.482664    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.500523 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.500494    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79"]
May 29 02:00:40.502685 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:40.502643    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ebdc10_821d_44f8_b9ea_d0c98cf530e7.slice/crio-61dabe3e24f570393e6c01ad6ff64cca9443b70f585eb9bba56201967bbb764e WatchSource:0}: Error finding container 61dabe3e24f570393e6c01ad6ff64cca9443b70f585eb9bba56201967bbb764e: Status 404 returned error can't find the container with id 61dabe3e24f570393e6c01ad6ff64cca9443b70f585eb9bba56201967bbb764e
May 29 02:00:40.549283 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.549250    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh8m5"]
May 29 02:00:40.553374 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:40.553342    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae808a5_a3dd_4908_ae9b_3e79845eb41d.slice/crio-611611b07c8c125569f1cc947cf8e343f5887947538c54362a2549b4ae8d16ad WatchSource:0}: Error finding container 611611b07c8c125569f1cc947cf8e343f5887947538c54362a2549b4ae8d16ad: Status 404 returned error can't find the container with id 611611b07c8c125569f1cc947cf8e343f5887947538c54362a2549b4ae8d16ad
May 29 02:00:40.615205 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.615177    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85d6fcddcf-kgq92"]
May 29 02:00:40.618486 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:40.618417    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903eacee_51c0_4a5a_bb87_777ec3e63d21.slice/crio-1655c8ac577c740d71c51b8ae7865c9b93c362d4834f3195b5dbb771e58c3302 WatchSource:0}: Error finding container 1655c8ac577c740d71c51b8ae7865c9b93c362d4834f3195b5dbb771e58c3302: Status 404 returned error can't find the container with id 1655c8ac577c740d71c51b8ae7865c9b93c362d4834f3195b5dbb771e58c3302
May 29 02:00:40.964152 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.964073    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8m5" event={"ID":"5ae808a5-a3dd-4908-ae9b-3e79845eb41d","Type":"ContainerStarted","Data":"bcb00b6e54a20355e152e7ea3953abc602f01ea3c4398421ca6d724e765b617b"}
May 29 02:00:40.964152 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.964110    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8m5" event={"ID":"5ae808a5-a3dd-4908-ae9b-3e79845eb41d","Type":"ContainerStarted","Data":"611611b07c8c125569f1cc947cf8e343f5887947538c54362a2549b4ae8d16ad"}
May 29 02:00:40.964995 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.964968    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79" event={"ID":"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7","Type":"ContainerStarted","Data":"61dabe3e24f570393e6c01ad6ff64cca9443b70f585eb9bba56201967bbb764e"}
May 29 02:00:40.966336 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.966314    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92" event={"ID":"903eacee-51c0-4a5a-bb87-777ec3e63d21","Type":"ContainerStarted","Data":"47ad836130f3410ee6112c70a6f0e259169cee2189f967f5a92d61eb1033c6d3"}
May 29 02:00:40.966435 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.966342    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92" event={"ID":"903eacee-51c0-4a5a-bb87-777ec3e63d21","Type":"ContainerStarted","Data":"1655c8ac577c740d71c51b8ae7865c9b93c362d4834f3195b5dbb771e58c3302"}
May 29 02:00:40.966480 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.966459    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:00:40.985628 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:40.985582    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92" podStartSLOduration=0.985565856 podStartE2EDuration="985.565856ms" podCreationTimestamp="2026-05-29 02:00:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:00:40.984734788 +0000 UTC m=+137.963441626" watchObservedRunningTime="2026-05-29 02:00:40.985565856 +0000 UTC m=+137.964272673"
May 29 02:00:41.970955 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:41.970917    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8m5" event={"ID":"5ae808a5-a3dd-4908-ae9b-3e79845eb41d","Type":"ContainerStarted","Data":"8b285a4b9b272951f5450ea7f3f9c6280f3f911d4596e42e89da7dbab2b090ac"}
May 29 02:00:41.972558 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:41.972523    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79" event={"ID":"b6ebdc10-821d-44f8-b9ea-d0c98cf530e7","Type":"ContainerStarted","Data":"1afdc454ffdccf3980b79b7581546be96a65d4cac44afc0f55ec2319a4a01e63"}
May 29 02:00:41.988581 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:41.988531    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-bxk79" podStartSLOduration=0.894574862 podStartE2EDuration="1.988514379s" podCreationTimestamp="2026-05-29 02:00:40 +0000 UTC" firstStartedPulling="2026-05-29 02:00:40.504588429 +0000 UTC m=+137.483295236" lastFinishedPulling="2026-05-29 02:00:41.598527958 +0000 UTC m=+138.577234753" observedRunningTime="2026-05-29 02:00:41.987198466 +0000 UTC m=+138.965905283" watchObservedRunningTime="2026-05-29 02:00:41.988514379 +0000 UTC m=+138.967221195"
May 29 02:00:42.977835 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:42.977799    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8m5" event={"ID":"5ae808a5-a3dd-4908-ae9b-3e79845eb41d","Type":"ContainerStarted","Data":"1f9b60db3d71c036dd3e5b965cebf8b59ef5d48ac16a55e387c6d3fd873daf3e"}
May 29 02:00:42.996219 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:42.996171    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kh8m5" podStartSLOduration=0.832891274 podStartE2EDuration="2.99615438s" podCreationTimestamp="2026-05-29 02:00:40 +0000 UTC" firstStartedPulling="2026-05-29 02:00:40.616996078 +0000 UTC m=+137.595702871" lastFinishedPulling="2026-05-29 02:00:42.780259184 +0000 UTC m=+139.758965977" observedRunningTime="2026-05-29 02:00:42.994349684 +0000 UTC m=+139.973056500" watchObservedRunningTime="2026-05-29 02:00:42.99615438 +0000 UTC m=+139.974861197"
May 29 02:00:45.531886 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:45.531839    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:45.534232 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:45.534193    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a041f7bf-9420-4d09-b7c3-6897933d87ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-tx59c\" (UID: \"a041f7bf-9420-4d09-b7c3-6897933d87ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:45.797092 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:45.796985    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gntwd\""
May 29 02:00:45.805225 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:45.805201    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"
May 29 02:00:45.927362 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:45.927216    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c"]
May 29 02:00:45.929900 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:00:45.929868    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda041f7bf_9420_4d09_b7c3_6897933d87ea.slice/crio-6604628c416ae597353b3f5eaf7c63f84e948fb540222b5f9a3df8bd04431c09 WatchSource:0}: Error finding container 6604628c416ae597353b3f5eaf7c63f84e948fb540222b5f9a3df8bd04431c09: Status 404 returned error can't find the container with id 6604628c416ae597353b3f5eaf7c63f84e948fb540222b5f9a3df8bd04431c09
May 29 02:00:45.986084 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:45.986035    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c" event={"ID":"a041f7bf-9420-4d09-b7c3-6897933d87ea","Type":"ContainerStarted","Data":"6604628c416ae597353b3f5eaf7c63f84e948fb540222b5f9a3df8bd04431c09"}
May 29 02:00:47.993144 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:47.993114    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c" event={"ID":"a041f7bf-9420-4d09-b7c3-6897933d87ea","Type":"ContainerStarted","Data":"3864c6fcf512e35cc6b432407493f70527f50c8d4c84d3ad2a16cd6720b1e62e"}
May 29 02:00:48.010703 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:48.010644    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-tx59c" podStartSLOduration=33.489252045 podStartE2EDuration="35.010626657s" podCreationTimestamp="2026-05-29 02:00:13 +0000 UTC" firstStartedPulling="2026-05-29 02:00:45.931825939 +0000 UTC m=+142.910532732" lastFinishedPulling="2026-05-29 02:00:47.45320054 +0000 UTC m=+144.431907344" observedRunningTime="2026-05-29 02:00:48.009100265 +0000 UTC m=+144.987807079" watchObservedRunningTime="2026-05-29 02:00:48.010626657 +0000 UTC m=+144.989333449"
May 29 02:00:50.155460 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:50.155407    2550 patch_prober.go:28] interesting pod/image-registry-6fb8c7d575-f74tc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 29 02:00:50.155853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:50.155493    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc" podUID="53a00798-c6de-4340-bd6f-69332665c897" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 02:00:59.677595 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.677561    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c598df5bd-qn8zb"]
May 29 02:00:59.680491 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.680472    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.683122 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.683100    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 29 02:00:59.683238 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.683149    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 29 02:00:59.684406 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.684380    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 29 02:00:59.684512 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.684385    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 29 02:00:59.684512 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.684415    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8pztx\""
May 29 02:00:59.684512 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.684469    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 29 02:00:59.684675 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.684537    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 29 02:00:59.684675 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.684631    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 29 02:00:59.688757 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.688736    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 29 02:00:59.690014 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.689988    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c598df5bd-qn8zb"]
May 29 02:00:59.744012 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.743978    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-config\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.744205 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.744024    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-serving-cert\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.744205 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.744139    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-oauth-config\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.744205 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.744175    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-service-ca\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.744205 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.744201    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-oauth-serving-cert\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.744342 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.744250    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-trusted-ca-bundle\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.744342 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.744272    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrb7\" (UniqueName: \"kubernetes.io/projected/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-kube-api-access-hhrb7\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.845383 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.845339    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-oauth-config\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.845383 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.845389    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-service-ca\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.845631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.845421    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-oauth-serving-cert\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.845631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.845455    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-trusted-ca-bundle\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.845631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.845478    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrb7\" (UniqueName: \"kubernetes.io/projected/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-kube-api-access-hhrb7\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.845631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.845533    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-config\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.845631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.845582    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-serving-cert\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.846367 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.846339    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-oauth-serving-cert\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.846490 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.846339    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-service-ca\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.846490 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.846339    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-config\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.846490 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.846410    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-trusted-ca-bundle\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.848403 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.848379    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-serving-cert\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.848403 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.848393    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-oauth-config\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.854316 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.854295    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrb7\" (UniqueName: \"kubernetes.io/projected/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-kube-api-access-hhrb7\") pod \"console-c598df5bd-qn8zb\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") " pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:00:59.989809 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:00:59.989722    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:01:00.116554 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:00.116521    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c598df5bd-qn8zb"]
May 29 02:01:00.120628 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:00.120592    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1a5bb4_582f_482c_8c91_0bf31ef7c1a1.slice/crio-29006154c9bb01f4faf2389ab7c99373cbeaf6b2ab940c5cc97a7e1cd6dee7aa WatchSource:0}: Error finding container 29006154c9bb01f4faf2389ab7c99373cbeaf6b2ab940c5cc97a7e1cd6dee7aa: Status 404 returned error can't find the container with id 29006154c9bb01f4faf2389ab7c99373cbeaf6b2ab940c5cc97a7e1cd6dee7aa
May 29 02:01:00.150422 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:00.150393    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:01:00.546736 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:00.546691    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4sqjp" podUID="c76f1fdf-243d-43d9-a2db-3221ff958fe8"
May 29 02:01:00.557117 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:00.557056    2550 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-gs4fc" podUID="a1366c6d-ab3a-4885-863c-afc4c22d7330"
May 29 02:01:01.029243 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:01.029206    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c598df5bd-qn8zb" event={"ID":"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1","Type":"ContainerStarted","Data":"29006154c9bb01f4faf2389ab7c99373cbeaf6b2ab940c5cc97a7e1cd6dee7aa"}
May 29 02:01:01.029243 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:01.029220    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4sqjp"
May 29 02:01:01.977341 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:01.977306    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85d6fcddcf-kgq92"
May 29 02:01:03.036791 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:03.036752    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c598df5bd-qn8zb" event={"ID":"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1","Type":"ContainerStarted","Data":"20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7"}
May 29 02:01:03.055781 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:03.055724    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c598df5bd-qn8zb" podStartSLOduration=1.307185341 podStartE2EDuration="4.055707567s" podCreationTimestamp="2026-05-29 02:00:59 +0000 UTC" firstStartedPulling="2026-05-29 02:01:00.122534239 +0000 UTC m=+157.101241035" lastFinishedPulling="2026-05-29 02:01:02.871056467 +0000 UTC m=+159.849763261" observedRunningTime="2026-05-29 02:01:03.055326379 +0000 UTC m=+160.034033194" watchObservedRunningTime="2026-05-29 02:01:03.055707567 +0000 UTC m=+160.034414382"
May 29 02:01:04.420144 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.420097    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"]
May 29 02:01:04.422778 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.422750    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.425675 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.425650    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 29 02:01:04.426813 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.426793    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 29 02:01:04.426924 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.426833    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jr8fr\""
May 29 02:01:04.427010 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.426991    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 29 02:01:04.440971 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.440716    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"]
May 29 02:01:04.449644 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.449604    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dclzf"]
May 29 02:01:04.452491 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.452465    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"]
May 29 02:01:04.455230 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.455199    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.455477 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.455255    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.461394 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.460547    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 29 02:01:04.461394 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.460896    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jwsv6\""
May 29 02:01:04.461394 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.461342    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"]
May 29 02:01:04.461655 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.461396    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 29 02:01:04.461655 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.461475    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jsgvb\""
May 29 02:01:04.461655 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.461652    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 29 02:01:04.461802 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.461707    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 29 02:01:04.461963 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.461946    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 29 02:01:04.462254 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.462180    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 29 02:01:04.483296 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.483266    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.483503 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.483327    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.483503 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.483354    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hd6v\" (UniqueName: \"kubernetes.io/projected/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-kube-api-access-2hd6v\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.483503 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.483457    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.584849 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.584806    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-wtmp\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585038 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.584857    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxx2h\" (UniqueName: \"kubernetes.io/projected/98480750-8ff4-43a2-8a06-333baaaf9623-kube-api-access-pxx2h\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.585038 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.584929    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.585038 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.584981    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-tls\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585038 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585015    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/98480750-8ff4-43a2-8a06-333baaaf9623-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.585271 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585040    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.585271 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585094    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-textfile\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585271 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:04.585110    2550 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 29 02:01:04.585271 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:04.585183    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-tls podName:ec5e7a97-ebd1-48d3-b222-3f5b70a363eb nodeName:}" failed. No retries permitted until 2026-05-29 02:01:05.085160094 +0000 UTC m=+162.063866890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-fzz6f" (UID: "ec5e7a97-ebd1-48d3-b222-3f5b70a363eb") : secret "openshift-state-metrics-tls" not found
May 29 02:01:04.585271 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585178    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.585271 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585220    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.585533 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585294    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.585533 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585324    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585533 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585366    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-sys\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585533 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585416    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585533 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585448    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k42v\" (UniqueName: \"kubernetes.io/projected/6876f49c-c16e-4e04-a9a1-a93c1676613e-kube-api-access-8k42v\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585533 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585487    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.585533 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585513    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hd6v\" (UniqueName: \"kubernetes.io/projected/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-kube-api-access-2hd6v\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.585857 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585545    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98480750-8ff4-43a2-8a06-333baaaf9623-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.585857 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585596    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-root\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.585857 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.585678    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6876f49c-c16e-4e04-a9a1-a93c1676613e-metrics-client-ca\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.586129 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.586083    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.588049 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.588026    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.608884 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.608845    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hd6v\" (UniqueName: \"kubernetes.io/projected/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-kube-api-access-2hd6v\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:04.687020 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.686922    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687020 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.686975    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-sys\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687020 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687013    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687047    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8k42v\" (UniqueName: \"kubernetes.io/projected/6876f49c-c16e-4e04-a9a1-a93c1676613e-kube-api-access-8k42v\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687103    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98480750-8ff4-43a2-8a06-333baaaf9623-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687129    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-sys\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687152    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-root\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687203    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-root\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687217    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6876f49c-c16e-4e04-a9a1-a93c1676613e-metrics-client-ca\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687250    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-wtmp\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687275    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxx2h\" (UniqueName: \"kubernetes.io/projected/98480750-8ff4-43a2-8a06-333baaaf9623-kube-api-access-pxx2h\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.687321 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687322    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-tls\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687352    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/98480750-8ff4-43a2-8a06-333baaaf9623-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.687738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687380    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.687738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687419    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-textfile\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687450    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.687738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687592    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-wtmp\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.687982 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.687917    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98480750-8ff4-43a2-8a06-333baaaf9623-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.688203 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.688180    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6876f49c-c16e-4e04-a9a1-a93c1676613e-metrics-client-ca\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.688306 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:04.688272    2550 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 29 02:01:04.688377 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:04.688361    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-tls podName:98480750-8ff4-43a2-8a06-333baaaf9623 nodeName:}" failed. No retries permitted until 2026-05-29 02:01:05.188341564 +0000 UTC m=+162.167048372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-7wsmg" (UID: "98480750-8ff4-43a2-8a06-333baaaf9623") : secret "kube-state-metrics-tls" not found
May 29 02:01:04.688486 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.688460    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/98480750-8ff4-43a2-8a06-333baaaf9623-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.688938 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.688778    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-textfile\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.688938 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.688803    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.688938 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.688832    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.689422 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.689404    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.690246 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.690197    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.690361 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.690260    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.690800 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.690777    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6876f49c-c16e-4e04-a9a1-a93c1676613e-node-exporter-tls\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.695301 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.695277    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k42v\" (UniqueName: \"kubernetes.io/projected/6876f49c-c16e-4e04-a9a1-a93c1676613e-kube-api-access-8k42v\") pod \"node-exporter-dclzf\" (UID: \"6876f49c-c16e-4e04-a9a1-a93c1676613e\") " pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.698811 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.698787    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxx2h\" (UniqueName: \"kubernetes.io/projected/98480750-8ff4-43a2-8a06-333baaaf9623-kube-api-access-pxx2h\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:04.771909 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:04.771865    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dclzf"
May 29 02:01:04.780024 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:04.779995    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6876f49c_c16e_4e04_a9a1_a93c1676613e.slice/crio-5963bcf6e9fdeeaac7b91ca6311a83afd1457a8d1d9584ab6d7a25a7665cd2a7 WatchSource:0}: Error finding container 5963bcf6e9fdeeaac7b91ca6311a83afd1457a8d1d9584ab6d7a25a7665cd2a7: Status 404 returned error can't find the container with id 5963bcf6e9fdeeaac7b91ca6311a83afd1457a8d1d9584ab6d7a25a7665cd2a7
May 29 02:01:05.044590 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.044503    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dclzf" event={"ID":"6876f49c-c16e-4e04-a9a1-a93c1676613e","Type":"ContainerStarted","Data":"5963bcf6e9fdeeaac7b91ca6311a83afd1457a8d1d9584ab6d7a25a7665cd2a7"}
May 29 02:01:05.092947 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.092908    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:05.095398 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.095372    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec5e7a97-ebd1-48d3-b222-3f5b70a363eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-fzz6f\" (UID: \"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:05.164802 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.164733    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc" podUID="53a00798-c6de-4340-bd6f-69332665c897" containerName="registry" containerID="cri-o://8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea" gracePeriod=30
May 29 02:01:05.193509 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.193471    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:05.195849 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.195829    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/98480750-8ff4-43a2-8a06-333baaaf9623-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-7wsmg\" (UID: \"98480750-8ff4-43a2-8a06-333baaaf9623\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:05.352614 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.352581    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"
May 29 02:01:05.378884 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.378815    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"
May 29 02:01:05.428177 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.427137    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:01:05.461931 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.460140    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:01:05.461931 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.460581    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a00798-c6de-4340-bd6f-69332665c897" containerName="registry"
May 29 02:01:05.461931 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.460601    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a00798-c6de-4340-bd6f-69332665c897" containerName="registry"
May 29 02:01:05.461931 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.460670    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="53a00798-c6de-4340-bd6f-69332665c897" containerName="registry"
May 29 02:01:05.463861 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.463757    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.466616    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.466841    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.467244    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwfqr\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.467475    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.467675    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.467837    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.468092    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.468272    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.468842    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 02:01:05.470340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.469251    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 02:01:05.482451 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.482418    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:01:05.497662 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.497629    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.497876 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.497681    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-trusted-ca\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.497876 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.497712    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-registry-certificates\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.497876 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.497738    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-988bm\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-kube-api-access-988bm\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.497876 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.497768    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-installation-pull-secrets\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.498307 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.498258    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:01:05.498408 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.498333    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-image-registry-private-configuration\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.498408 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.498404    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-bound-sa-token\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.498529 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.498470    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a00798-c6de-4340-bd6f-69332665c897-ca-trust-extracted\") pod \"53a00798-c6de-4340-bd6f-69332665c897\" (UID: \"53a00798-c6de-4340-bd6f-69332665c897\") "
May 29 02:01:05.498674 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.498644    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 02:01:05.498753 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.498698    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 02:01:05.498830 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.498808    2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-trusted-ca\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.504814 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.504781    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:01:05.505690 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.505664    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:01:05.506107 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.505873    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1366c6d-ab3a-4885-863c-afc4c22d7330-cert\") pod \"ingress-canary-gs4fc\" (UID: \"a1366c6d-ab3a-4885-863c-afc4c22d7330\") " pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 02:01:05.508219 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.507938    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c76f1fdf-243d-43d9-a2db-3221ff958fe8-metrics-tls\") pod \"dns-default-4sqjp\" (UID: \"c76f1fdf-243d-43d9-a2db-3221ff958fe8\") " pod="openshift-dns/dns-default-4sqjp"
May 29 02:01:05.512247 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.512217    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:01:05.512679 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.512632    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:01:05.512793 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.512721    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-kube-api-access-988bm" (OuterVolumeSpecName: "kube-api-access-988bm") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "kube-api-access-988bm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:01:05.512793 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.512680    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:01:05.514163 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.514129    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53a00798-c6de-4340-bd6f-69332665c897-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "53a00798-c6de-4340-bd6f-69332665c897" (UID: "53a00798-c6de-4340-bd6f-69332665c897"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:01:05.532482 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.532444    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7t46n\""
May 29 02:01:05.540958 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.540726    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4sqjp"
May 29 02:01:05.543921 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.543888    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f"]
May 29 02:01:05.548409 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:05.548372    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5e7a97_ebd1_48d3_b222_3f5b70a363eb.slice/crio-820741e20336f374e833ad689b851c36ed2252707da23b037cb073f5e7e4f2fa WatchSource:0}: Error finding container 820741e20336f374e833ad689b851c36ed2252707da23b037cb073f5e7e4f2fa: Status 404 returned error can't find the container with id 820741e20336f374e833ad689b851c36ed2252707da23b037cb073f5e7e4f2fa
May 29 02:01:05.564683 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.564662    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg"]
May 29 02:01:05.568233 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:05.568198    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98480750_8ff4_43a2_8a06_333baaaf9623.slice/crio-e368a64aa0dffd938a81f47aefaea7553d0269a55e4df9e1adb912f9b4fd0dde WatchSource:0}: Error finding container e368a64aa0dffd938a81f47aefaea7553d0269a55e4df9e1adb912f9b4fd0dde: Status 404 returned error can't find the container with id e368a64aa0dffd938a81f47aefaea7553d0269a55e4df9e1adb912f9b4fd0dde
May 29 02:01:05.600180 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600073    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-config-out\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.600180 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600125    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.600399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600199    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-web-config\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.600399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600228    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.600399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600264    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.600399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600302    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.600399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600337    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.600399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600373    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600414    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600436    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600462    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgb4j\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-kube-api-access-sgb4j\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600510    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600534    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600577    2550 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-registry-tls\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600591    2550 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53a00798-c6de-4340-bd6f-69332665c897-registry-certificates\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600607    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-988bm\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-kube-api-access-988bm\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600619    2550 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-installation-pull-secrets\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600633    2550 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53a00798-c6de-4340-bd6f-69332665c897-image-registry-private-configuration\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600646    2550 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53a00798-c6de-4340-bd6f-69332665c897-bound-sa-token\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.601159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.600659    2550 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53a00798-c6de-4340-bd6f-69332665c897-ca-trust-extracted\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:05.701159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.701106    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.701159 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.701160    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.701431 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.701402    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.701502 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.701476    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgb4j\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-kube-api-access-sgb4j\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.701782 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.701761    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.702011 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.701992    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.702359 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.702337    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-config-out\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.702508 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.702491    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.702635 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.702621    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-web-config\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.702741 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.702724    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.702884 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.702869    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.703011 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.702999    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.703141 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.703124    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.704032 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.704013    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.704654 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.704546    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.705001 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.704917    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.705219 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.705197    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.705326 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.705303    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.707608 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.707565    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-web-config\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.707952 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.707924    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.708238 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.708215    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.710828 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.708544    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.711477 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.711446    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-config-volume\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.712076 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.712041    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.712523 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.712470    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4sqjp"]
May 29 02:01:05.712824 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.712802    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-config-out\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.715221 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.715194    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgb4j\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-kube-api-access-sgb4j\") pod \"alertmanager-main-0\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.717695 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:05.717656    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76f1fdf_243d_43d9_a2db_3221ff958fe8.slice/crio-2d7fe91ced01cb69cf39613b600ab728da4c53e47b0dfc0e35ff9587aaa6e680 WatchSource:0}: Error finding container 2d7fe91ced01cb69cf39613b600ab728da4c53e47b0dfc0e35ff9587aaa6e680: Status 404 returned error can't find the container with id 2d7fe91ced01cb69cf39613b600ab728da4c53e47b0dfc0e35ff9587aaa6e680
May 29 02:01:05.782862 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.782814    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:01:05.938122 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:05.938047    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:01:06.021812 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:06.021765    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb8765b_5604_497b_830b_5263acf17fd9.slice/crio-0edc06103fef7821f16a80e8face923ec67e644a8d031e7415edc620361cb8ab WatchSource:0}: Error finding container 0edc06103fef7821f16a80e8face923ec67e644a8d031e7415edc620361cb8ab: Status 404 returned error can't find the container with id 0edc06103fef7821f16a80e8face923ec67e644a8d031e7415edc620361cb8ab
May 29 02:01:06.050846 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.050804    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerStarted","Data":"0edc06103fef7821f16a80e8face923ec67e644a8d031e7415edc620361cb8ab"}
May 29 02:01:06.052391 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.052363    2550 generic.go:358] "Generic (PLEG): container finished" podID="53a00798-c6de-4340-bd6f-69332665c897" containerID="8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea" exitCode=0
May 29 02:01:06.052480 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.052433    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc" event={"ID":"53a00798-c6de-4340-bd6f-69332665c897","Type":"ContainerDied","Data":"8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea"}
May 29 02:01:06.052480 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.052465    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc" event={"ID":"53a00798-c6de-4340-bd6f-69332665c897","Type":"ContainerDied","Data":"f096de6f5ee1f07ed35af8335b58390a2372ac64777a95b64eca53366809b173"}
May 29 02:01:06.052683 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.052482    2550 scope.go:117] "RemoveContainer" containerID="8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea"
May 29 02:01:06.052683 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.052486    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb8c7d575-f74tc"
May 29 02:01:06.054467 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.054440    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4sqjp" event={"ID":"c76f1fdf-243d-43d9-a2db-3221ff958fe8","Type":"ContainerStarted","Data":"2d7fe91ced01cb69cf39613b600ab728da4c53e47b0dfc0e35ff9587aaa6e680"}
May 29 02:01:06.055715 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.055691    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg" event={"ID":"98480750-8ff4-43a2-8a06-333baaaf9623","Type":"ContainerStarted","Data":"e368a64aa0dffd938a81f47aefaea7553d0269a55e4df9e1adb912f9b4fd0dde"}
May 29 02:01:06.057403 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.057380    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f" event={"ID":"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb","Type":"ContainerStarted","Data":"a5c0834f4e5b254ef7bb5f5677110a8f624bb7f60f56de9753acb7e1cd9170d1"}
May 29 02:01:06.057498 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.057410    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f" event={"ID":"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb","Type":"ContainerStarted","Data":"a49a9f442479726ecf04a811be972fa0f2a7bb4694b41ce5709e2db4b46c97ef"}
May 29 02:01:06.057498 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.057423    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f" event={"ID":"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb","Type":"ContainerStarted","Data":"820741e20336f374e833ad689b851c36ed2252707da23b037cb073f5e7e4f2fa"}
May 29 02:01:06.061979 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.061956    2550 scope.go:117] "RemoveContainer" containerID="8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea"
May 29 02:01:06.062287 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:06.062253    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea\": container with ID starting with 8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea not found: ID does not exist" containerID="8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea"
May 29 02:01:06.062357 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.062291    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea"} err="failed to get container status \"8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea\": rpc error: code = NotFound desc = could not find container \"8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea\": container with ID starting with 8c241e2adb9172b755d9873859a5fb9b9f825836ec00bde49b8521cb5b468fea not found: ID does not exist"
May 29 02:01:06.069700 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.069662    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fb8c7d575-f74tc"]
May 29 02:01:06.073881 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:06.073856    2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fb8c7d575-f74tc"]
May 29 02:01:07.061413 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.061380    2550 generic.go:358] "Generic (PLEG): container finished" podID="6876f49c-c16e-4e04-a9a1-a93c1676613e" containerID="3ae602c931c8756a6e085145e52939d15f5c8dbb086715aa838d192a297bdf5f" exitCode=0
May 29 02:01:07.061889 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.061466    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dclzf" event={"ID":"6876f49c-c16e-4e04-a9a1-a93c1676613e","Type":"ContainerDied","Data":"3ae602c931c8756a6e085145e52939d15f5c8dbb086715aa838d192a297bdf5f"}
May 29 02:01:07.353708 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.353620    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"]
May 29 02:01:07.357254 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.357224    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.360587 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.360114    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 29 02:01:07.360587 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.360184    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 29 02:01:07.360587 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.360329    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 29 02:01:07.360587 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.360349    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 29 02:01:07.360587 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.360389    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-192kt62kbpi0l\""
May 29 02:01:07.360587 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.360476    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 29 02:01:07.360587 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.360524    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pbg57\""
May 29 02:01:07.369774 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.369741    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"]
May 29 02:01:07.419082 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419028    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.419271 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419163    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-tls\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.419271 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419205    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.419375 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419299    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.419375 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419345    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbrv\" (UniqueName: \"kubernetes.io/projected/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-kube-api-access-hdbrv\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.419477 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419397    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.419515 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419479    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-grpc-tls\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.419559 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.419520    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-metrics-client-ca\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520473 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520424    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-tls\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520671 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520485    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520671 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520542    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520671 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520574    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbrv\" (UniqueName: \"kubernetes.io/projected/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-kube-api-access-hdbrv\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520671 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520600    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520671 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520634    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-grpc-tls\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520920 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520671    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-metrics-client-ca\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.520920 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.520742    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.521828 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.521759    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-metrics-client-ca\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.524089 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.524020    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-tls\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.524669 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.524622    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.524852 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.524825    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.525158 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.525137    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-grpc-tls\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.525754 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.525527    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.526009 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.525987    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.530005 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.529977    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbrv\" (UniqueName: \"kubernetes.io/projected/07bb1dc0-f3b7-4079-adbb-5fcddb37def1-kube-api-access-hdbrv\") pod \"thanos-querier-6cbbb77c6-8zk88\" (UID: \"07bb1dc0-f3b7-4079-adbb-5fcddb37def1\") " pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:07.581459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.581424    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53a00798-c6de-4340-bd6f-69332665c897" path="/var/lib/kubelet/pods/53a00798-c6de-4340-bd6f-69332665c897/volumes"
May 29 02:01:07.672180 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:07.672147    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:08.163241 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:08.162886    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"]
May 29 02:01:08.189380 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:08.189341    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bb1dc0_f3b7_4079_adbb_5fcddb37def1.slice/crio-4cf153fc4fa5b4a1c61dfdab8513ce40116efbe26c0ec06f1645227fbe97a453 WatchSource:0}: Error finding container 4cf153fc4fa5b4a1c61dfdab8513ce40116efbe26c0ec06f1645227fbe97a453: Status 404 returned error can't find the container with id 4cf153fc4fa5b4a1c61dfdab8513ce40116efbe26c0ec06f1645227fbe97a453
May 29 02:01:09.074465 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.074428    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dclzf" event={"ID":"6876f49c-c16e-4e04-a9a1-a93c1676613e","Type":"ContainerStarted","Data":"43905fed3e5c57d06e0032ffa87c6e4585a6daa7a59d42392632e3479ea55941"}
May 29 02:01:09.074465 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.074472    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dclzf" event={"ID":"6876f49c-c16e-4e04-a9a1-a93c1676613e","Type":"ContainerStarted","Data":"bb4239c7c4eee1d8ef8d230460eb42b8eaea52b2fcd2a0247bf0f4f1e314fb64"}
May 29 02:01:09.076265 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.076233    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4sqjp" event={"ID":"c76f1fdf-243d-43d9-a2db-3221ff958fe8","Type":"ContainerStarted","Data":"8f9299955dbbab8dc3638442b8fbe2576edb230741573b84f7b77a6d6215c317"}
May 29 02:01:09.076399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.076271    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4sqjp" event={"ID":"c76f1fdf-243d-43d9-a2db-3221ff958fe8","Type":"ContainerStarted","Data":"c5d78adfec5aae8f5bc45cd3a5670f3cd0b021847b2129ae7d90854ff6a334c0"}
May 29 02:01:09.076399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.076350    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4sqjp"
May 29 02:01:09.078326 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.078296    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg" event={"ID":"98480750-8ff4-43a2-8a06-333baaaf9623","Type":"ContainerStarted","Data":"77b1655e8642d2cc346ee800df5ed50f1bdda2b93cdd2f83b8464340b7b2b1f1"}
May 29 02:01:09.078441 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.078329    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg" event={"ID":"98480750-8ff4-43a2-8a06-333baaaf9623","Type":"ContainerStarted","Data":"dff8eb435c018e018fb088578445a1410a219d46d73bd2888112d78d073c1b03"}
May 29 02:01:09.078441 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.078344    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg" event={"ID":"98480750-8ff4-43a2-8a06-333baaaf9623","Type":"ContainerStarted","Data":"553f3a14ccbe5f7af5d6177d16b007cd3ccba551285fb58e0b06b3900f47d915"}
May 29 02:01:09.080729 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.080706    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f" event={"ID":"ec5e7a97-ebd1-48d3-b222-3f5b70a363eb","Type":"ContainerStarted","Data":"f3f18aac96bf97c168e5c0afdb0367d3941590836b5c0354aea5288c987befa8"}
May 29 02:01:09.081829 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.081808    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" event={"ID":"07bb1dc0-f3b7-4079-adbb-5fcddb37def1","Type":"ContainerStarted","Data":"4cf153fc4fa5b4a1c61dfdab8513ce40116efbe26c0ec06f1645227fbe97a453"}
May 29 02:01:09.083318 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.083290    2550 generic.go:358] "Generic (PLEG): container finished" podID="2bb8765b-5604-497b-830b-5263acf17fd9" containerID="f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1" exitCode=0
May 29 02:01:09.083429 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.083337    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1"}
May 29 02:01:09.123689 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.123630    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dclzf" podStartSLOduration=3.853480925 podStartE2EDuration="5.123605953s" podCreationTimestamp="2026-05-29 02:01:04 +0000 UTC" firstStartedPulling="2026-05-29 02:01:04.781611348 +0000 UTC m=+161.760318141" lastFinishedPulling="2026-05-29 02:01:06.051736369 +0000 UTC m=+163.030443169" observedRunningTime="2026-05-29 02:01:09.096493923 +0000 UTC m=+166.075200738" watchObservedRunningTime="2026-05-29 02:01:09.123605953 +0000 UTC m=+166.102312769"
May 29 02:01:09.124299 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.124265    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4sqjp" podStartSLOduration=129.868089716 podStartE2EDuration="2m12.124254188s" podCreationTimestamp="2026-05-29 01:58:57 +0000 UTC" firstStartedPulling="2026-05-29 02:01:05.720395321 +0000 UTC m=+162.699102113" lastFinishedPulling="2026-05-29 02:01:07.976559777 +0000 UTC m=+164.955266585" observedRunningTime="2026-05-29 02:01:09.123306978 +0000 UTC m=+166.102013794" watchObservedRunningTime="2026-05-29 02:01:09.124254188 +0000 UTC m=+166.102961004"
May 29 02:01:09.146342 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.146284    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-7wsmg" podStartSLOduration=2.74168073 podStartE2EDuration="5.146266568s" podCreationTimestamp="2026-05-29 02:01:04 +0000 UTC" firstStartedPulling="2026-05-29 02:01:05.571603551 +0000 UTC m=+162.550310361" lastFinishedPulling="2026-05-29 02:01:07.976189398 +0000 UTC m=+164.954896199" observedRunningTime="2026-05-29 02:01:09.144415422 +0000 UTC m=+166.123122253" watchObservedRunningTime="2026-05-29 02:01:09.146266568 +0000 UTC m=+166.124973382"
May 29 02:01:09.168309 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.167974    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"]
May 29 02:01:09.168911 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.168844    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-fzz6f" podStartSLOduration=2.959746331 podStartE2EDuration="5.168825523s" podCreationTimestamp="2026-05-29 02:01:04 +0000 UTC" firstStartedPulling="2026-05-29 02:01:05.766935392 +0000 UTC m=+162.745642185" lastFinishedPulling="2026-05-29 02:01:07.976014565 +0000 UTC m=+164.954721377" observedRunningTime="2026-05-29 02:01:09.166436517 +0000 UTC m=+166.145143333" watchObservedRunningTime="2026-05-29 02:01:09.168825523 +0000 UTC m=+166.147532370"
May 29 02:01:09.170948 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.170929    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:09.173427 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.173391    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-qjx5c\""
May 29 02:01:09.173582 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.173397    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 29 02:01:09.179923 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.179880    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"]
May 29 02:01:09.239082 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.239031    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9de66a04-b164-46b6-a326-f4d3623c1b2b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wgrdh\" (UID: \"9de66a04-b164-46b6-a326-f4d3623c1b2b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:09.340705 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.340615    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9de66a04-b164-46b6-a326-f4d3623c1b2b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wgrdh\" (UID: \"9de66a04-b164-46b6-a326-f4d3623c1b2b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:09.340865 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:09.340759    2550 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 29 02:01:09.340865 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:09.340836    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9de66a04-b164-46b6-a326-f4d3623c1b2b-monitoring-plugin-cert podName:9de66a04-b164-46b6-a326-f4d3623c1b2b nodeName:}" failed. No retries permitted until 2026-05-29 02:01:09.840810026 +0000 UTC m=+166.819516820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9de66a04-b164-46b6-a326-f4d3623c1b2b-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-wgrdh" (UID: "9de66a04-b164-46b6-a326-f4d3623c1b2b") : secret "monitoring-plugin-cert" not found
May 29 02:01:09.606240 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.606155    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-695f4d8d48-f5c48"]
May 29 02:01:09.609407 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.609377    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.612260 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.612228    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 29 02:01:09.612419 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.612228    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-26fsl\""
May 29 02:01:09.612487 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.612429    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 29 02:01:09.612747 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.612552    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 29 02:01:09.612747 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.612624    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 29 02:01:09.612747 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.612659    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 29 02:01:09.617289 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.617251    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 29 02:01:09.621824 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.621800    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-695f4d8d48-f5c48"]
May 29 02:01:09.744980 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.744943    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-metrics-client-ca\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.745184 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.744993    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-telemeter-client-tls\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.745184 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.745058    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjjdn\" (UniqueName: \"kubernetes.io/projected/750ad25f-05c6-450d-a685-4a8923a33b4e-kube-api-access-bjjdn\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.745184 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.745123    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-secret-telemeter-client\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.745184 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.745156    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-federate-client-tls\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.745394 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.745184    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.745394 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.745285    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.745394 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.745344    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-serving-certs-ca-bundle\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846471 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846420    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846490    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-serving-certs-ca-bundle\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846530    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9de66a04-b164-46b6-a326-f4d3623c1b2b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wgrdh\" (UID: \"9de66a04-b164-46b6-a326-f4d3623c1b2b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:09.846653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846599    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-metrics-client-ca\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846634    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-telemeter-client-tls\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846861 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846678    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjjdn\" (UniqueName: \"kubernetes.io/projected/750ad25f-05c6-450d-a685-4a8923a33b4e-kube-api-access-bjjdn\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846861 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846826    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-secret-telemeter-client\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846947 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846886    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-federate-client-tls\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.846947 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.846933    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.847440 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.847407    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-serving-certs-ca-bundle\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.847561 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.847522    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.847945 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.847894    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/750ad25f-05c6-450d-a685-4a8923a33b4e-metrics-client-ca\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.850178 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.850152    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-secret-telemeter-client\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.850304 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.850226    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-federate-client-tls\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.850304 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.850233    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.850304 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.850287    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9de66a04-b164-46b6-a326-f4d3623c1b2b-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-wgrdh\" (UID: \"9de66a04-b164-46b6-a326-f4d3623c1b2b\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:09.850942 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.850918    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/750ad25f-05c6-450d-a685-4a8923a33b4e-telemeter-client-tls\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.856871 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.856846    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjjdn\" (UniqueName: \"kubernetes.io/projected/750ad25f-05c6-450d-a685-4a8923a33b4e-kube-api-access-bjjdn\") pod \"telemeter-client-695f4d8d48-f5c48\" (UID: \"750ad25f-05c6-450d-a685-4a8923a33b4e\") " pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.923377 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.923121    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48"
May 29 02:01:09.993853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.993811    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:01:09.995020 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:09.994994    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:01:10.014788 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.014514    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:01:10.084357 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.084324    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:10.088927 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.088792    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" event={"ID":"07bb1dc0-f3b7-4079-adbb-5fcddb37def1","Type":"ContainerStarted","Data":"08af04e2e0914a9a987174972a2dfd8f05056e4babbc0a613d3eca12f067b518"}
May 29 02:01:10.094590 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.094552    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:01:10.100564 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.100430    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-695f4d8d48-f5c48"]
May 29 02:01:10.102231 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:10.102187    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750ad25f_05c6_450d_a685_4a8923a33b4e.slice/crio-9fd437e1df58abbd393fd97390713ae7dcc2e51c1e681561f0577be2fd92e8af WatchSource:0}: Error finding container 9fd437e1df58abbd393fd97390713ae7dcc2e51c1e681561f0577be2fd92e8af: Status 404 returned error can't find the container with id 9fd437e1df58abbd393fd97390713ae7dcc2e51c1e681561f0577be2fd92e8af
May 29 02:01:10.252652 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.252615    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"]
May 29 02:01:10.255444 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:10.255405    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de66a04_b164_46b6_a326_f4d3623c1b2b.slice/crio-419dc3884c96d5386debd03cc79c42bee5a261307cf10cb1d63c747ac6d98f1c WatchSource:0}: Error finding container 419dc3884c96d5386debd03cc79c42bee5a261307cf10cb1d63c747ac6d98f1c: Status 404 returned error can't find the container with id 419dc3884c96d5386debd03cc79c42bee5a261307cf10cb1d63c747ac6d98f1c
May 29 02:01:10.577731 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.577635    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 02:01:10.580992 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.580961    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fmgpb\""
May 29 02:01:10.588299 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.588261    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gs4fc"
May 29 02:01:10.590564 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.590535    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:01:10.593635 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.593615    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.598547 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.598528    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 29 02:01:10.599520 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.599501    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 29 02:01:10.599520 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.599512    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 29 02:01:10.599681 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.599550    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 29 02:01:10.599798 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.599778    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 29 02:01:10.599856 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.599787    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 29 02:01:10.600595 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.600577    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 29 02:01:10.600830 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.600813    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 29 02:01:10.600913 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.600872    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 29 02:01:10.601015 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.600964    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 29 02:01:10.601103 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.601032    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 29 02:01:10.601103 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.601039    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bf8c7q843davc\""
May 29 02:01:10.601211 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.600979    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-scdk7\""
May 29 02:01:10.601211 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.601190    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 29 02:01:10.603344 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.603325    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 29 02:01:10.610124 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.610099    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:01:10.657467 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657431    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657503    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657527    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657549    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657576    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657603    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657660    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657690    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657709    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657809    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657833    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657867    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-config\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657897    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.657926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657921    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.658298 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.657937    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtsk6\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-kube-api-access-qtsk6\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.658298 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.658029    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.658298 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.658091    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.658298 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.658129    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.758979 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.758935    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759187 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.758998    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759187 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759030    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759187 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759083    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759187 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759111    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759187 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759141    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759187 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759169    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759204    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759242    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759268    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759309    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-config\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759334    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759360    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759376    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtsk6\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-kube-api-access-qtsk6\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759420    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759459 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759453    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759813 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759471    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.759813 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.759523    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.760536 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.760497    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.760822 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.760799    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.761042 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.761015    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.763047 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.762010    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.763047 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.762856    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.763047 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.762972    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.763465 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.763435    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.764322 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.764225    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.764322 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.764285    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.764472 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.764456    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.765464 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.765421    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.765628 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.765607    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.766086 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.766022    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.766277 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.766230    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.766955 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.766934    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-config\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.767141 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.767120    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.767383 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.767354    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.769806 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.769772    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtsk6\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-kube-api-access-qtsk6\") pod \"prometheus-k8s-0\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:10.905754 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:10.905719    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:11.054252 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.054148    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gs4fc"]
May 29 02:01:11.057121 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:01:11.057058    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1366c6d_ab3a_4885_863c_afc4c22d7330.slice/crio-77fe77f9f47f90ef03cdd151dbe3ba92d45b8d68985ac6fcc0f374f71edd9e51 WatchSource:0}: Error finding container 77fe77f9f47f90ef03cdd151dbe3ba92d45b8d68985ac6fcc0f374f71edd9e51: Status 404 returned error can't find the container with id 77fe77f9f47f90ef03cdd151dbe3ba92d45b8d68985ac6fcc0f374f71edd9e51
May 29 02:01:11.088470 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.088436    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:01:11.094034 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.093995    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gs4fc" event={"ID":"a1366c6d-ab3a-4885-863c-afc4c22d7330","Type":"ContainerStarted","Data":"77fe77f9f47f90ef03cdd151dbe3ba92d45b8d68985ac6fcc0f374f71edd9e51"}
May 29 02:01:11.096855 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.096825    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" event={"ID":"07bb1dc0-f3b7-4079-adbb-5fcddb37def1","Type":"ContainerStarted","Data":"2fde3fce87e07601f09d748ba5e1a70a3bb73737529f3c82f612fac17c33757b"}
May 29 02:01:11.096971 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.096864    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" event={"ID":"07bb1dc0-f3b7-4079-adbb-5fcddb37def1","Type":"ContainerStarted","Data":"753d954a28d4ff0edea0da77c0d1fb9415cf893a808816ec7be657dbbd5c0162"}
May 29 02:01:11.098020 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.097996    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh" event={"ID":"9de66a04-b164-46b6-a326-f4d3623c1b2b","Type":"ContainerStarted","Data":"419dc3884c96d5386debd03cc79c42bee5a261307cf10cb1d63c747ac6d98f1c"}
May 29 02:01:11.099805 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.099776    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerStarted","Data":"1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38"}
May 29 02:01:11.100802 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:11.100779    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48" event={"ID":"750ad25f-05c6-450d-a685-4a8923a33b4e","Type":"ContainerStarted","Data":"9fd437e1df58abbd393fd97390713ae7dcc2e51c1e681561f0577be2fd92e8af"}
May 29 02:01:12.109312 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:12.109258    2550 generic.go:358] "Generic (PLEG): container finished" podID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8" exitCode=0
May 29 02:01:12.109747 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:12.109345    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"}
May 29 02:01:12.109747 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:12.109404    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerStarted","Data":"f0584e9fc46ef8570782d2559fae38e630ef8dc3b6af569cc6a3920b6bb35c76"}
May 29 02:01:12.112899 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:12.112867    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerStarted","Data":"e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f"}
May 29 02:01:12.112985 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:12.112912    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerStarted","Data":"9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9"}
May 29 02:01:12.112985 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:12.112930    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerStarted","Data":"2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a"}
May 29 02:01:12.112985 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:12.112946    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerStarted","Data":"ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4"}
May 29 02:01:14.123074 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.123021    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerStarted","Data":"2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750"}
May 29 02:01:14.125354 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.125267    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48" event={"ID":"750ad25f-05c6-450d-a685-4a8923a33b4e","Type":"ContainerStarted","Data":"1734830d6eab76685ebc4c2ee71997e448efbd2a2fcf913b5b3d16bb2f5d9514"}
May 29 02:01:14.125354 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.125313    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48" event={"ID":"750ad25f-05c6-450d-a685-4a8923a33b4e","Type":"ContainerStarted","Data":"ae8a67fd344daea2b60af24a5e49cef7d437138f5ae34945c5c12ac1398aac69"}
May 29 02:01:14.125354 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.125328    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48" event={"ID":"750ad25f-05c6-450d-a685-4a8923a33b4e","Type":"ContainerStarted","Data":"9d518b5de53b51d379197d428db80f1f75629fa87981c40e3a749e7bbbaae1dc"}
May 29 02:01:14.126750 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.126726    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gs4fc" event={"ID":"a1366c6d-ab3a-4885-863c-afc4c22d7330","Type":"ContainerStarted","Data":"396c3c45211c9d737016803401c7d28946958e7c169d7384fc49b7b4e53d6c84"}
May 29 02:01:14.161960 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.161899    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.036411445 podStartE2EDuration="9.161878007s" podCreationTimestamp="2026-05-29 02:01:05 +0000 UTC" firstStartedPulling="2026-05-29 02:01:06.023920561 +0000 UTC m=+163.002627357" lastFinishedPulling="2026-05-29 02:01:13.149387124 +0000 UTC m=+170.128093919" observedRunningTime="2026-05-29 02:01:14.159705555 +0000 UTC m=+171.138412379" watchObservedRunningTime="2026-05-29 02:01:14.161878007 +0000 UTC m=+171.140584847"
May 29 02:01:14.188677 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.188522    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-695f4d8d48-f5c48" podStartSLOduration=2.137806112 podStartE2EDuration="5.18850185s" podCreationTimestamp="2026-05-29 02:01:09 +0000 UTC" firstStartedPulling="2026-05-29 02:01:10.104122694 +0000 UTC m=+167.082829501" lastFinishedPulling="2026-05-29 02:01:13.15481843 +0000 UTC m=+170.133525239" observedRunningTime="2026-05-29 02:01:14.187490011 +0000 UTC m=+171.166196844" watchObservedRunningTime="2026-05-29 02:01:14.18850185 +0000 UTC m=+171.167208666"
May 29 02:01:14.205052 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:14.204753    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gs4fc" podStartSLOduration=135.115693413 podStartE2EDuration="2m17.204731628s" podCreationTimestamp="2026-05-29 01:58:57 +0000 UTC" firstStartedPulling="2026-05-29 02:01:11.059693004 +0000 UTC m=+168.038399805" lastFinishedPulling="2026-05-29 02:01:13.148731216 +0000 UTC m=+170.127438020" observedRunningTime="2026-05-29 02:01:14.204024994 +0000 UTC m=+171.182731811" watchObservedRunningTime="2026-05-29 02:01:14.204731628 +0000 UTC m=+171.183438444"
May 29 02:01:16.141650 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:16.141457    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh" event={"ID":"9de66a04-b164-46b6-a326-f4d3623c1b2b","Type":"ContainerStarted","Data":"ee0ec707547b709818fb581bf87b8facb3bb9801686550a64eeabac8c915f314"}
May 29 02:01:16.141650 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:16.141506    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:16.145547 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:16.145489    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerStarted","Data":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"}
May 29 02:01:16.145547 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:16.145530    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerStarted","Data":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"}
May 29 02:01:16.145547 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:16.145543    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerStarted","Data":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"}
May 29 02:01:16.151775 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:16.150570    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh"
May 29 02:01:16.187363 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:16.186967    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-wgrdh" podStartSLOduration=1.509758127 podStartE2EDuration="7.186945833s" podCreationTimestamp="2026-05-29 02:01:09 +0000 UTC" firstStartedPulling="2026-05-29 02:01:10.258567872 +0000 UTC m=+167.237274669" lastFinishedPulling="2026-05-29 02:01:15.935755582 +0000 UTC m=+172.914462375" observedRunningTime="2026-05-29 02:01:16.168293689 +0000 UTC m=+173.147000504" watchObservedRunningTime="2026-05-29 02:01:16.186945833 +0000 UTC m=+173.165652649"
May 29 02:01:17.151965 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:17.151927    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerStarted","Data":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"}
May 29 02:01:17.151965 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:17.151964    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerStarted","Data":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"}
May 29 02:01:17.151965 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:17.151975    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerStarted","Data":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"}
May 29 02:01:17.184129 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:17.184075    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.353844855 podStartE2EDuration="7.184048704s" podCreationTimestamp="2026-05-29 02:01:10 +0000 UTC" firstStartedPulling="2026-05-29 02:01:12.110604761 +0000 UTC m=+169.089311568" lastFinishedPulling="2026-05-29 02:01:15.940808621 +0000 UTC m=+172.919515417" observedRunningTime="2026-05-29 02:01:17.181366373 +0000 UTC m=+174.160073220" watchObservedRunningTime="2026-05-29 02:01:17.184048704 +0000 UTC m=+174.162755518"
May 29 02:01:19.092283 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:19.092248    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4sqjp"
May 29 02:01:19.160384 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:19.160344    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" event={"ID":"07bb1dc0-f3b7-4079-adbb-5fcddb37def1","Type":"ContainerStarted","Data":"17899f0d1da8b4e71a44d3c72e2f312e1b1f815a58bd2c7faa6844bcc8026b5c"}
May 29 02:01:19.160384 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:19.160384    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" event={"ID":"07bb1dc0-f3b7-4079-adbb-5fcddb37def1","Type":"ContainerStarted","Data":"30ae2bf54241defef546df6e459992f1f210183f05352fe347f3ea717668ed03"}
May 29 02:01:19.160620 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:19.160401    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" event={"ID":"07bb1dc0-f3b7-4079-adbb-5fcddb37def1","Type":"ContainerStarted","Data":"1084bfabf71fde14c9c94e8cc7e6a5e07aa7966327b025be1e655e9cd311c925"}
May 29 02:01:19.160672 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:19.160640    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:19.167214 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:19.167190    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88"
May 29 02:01:19.182107 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:19.182036    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6cbbb77c6-8zk88" podStartSLOduration=1.9141252020000001 podStartE2EDuration="12.182021259s" podCreationTimestamp="2026-05-29 02:01:07 +0000 UTC" firstStartedPulling="2026-05-29 02:01:08.19490901 +0000 UTC m=+165.173615803" lastFinishedPulling="2026-05-29 02:01:18.462805067 +0000 UTC m=+175.441511860" observedRunningTime="2026-05-29 02:01:19.180549635 +0000 UTC m=+176.159256462" watchObservedRunningTime="2026-05-29 02:01:19.182021259 +0000 UTC m=+176.160728088"
May 29 02:01:20.906437 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:20.906399    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:01:25.605265 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:25.605225    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c598df5bd-qn8zb"]
May 29 02:01:46.247550 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:46.247504    2550 generic.go:358] "Generic (PLEG): container finished" podID="9a1987b3-8d48-403a-8c6b-c0f077176fca" containerID="d39b5dbe33f4839d6a6e10f8bd930991dd9b625db3fe11474b51ef64b26dc634" exitCode=0
May 29 02:01:46.247958 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:46.247587    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wkc46" event={"ID":"9a1987b3-8d48-403a-8c6b-c0f077176fca","Type":"ContainerDied","Data":"d39b5dbe33f4839d6a6e10f8bd930991dd9b625db3fe11474b51ef64b26dc634"}
May 29 02:01:46.248139 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:46.248107    2550 scope.go:117] "RemoveContainer" containerID="d39b5dbe33f4839d6a6e10f8bd930991dd9b625db3fe11474b51ef64b26dc634"
May 29 02:01:47.252639 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:47.252603    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wkc46" event={"ID":"9a1987b3-8d48-403a-8c6b-c0f077176fca","Type":"ContainerStarted","Data":"cfd5caa139f23f17fb352303bde3c504696476f6f5201fd20f5b228f128385b4"}
May 29 02:01:50.629259 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.629215    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c598df5bd-qn8zb" podUID="6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" containerName="console" containerID="cri-o://20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7" gracePeriod=15
May 29 02:01:50.876292 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.876267    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c598df5bd-qn8zb_6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1/console/0.log"
May 29 02:01:50.876428 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.876329    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:01:50.915096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.914987    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-trusted-ca-bundle\") pod \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") "
May 29 02:01:50.915096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915040    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-service-ca\") pod \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") "
May 29 02:01:50.915286 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915170    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-serving-cert\") pod \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") "
May 29 02:01:50.915286 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915211    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-oauth-serving-cert\") pod \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") "
May 29 02:01:50.915286 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915244    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-config\") pod \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") "
May 29 02:01:50.915437 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915291    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-oauth-config\") pod \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") "
May 29 02:01:50.915437 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915325    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhrb7\" (UniqueName: \"kubernetes.io/projected/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-kube-api-access-hhrb7\") pod \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\" (UID: \"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1\") "
May 29 02:01:50.915546 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915435    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" (UID: "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:01:50.915546 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915499    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" (UID: "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:01:50.915797 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915728    2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-trusted-ca-bundle\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:50.915797 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915756    2550 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-service-ca\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:50.915985 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915853    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-config" (OuterVolumeSpecName: "console-config") pod "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" (UID: "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:01:50.916028 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.915997    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" (UID: "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:01:50.918153 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.918119    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" (UID: "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:01:50.918153 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.918142    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" (UID: "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:01:50.918292 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:50.918217    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-kube-api-access-hhrb7" (OuterVolumeSpecName: "kube-api-access-hhrb7") pod "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" (UID: "6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1"). InnerVolumeSpecName "kube-api-access-hhrb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:01:51.016385 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.016330    2550 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-oauth-config\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:51.016385 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.016374    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhrb7\" (UniqueName: \"kubernetes.io/projected/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-kube-api-access-hhrb7\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:51.016385 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.016385    2550 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-serving-cert\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:51.016385 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.016394    2550 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-oauth-serving-cert\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:51.016385 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.016404    2550 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1-console-config\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:01:51.266738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.266658    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c598df5bd-qn8zb_6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1/console/0.log"
May 29 02:01:51.266738 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.266694    2550 generic.go:358] "Generic (PLEG): container finished" podID="6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" containerID="20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7" exitCode=2
May 29 02:01:51.266971 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.266767    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c598df5bd-qn8zb"
May 29 02:01:51.266971 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.266792    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c598df5bd-qn8zb" event={"ID":"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1","Type":"ContainerDied","Data":"20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7"}
May 29 02:01:51.266971 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.266837    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c598df5bd-qn8zb" event={"ID":"6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1","Type":"ContainerDied","Data":"29006154c9bb01f4faf2389ab7c99373cbeaf6b2ab940c5cc97a7e1cd6dee7aa"}
May 29 02:01:51.266971 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.266859    2550 scope.go:117] "RemoveContainer" containerID="20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7"
May 29 02:01:51.275820 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.275802    2550 scope.go:117] "RemoveContainer" containerID="20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7"
May 29 02:01:51.276119 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:01:51.276096    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7\": container with ID starting with 20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7 not found: ID does not exist" containerID="20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7"
May 29 02:01:51.276196 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.276131    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7"} err="failed to get container status \"20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7\": rpc error: code = NotFound desc = could not find container \"20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7\": container with ID starting with 20fe114276a5fcf259e316cd99b4d2845f937add188f3cb36bd0a5a938813ee7 not found: ID does not exist"
May 29 02:01:51.291328 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.291293    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c598df5bd-qn8zb"]
May 29 02:01:51.296681 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.296648    2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c598df5bd-qn8zb"]
May 29 02:01:51.582941 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:01:51.582844    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" path="/var/lib/kubelet/pods/6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1/volumes"
May 29 02:02:10.906690 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:10.906656    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:10.926178 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:10.926152    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:11.349557 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:11.349480    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:25.028813 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.028776    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:02:25.029257 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.029198    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="alertmanager" containerID="cri-o://1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38" gracePeriod=120
May 29 02:02:25.029257 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.029206    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-metric" containerID="cri-o://e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f" gracePeriod=120
May 29 02:02:25.029374 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.029259    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-web" containerID="cri-o://2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a" gracePeriod=120
May 29 02:02:25.029374 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.029291    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy" containerID="cri-o://9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9" gracePeriod=120
May 29 02:02:25.029374 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.029317    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="config-reloader" containerID="cri-o://ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4" gracePeriod=120
May 29 02:02:25.029374 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.029331    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="prom-label-proxy" containerID="cri-o://2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750" gracePeriod=120
May 29 02:02:25.380523 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380485    2550 generic.go:358] "Generic (PLEG): container finished" podID="2bb8765b-5604-497b-830b-5263acf17fd9" containerID="2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750" exitCode=0
May 29 02:02:25.380523 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380515    2550 generic.go:358] "Generic (PLEG): container finished" podID="2bb8765b-5604-497b-830b-5263acf17fd9" containerID="e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f" exitCode=0
May 29 02:02:25.380523 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380523    2550 generic.go:358] "Generic (PLEG): container finished" podID="2bb8765b-5604-497b-830b-5263acf17fd9" containerID="9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9" exitCode=0
May 29 02:02:25.380523 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380531    2550 generic.go:358] "Generic (PLEG): container finished" podID="2bb8765b-5604-497b-830b-5263acf17fd9" containerID="ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4" exitCode=0
May 29 02:02:25.380783 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380538    2550 generic.go:358] "Generic (PLEG): container finished" podID="2bb8765b-5604-497b-830b-5263acf17fd9" containerID="1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38" exitCode=0
May 29 02:02:25.380783 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380555    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750"}
May 29 02:02:25.380783 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380588    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f"}
May 29 02:02:25.380783 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380599    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9"}
May 29 02:02:25.380783 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380608    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4"}
May 29 02:02:25.380783 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:25.380616    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38"}
May 29 02:02:26.275710 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.275685    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.386741 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.386657    2550 generic.go:358] "Generic (PLEG): container finished" podID="2bb8765b-5604-497b-830b-5263acf17fd9" containerID="2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a" exitCode=0
May 29 02:02:26.386741 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.386717    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a"}
May 29 02:02:26.386965 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.386743    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2bb8765b-5604-497b-830b-5263acf17fd9","Type":"ContainerDied","Data":"0edc06103fef7821f16a80e8face923ec67e644a8d031e7415edc620361cb8ab"}
May 29 02:02:26.386965 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.386760    2550 scope.go:117] "RemoveContainer" containerID="2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750"
May 29 02:02:26.386965 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.386780    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.393866 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.393831    2550 scope.go:117] "RemoveContainer" containerID="e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f"
May 29 02:02:26.400423 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.400406    2550 scope.go:117] "RemoveContainer" containerID="9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9"
May 29 02:02:26.410674 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.410651    2550 scope.go:117] "RemoveContainer" containerID="2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a"
May 29 02:02:26.417688 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.417669    2550 scope.go:117] "RemoveContainer" containerID="ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4"
May 29 02:02:26.424322 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.424302    2550 scope.go:117] "RemoveContainer" containerID="1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38"
May 29 02:02:26.431096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.431057    2550 scope.go:117] "RemoveContainer" containerID="f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1"
May 29 02:02:26.437995 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.437977    2550 scope.go:117] "RemoveContainer" containerID="2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750"
May 29 02:02:26.438369 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:26.438346    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750\": container with ID starting with 2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750 not found: ID does not exist" containerID="2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750"
May 29 02:02:26.438441 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.438377    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750"} err="failed to get container status \"2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750\": rpc error: code = NotFound desc = could not find container \"2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750\": container with ID starting with 2944f685f5bc0603b285ac6a18090a0dce768e2f0963ecb455e099ed7374c750 not found: ID does not exist"
May 29 02:02:26.438441 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.438398    2550 scope.go:117] "RemoveContainer" containerID="e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f"
May 29 02:02:26.438614 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:26.438599    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f\": container with ID starting with e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f not found: ID does not exist" containerID="e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f"
May 29 02:02:26.438654 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.438617    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f"} err="failed to get container status \"e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f\": rpc error: code = NotFound desc = could not find container \"e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f\": container with ID starting with e6a4206dd389e4cb0e440eb5950f264e0ac127d370f03104f26bc976c369cb9f not found: ID does not exist"
May 29 02:02:26.438654 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.438628    2550 scope.go:117] "RemoveContainer" containerID="9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9"
May 29 02:02:26.438900 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:26.438885    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9\": container with ID starting with 9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9 not found: ID does not exist" containerID="9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9"
May 29 02:02:26.438954 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.438902    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9"} err="failed to get container status \"9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9\": rpc error: code = NotFound desc = could not find container \"9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9\": container with ID starting with 9f2b517b53ce59a193348be059036f347ba1775d083f5c0287c29b6c885084f9 not found: ID does not exist"
May 29 02:02:26.438954 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.438914    2550 scope.go:117] "RemoveContainer" containerID="2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a"
May 29 02:02:26.439171 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:26.439156    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a\": container with ID starting with 2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a not found: ID does not exist" containerID="2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a"
May 29 02:02:26.439221 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.439173    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a"} err="failed to get container status \"2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a\": rpc error: code = NotFound desc = could not find container \"2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a\": container with ID starting with 2f64e2fffdd94a18ea3a33f18bc05104636a3b2c879bec5380234167b0718b7a not found: ID does not exist"
May 29 02:02:26.439221 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.439184    2550 scope.go:117] "RemoveContainer" containerID="ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4"
May 29 02:02:26.439423 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:26.439402    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4\": container with ID starting with ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4 not found: ID does not exist" containerID="ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4"
May 29 02:02:26.439470 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.439430    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4"} err="failed to get container status \"ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4\": rpc error: code = NotFound desc = could not find container \"ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4\": container with ID starting with ee92e2504f864ef70752a9c01fc5ba13f98dcd17fe5507cb438410f2d4917ed4 not found: ID does not exist"
May 29 02:02:26.439470 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.439447    2550 scope.go:117] "RemoveContainer" containerID="1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38"
May 29 02:02:26.439700 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:26.439679    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38\": container with ID starting with 1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38 not found: ID does not exist" containerID="1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38"
May 29 02:02:26.439742 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.439707    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38"} err="failed to get container status \"1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38\": rpc error: code = NotFound desc = could not find container \"1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38\": container with ID starting with 1bfcd0dd64093556c594dad4cedd3e59738c4724bb139523570c7a70b6612f38 not found: ID does not exist"
May 29 02:02:26.439742 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.439721    2550 scope.go:117] "RemoveContainer" containerID="f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1"
May 29 02:02:26.439937 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:26.439920    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1\": container with ID starting with f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1 not found: ID does not exist" containerID="f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1"
May 29 02:02:26.439978 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.439942    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1"} err="failed to get container status \"f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1\": rpc error: code = NotFound desc = could not find container \"f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1\": container with ID starting with f78f4010a5ad7ba19a6b3a80526d38f9ba6910610de827cc5ba122c76279a7a1 not found: ID does not exist"
May 29 02:02:26.442258 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442241    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-main-tls\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442307 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442267    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-cluster-tls-config\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442344 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442304    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442344 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442325    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-web-config\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442499 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442480    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgb4j\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-kube-api-access-sgb4j\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442567 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442552    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-trusted-ca-bundle\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442623 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442585    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-metrics-client-ca\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442677 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442620    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-web\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442677 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442653    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-tls-assets\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442774 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442678    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-main-db\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442774 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442735    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442792    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-config-out\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.442869 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.442841    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-config-volume\") pod \"2bb8765b-5604-497b-830b-5263acf17fd9\" (UID: \"2bb8765b-5604-497b-830b-5263acf17fd9\") "
May 29 02:02:26.444198 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.444167    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:02:26.444411 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.444357    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:02:26.444769 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.444743    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:02:26.445255 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.445221    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:26.445638 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.445602    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:26.446083 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.446008    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-kube-api-access-sgb4j" (OuterVolumeSpecName: "kube-api-access-sgb4j") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "kube-api-access-sgb4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:02:26.446204 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.446177    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-config-volume" (OuterVolumeSpecName: "config-volume") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:26.446289 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.446274    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:26.446659 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.446634    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:02:26.446958 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.446937    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-config-out" (OuterVolumeSpecName: "config-out") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:02:26.447487 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.447470    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:26.450718 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.450695    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:26.457366 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.457342    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-web-config" (OuterVolumeSpecName: "web-config") pod "2bb8765b-5604-497b-830b-5263acf17fd9" (UID: "2bb8765b-5604-497b-830b-5263acf17fd9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:26.544384 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544353    2550 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-config-volume\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544384 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544381    2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-main-tls\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544384 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544391    2550 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-cluster-tls-config\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544401    2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544411    2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-web-config\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544419    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgb4j\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-kube-api-access-sgb4j\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544428    2550 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544436    2550 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bb8765b-5604-497b-830b-5263acf17fd9-metrics-client-ca\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544446    2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544454    2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2bb8765b-5604-497b-830b-5263acf17fd9-tls-assets\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544462    2550 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-alertmanager-main-db\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544472    2550 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2bb8765b-5604-497b-830b-5263acf17fd9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.544601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.544481    2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2bb8765b-5604-497b-830b-5263acf17fd9-config-out\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:26.720573 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.720542    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:02:26.729129 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.729103    2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:02:26.772569 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772541    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:02:26.772955 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772938    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy"
May 29 02:02:26.773016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772958    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy"
May 29 02:02:26.773016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772969    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-metric"
May 29 02:02:26.773016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772975    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-metric"
May 29 02:02:26.773016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772983    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="init-config-reloader"
May 29 02:02:26.773016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772989    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="init-config-reloader"
May 29 02:02:26.773016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.772998    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-web"
May 29 02:02:26.773016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773003    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-web"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773017    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="alertmanager"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773027    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="alertmanager"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773033    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="config-reloader"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773038    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="config-reloader"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773048    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="prom-label-proxy"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773053    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="prom-label-proxy"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773074    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" containerName="console"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773079    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" containerName="console"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773132    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-metric"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773141    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="alertmanager"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773149    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="prom-label-proxy"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773157    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a1a5bb4-582f-482c-8c91-0bf31ef7c1a1" containerName="console"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773164    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773173    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="kube-rbac-proxy-web"
May 29 02:02:26.773237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.773183    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" containerName="config-reloader"
May 29 02:02:26.777340 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.777322    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.780991 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.780953    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 02:02:26.781152 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781044    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 02:02:26.781152 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781102    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 02:02:26.781356 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781340    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 02:02:26.781413 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781376    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 02:02:26.781413 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781397    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 02:02:26.781510 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781422    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwfqr\""
May 29 02:02:26.781770 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781727    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 02:02:26.781922 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.781906    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 02:02:26.787075 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.787047    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 02:02:26.819243 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.819215    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:02:26.948406 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948330    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f9786bc-d972-488d-b6f5-d178ce1b8eda-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948406 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948368    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f9786bc-d972-488d-b6f5-d178ce1b8eda-config-out\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948406 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948386    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-web-config\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948608 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948491    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948608 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948521    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n76r7\" (UniqueName: \"kubernetes.io/projected/4f9786bc-d972-488d-b6f5-d178ce1b8eda-kube-api-access-n76r7\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948608 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948555    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948608 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948577    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948608 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948596    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f9786bc-d972-488d-b6f5-d178ce1b8eda-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948754 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948617    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f9786bc-d972-488d-b6f5-d178ce1b8eda-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948754 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948638    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948754 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948683    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948754 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948744    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:26.948868 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:26.948764    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9786bc-d972-488d-b6f5-d178ce1b8eda-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.049915 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.049878    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.049915 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.049918    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f9786bc-d972-488d-b6f5-d178ce1b8eda-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050146 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.049940    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f9786bc-d972-488d-b6f5-d178ce1b8eda-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050146 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.049962    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050146 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050086    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050146 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050129    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050364 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050156    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9786bc-d972-488d-b6f5-d178ce1b8eda-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050364 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050217    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f9786bc-d972-488d-b6f5-d178ce1b8eda-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050364 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050249    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f9786bc-d972-488d-b6f5-d178ce1b8eda-config-out\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050364 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050273    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-web-config\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050364 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050319    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050364 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050344    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n76r7\" (UniqueName: \"kubernetes.io/projected/4f9786bc-d972-488d-b6f5-d178ce1b8eda-kube-api-access-n76r7\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050661 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050365    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f9786bc-d972-488d-b6f5-d178ce1b8eda-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.050661 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.050389    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.051433 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.051401    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9786bc-d972-488d-b6f5-d178ce1b8eda-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.053631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.053299    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.053631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.053331    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f9786bc-d972-488d-b6f5-d178ce1b8eda-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.053631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.053429    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f9786bc-d972-488d-b6f5-d178ce1b8eda-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.053631 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.053473    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.053913 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.053873    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-web-config\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.053998 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.053977    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.054248 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.054228    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.054419 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.054400    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.054556 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.054538    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f9786bc-d972-488d-b6f5-d178ce1b8eda-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.055335 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.055310    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f9786bc-d972-488d-b6f5-d178ce1b8eda-config-out\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.062545 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.062528    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n76r7\" (UniqueName: \"kubernetes.io/projected/4f9786bc-d972-488d-b6f5-d178ce1b8eda-kube-api-access-n76r7\") pod \"alertmanager-main-0\" (UID: \"4f9786bc-d972-488d-b6f5-d178ce1b8eda\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.087036 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.087009    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 02:02:27.247011 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.246977    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 02:02:27.251105 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:02:27.251053    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9786bc_d972_488d_b6f5_d178ce1b8eda.slice/crio-d55086710a43206c647825848a4fdceeb313e4030863e8519ff78cd735bb3cef WatchSource:0}: Error finding container d55086710a43206c647825848a4fdceeb313e4030863e8519ff78cd735bb3cef: Status 404 returned error can't find the container with id d55086710a43206c647825848a4fdceeb313e4030863e8519ff78cd735bb3cef
May 29 02:02:27.391311 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.391280    2550 generic.go:358] "Generic (PLEG): container finished" podID="4f9786bc-d972-488d-b6f5-d178ce1b8eda" containerID="c1141e842677eb8b8b8f261dd5b1e2669bbc84bc91cbe9d9511f1d0b5fbfdb8c" exitCode=0
May 29 02:02:27.391736 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.391369    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerDied","Data":"c1141e842677eb8b8b8f261dd5b1e2669bbc84bc91cbe9d9511f1d0b5fbfdb8c"}
May 29 02:02:27.391736 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.391408    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerStarted","Data":"d55086710a43206c647825848a4fdceeb313e4030863e8519ff78cd735bb3cef"}
May 29 02:02:27.581420 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:27.581396    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bb8765b-5604-497b-830b-5263acf17fd9" path="/var/lib/kubelet/pods/2bb8765b-5604-497b-830b-5263acf17fd9/volumes"
May 29 02:02:28.397577 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:28.397495    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerStarted","Data":"db059109f15b67b382395bb9d5257966e844199064ee826c6f8e72220459c69a"}
May 29 02:02:28.397577 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:28.397533    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerStarted","Data":"f00351593577a4ac8d721aca90a8130fec4786269882271f01451f0b060c7e78"}
May 29 02:02:28.397577 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:28.397546    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerStarted","Data":"fd887ea864da9689d0fb20798bee3eaf29ae1d09d0cde7a3d0855af866701aad"}
May 29 02:02:28.397577 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:28.397555    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerStarted","Data":"a0c22a74c598f6e34493e19debf5e6b14a4393e1c110588946ee74274e2e8668"}
May 29 02:02:28.397577 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:28.397564    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerStarted","Data":"9f188dbf8fd3e10c8904a212ef6681ae397ad02169ef98f13ccd1ce36bf7dfb0"}
May 29 02:02:28.397577 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:28.397571    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f9786bc-d972-488d-b6f5-d178ce1b8eda","Type":"ContainerStarted","Data":"fd293f8766bb2d1e455a628491f9aa0fb342a3616b0c7960b8c061e61fd7b07c"}
May 29 02:02:28.445333 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:28.445280    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.445263237 podStartE2EDuration="2.445263237s" podCreationTimestamp="2026-05-29 02:02:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:02:28.442366441 +0000 UTC m=+245.421073255" watchObservedRunningTime="2026-05-29 02:02:28.445263237 +0000 UTC m=+245.423970077"
May 29 02:02:29.414798 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.414763    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:02:29.415244 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.415212    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy" containerID="cri-o://e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395" gracePeriod=600
May 29 02:02:29.415308 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.415243    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="thanos-sidecar" containerID="cri-o://0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7" gracePeriod=600
May 29 02:02:29.415308 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.415275    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="config-reloader" containerID="cri-o://de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617" gracePeriod=600
May 29 02:02:29.415472 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.415268    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-web" containerID="cri-o://725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607" gracePeriod=600
May 29 02:02:29.415472 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.415198    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="prometheus" containerID="cri-o://c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6" gracePeriod=600
May 29 02:02:29.415472 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.415277    2550 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57" gracePeriod=600
May 29 02:02:29.656438 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.656415    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:29.671996 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.671941    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-config-out\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.671996 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.671984    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-web-config\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.672172 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.672002    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-thanos-prometheus-http-client-file\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.672172 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.672021    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-db\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.672172 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.672035    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-config\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.672172 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.672053    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-tls\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.672172 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.672090    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtsk6\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-kube-api-access-qtsk6\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.672172 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.672113    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-grpc-tls\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673276    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673341    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-trusted-ca-bundle\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673379    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-rulefiles-0\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673431    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673458    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-serving-certs-ca-bundle\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673491    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-kube-rbac-proxy\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673521    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-kubelet-serving-ca-bundle\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673547    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673575    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-metrics-client-certs\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673625    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-metrics-client-ca\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674096 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.673662    2550 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-tls-assets\") pod \"a0dccc30-4092-47a8-a887-21ed2d91596a\" (UID: \"a0dccc30-4092-47a8-a887-21ed2d91596a\") "
May 29 02:02:29.674855 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.674184    2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-db\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.674855 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.674609    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-config" (OuterVolumeSpecName: "config") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.675509 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.675003    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.675509 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.675282    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.675509 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.675443    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:02:29.675509 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.675455    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:02:29.676271 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.676247    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-config-out" (OuterVolumeSpecName: "config-out") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:02:29.676350 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.676302    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-kube-api-access-qtsk6" (OuterVolumeSpecName: "kube-api-access-qtsk6") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "kube-api-access-qtsk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:02:29.676716 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.676546    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:02:29.676716 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.676651    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.676716 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.676688    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:02:29.676979 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.676953    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.676979 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.676964    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.677186 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.677120    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:02:29.677265 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.677243    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.677609 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.677589    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.677891 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.677870    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:02:29.687692 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.687672    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-web-config" (OuterVolumeSpecName: "web-config") pod "a0dccc30-4092-47a8-a887-21ed2d91596a" (UID: "a0dccc30-4092-47a8-a887-21ed2d91596a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:02:29.775332 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775274    2550 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-metrics-client-certs\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775332 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775323    2550 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-metrics-client-ca\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775332 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775336    2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-tls-assets\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775332 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775345    2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0dccc30-4092-47a8-a887-21ed2d91596a-config-out\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775355    2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-web-config\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775365    2550 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775375    2550 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-config\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775384    2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775394    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtsk6\" (UniqueName: \"kubernetes.io/projected/a0dccc30-4092-47a8-a887-21ed2d91596a-kube-api-access-qtsk6\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775403    2550 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-grpc-tls\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775411    2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775421    2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775431    2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775441    2550 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775450    2550 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-kube-rbac-proxy\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775459    2550 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0dccc30-4092-47a8-a887-21ed2d91596a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:29.775622 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:29.775468    2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0dccc30-4092-47a8-a887-21ed2d91596a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-250.ec2.internal\" DevicePath \"\""
May 29 02:02:30.407728 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407690    2550 generic.go:358] "Generic (PLEG): container finished" podID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57" exitCode=0
May 29 02:02:30.407728 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407722    2550 generic.go:358] "Generic (PLEG): container finished" podID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395" exitCode=0
May 29 02:02:30.407728 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407732    2550 generic.go:358] "Generic (PLEG): container finished" podID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607" exitCode=0
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407741    2550 generic.go:358] "Generic (PLEG): container finished" podID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7" exitCode=0
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407749    2550 generic.go:358] "Generic (PLEG): container finished" podID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617" exitCode=0
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407758    2550 generic.go:358] "Generic (PLEG): container finished" podID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6" exitCode=0
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407771    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"}
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407822    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"}
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407837    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"}
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407852    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"}
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407787    2550 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407877    2550 scope.go:117] "RemoveContainer" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.407949 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407866    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"}
May 29 02:02:30.408352 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407962    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"}
May 29 02:02:30.408352 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.407976    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0dccc30-4092-47a8-a887-21ed2d91596a","Type":"ContainerDied","Data":"f0584e9fc46ef8570782d2559fae38e630ef8dc3b6af569cc6a3920b6bb35c76"}
May 29 02:02:30.415320 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.415302    2550 scope.go:117] "RemoveContainer" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.422652 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.422629    2550 scope.go:117] "RemoveContainer" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.444681 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.444661    2550 scope.go:117] "RemoveContainer" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.451490 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.451468    2550 scope.go:117] "RemoveContainer" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.455040 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.455020    2550 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:02:30.458907 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.458888    2550 scope.go:117] "RemoveContainer" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.466313 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.466288    2550 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:02:30.466762 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.466748    2550 scope.go:117] "RemoveContainer" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.473582 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.473552    2550 scope.go:117] "RemoveContainer" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.473857 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:30.473818    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": container with ID starting with 716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57 not found: ID does not exist" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.473929 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.473865    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"} err="failed to get container status \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": rpc error: code = NotFound desc = could not find container \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": container with ID starting with 716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57 not found: ID does not exist"
May 29 02:02:30.473929 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.473886    2550 scope.go:117] "RemoveContainer" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.474157 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:30.474140    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": container with ID starting with e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395 not found: ID does not exist" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.474207 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474166    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"} err="failed to get container status \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": rpc error: code = NotFound desc = could not find container \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": container with ID starting with e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395 not found: ID does not exist"
May 29 02:02:30.474207 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474185    2550 scope.go:117] "RemoveContainer" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.474381 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:30.474367    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": container with ID starting with 725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607 not found: ID does not exist" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.474420 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474383    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"} err="failed to get container status \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": rpc error: code = NotFound desc = could not find container \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": container with ID starting with 725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607 not found: ID does not exist"
May 29 02:02:30.474420 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474396    2550 scope.go:117] "RemoveContainer" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.474628 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:30.474612    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": container with ID starting with 0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7 not found: ID does not exist" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.474669 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474634    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"} err="failed to get container status \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": rpc error: code = NotFound desc = could not find container \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": container with ID starting with 0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7 not found: ID does not exist"
May 29 02:02:30.474669 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474647    2550 scope.go:117] "RemoveContainer" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.474863 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:30.474848    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": container with ID starting with de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617 not found: ID does not exist" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.474911 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474865    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"} err="failed to get container status \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": rpc error: code = NotFound desc = could not find container \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": container with ID starting with de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617 not found: ID does not exist"
May 29 02:02:30.474911 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.474875    2550 scope.go:117] "RemoveContainer" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.475084 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:30.475051    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": container with ID starting with c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6 not found: ID does not exist" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.475130 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.475089    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"} err="failed to get container status \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": rpc error: code = NotFound desc = could not find container \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": container with ID starting with c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6 not found: ID does not exist"
May 29 02:02:30.475130 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.475102    2550 scope.go:117] "RemoveContainer" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.475344 ip-10-0-141-250 kubenswrapper[2550]: E0529 02:02:30.475327    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": container with ID starting with 10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8 not found: ID does not exist" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.475387 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.475348    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"} err="failed to get container status \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": rpc error: code = NotFound desc = could not find container \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": container with ID starting with 10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8 not found: ID does not exist"
May 29 02:02:30.475387 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.475364    2550 scope.go:117] "RemoveContainer" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.475592 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.475574    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"} err="failed to get container status \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": rpc error: code = NotFound desc = could not find container \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": container with ID starting with 716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57 not found: ID does not exist"
May 29 02:02:30.475635 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.475592    2550 scope.go:117] "RemoveContainer" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.476032 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.476007    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"} err="failed to get container status \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": rpc error: code = NotFound desc = could not find container \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": container with ID starting with e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395 not found: ID does not exist"
May 29 02:02:30.476139 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.476035    2550 scope.go:117] "RemoveContainer" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.476360 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.476330    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"} err="failed to get container status \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": rpc error: code = NotFound desc = could not find container \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": container with ID starting with 725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607 not found: ID does not exist"
May 29 02:02:30.476493 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.476363    2550 scope.go:117] "RemoveContainer" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.476747 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.476719    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"} err="failed to get container status \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": rpc error: code = NotFound desc = could not find container \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": container with ID starting with 0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7 not found: ID does not exist"
May 29 02:02:30.476826 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.476746    2550 scope.go:117] "RemoveContainer" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.478596 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.478570    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"} err="failed to get container status \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": rpc error: code = NotFound desc = could not find container \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": container with ID starting with de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617 not found: ID does not exist"
May 29 02:02:30.478596 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.478591    2550 scope.go:117] "RemoveContainer" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.479078 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479035    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"} err="failed to get container status \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": rpc error: code = NotFound desc = could not find container \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": container with ID starting with c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6 not found: ID does not exist"
May 29 02:02:30.479078 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479054    2550 scope.go:117] "RemoveContainer" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.479307 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479290    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"} err="failed to get container status \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": rpc error: code = NotFound desc = could not find container \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": container with ID starting with 10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8 not found: ID does not exist"
May 29 02:02:30.479354 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479307    2550 scope.go:117] "RemoveContainer" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.479527 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479507    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"} err="failed to get container status \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": rpc error: code = NotFound desc = could not find container \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": container with ID starting with 716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57 not found: ID does not exist"
May 29 02:02:30.479589 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479529    2550 scope.go:117] "RemoveContainer" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.479767 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479747    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"} err="failed to get container status \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": rpc error: code = NotFound desc = could not find container \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": container with ID starting with e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395 not found: ID does not exist"
May 29 02:02:30.479827 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479768    2550 scope.go:117] "RemoveContainer" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.480003 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.479986    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"} err="failed to get container status \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": rpc error: code = NotFound desc = could not find container \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": container with ID starting with 725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607 not found: ID does not exist"
May 29 02:02:30.480045 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480004    2550 scope.go:117] "RemoveContainer" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.480211 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480194    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"} err="failed to get container status \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": rpc error: code = NotFound desc = could not find container \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": container with ID starting with 0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7 not found: ID does not exist"
May 29 02:02:30.480258 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480211    2550 scope.go:117] "RemoveContainer" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.480409 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480391    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"} err="failed to get container status \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": rpc error: code = NotFound desc = could not find container \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": container with ID starting with de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617 not found: ID does not exist"
May 29 02:02:30.480464 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480410    2550 scope.go:117] "RemoveContainer" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.480592 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480578    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"} err="failed to get container status \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": rpc error: code = NotFound desc = could not find container \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": container with ID starting with c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6 not found: ID does not exist"
May 29 02:02:30.480636 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480593    2550 scope.go:117] "RemoveContainer" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.480809 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480790    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"} err="failed to get container status \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": rpc error: code = NotFound desc = could not find container \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": container with ID starting with 10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8 not found: ID does not exist"
May 29 02:02:30.480862 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480809    2550 scope.go:117] "RemoveContainer" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.481006 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.480989    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"} err="failed to get container status \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": rpc error: code = NotFound desc = could not find container \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": container with ID starting with 716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57 not found: ID does not exist"
May 29 02:02:30.481055 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481007    2550 scope.go:117] "RemoveContainer" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.481310 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481287    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"} err="failed to get container status \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": rpc error: code = NotFound desc = could not find container \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": container with ID starting with e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395 not found: ID does not exist"
May 29 02:02:30.481389 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481311    2550 scope.go:117] "RemoveContainer" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.481525 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481503    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"} err="failed to get container status \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": rpc error: code = NotFound desc = could not find container \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": container with ID starting with 725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607 not found: ID does not exist"
May 29 02:02:30.481525 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481525    2550 scope.go:117] "RemoveContainer" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.481714 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481696    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"} err="failed to get container status \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": rpc error: code = NotFound desc = could not find container \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": container with ID starting with 0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7 not found: ID does not exist"
May 29 02:02:30.481766 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481715    2550 scope.go:117] "RemoveContainer" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.481891 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481875    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"} err="failed to get container status \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": rpc error: code = NotFound desc = could not find container \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": container with ID starting with de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617 not found: ID does not exist"
May 29 02:02:30.481938 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.481892    2550 scope.go:117] "RemoveContainer" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.482049 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482035    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"} err="failed to get container status \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": rpc error: code = NotFound desc = could not find container \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": container with ID starting with c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6 not found: ID does not exist"
May 29 02:02:30.482102 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482049    2550 scope.go:117] "RemoveContainer" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.482237 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482220    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"} err="failed to get container status \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": rpc error: code = NotFound desc = could not find container \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": container with ID starting with 10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8 not found: ID does not exist"
May 29 02:02:30.482273 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482238    2550 scope.go:117] "RemoveContainer" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.482434 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482416    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"} err="failed to get container status \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": rpc error: code = NotFound desc = could not find container \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": container with ID starting with 716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57 not found: ID does not exist"
May 29 02:02:30.482485 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482436    2550 scope.go:117] "RemoveContainer" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.482626 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482609    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"} err="failed to get container status \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": rpc error: code = NotFound desc = could not find container \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": container with ID starting with e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395 not found: ID does not exist"
May 29 02:02:30.482677 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482625    2550 scope.go:117] "RemoveContainer" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.482821 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482805    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"} err="failed to get container status \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": rpc error: code = NotFound desc = could not find container \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": container with ID starting with 725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607 not found: ID does not exist"
May 29 02:02:30.482867 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.482822    2550 scope.go:117] "RemoveContainer" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.483038 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483020    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"} err="failed to get container status \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": rpc error: code = NotFound desc = could not find container \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": container with ID starting with 0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7 not found: ID does not exist"
May 29 02:02:30.483138 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483038    2550 scope.go:117] "RemoveContainer" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.483316 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483294    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"} err="failed to get container status \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": rpc error: code = NotFound desc = could not find container \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": container with ID starting with de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617 not found: ID does not exist"
May 29 02:02:30.483377 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483328    2550 scope.go:117] "RemoveContainer" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.483556 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483540    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"} err="failed to get container status \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": rpc error: code = NotFound desc = could not find container \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": container with ID starting with c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6 not found: ID does not exist"
May 29 02:02:30.483617 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483556    2550 scope.go:117] "RemoveContainer" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.483803 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483787    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"} err="failed to get container status \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": rpc error: code = NotFound desc = could not find container \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": container with ID starting with 10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8 not found: ID does not exist"
May 29 02:02:30.483803 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483802    2550 scope.go:117] "RemoveContainer" containerID="716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"
May 29 02:02:30.484016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.483989    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57"} err="failed to get container status \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": rpc error: code = NotFound desc = could not find container \"716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57\": container with ID starting with 716382c1abc54e4c6dff92777b441ab4da00cbd526f296b302c948801d94ba57 not found: ID does not exist"
May 29 02:02:30.484016 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484008    2550 scope.go:117] "RemoveContainer" containerID="e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"
May 29 02:02:30.484253 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484229    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395"} err="failed to get container status \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": rpc error: code = NotFound desc = could not find container \"e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395\": container with ID starting with e51826cb24b47d1c4df531040e45f89f6c8a8e95503510178d3b4a5fff94b395 not found: ID does not exist"
May 29 02:02:30.484296 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484253    2550 scope.go:117] "RemoveContainer" containerID="725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"
May 29 02:02:30.484448 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484428    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607"} err="failed to get container status \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": rpc error: code = NotFound desc = could not find container \"725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607\": container with ID starting with 725db87eaacc18fdf1616ec8ebcc67c1ff2057f399fde5cc1ccddcc4d38d6607 not found: ID does not exist"
May 29 02:02:30.484521 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484450    2550 scope.go:117] "RemoveContainer" containerID="0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"
May 29 02:02:30.484716 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484698    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7"} err="failed to get container status \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": rpc error: code = NotFound desc = could not find container \"0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7\": container with ID starting with 0d5ecb11eb76b9409f8246f1fe3dfed8c9e0e36b7222b5263b5627788d2f3fb7 not found: ID does not exist"
May 29 02:02:30.484770 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484717    2550 scope.go:117] "RemoveContainer" containerID="de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"
May 29 02:02:30.484954 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484936    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617"} err="failed to get container status \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": rpc error: code = NotFound desc = could not find container \"de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617\": container with ID starting with de1ebdff371269cbb2219f5c605efd709cb8e253402e0f9322f99cf1d1137617 not found: ID does not exist"
May 29 02:02:30.485038 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.484955    2550 scope.go:117] "RemoveContainer" containerID="c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"
May 29 02:02:30.485224 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.485203    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6"} err="failed to get container status \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": rpc error: code = NotFound desc = could not find container \"c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6\": container with ID starting with c666e789800eede6603e370b8830c2dcdff8d496d4240d76bfcc57d4b49bf9b6 not found: ID does not exist"
May 29 02:02:30.485309 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.485226    2550 scope.go:117] "RemoveContainer" containerID="10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"
May 29 02:02:30.485466 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.485442    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8"} err="failed to get container status \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": rpc error: code = NotFound desc = could not find container \"10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8\": container with ID starting with 10b75640fde403f094667546cb940909eb274414e78811b7434438df7d9206b8 not found: ID does not exist"
May 29 02:02:30.530843 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.530805    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:02:30.531158 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531146    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="init-config-reloader"
May 29 02:02:30.531202 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531160    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="init-config-reloader"
May 29 02:02:30.531202 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531168    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-web"
May 29 02:02:30.531202 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531173    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-web"
May 29 02:02:30.531202 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531184    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="thanos-sidecar"
May 29 02:02:30.531202 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531189    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="thanos-sidecar"
May 29 02:02:30.531202 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531204    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="config-reloader"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531209    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="config-reloader"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531214    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-thanos"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531219    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-thanos"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531225    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="prometheus"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531231    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="prometheus"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531238    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531245    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531295    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="config-reloader"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531303    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="prometheus"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531310    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531316    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-thanos"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531324    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="thanos-sidecar"
May 29 02:02:30.531378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.531331    2550 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" containerName="kube-rbac-proxy-web"
May 29 02:02:30.535530 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.535510    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.542774 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.542747    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 29 02:02:30.542905 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.542889    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 29 02:02:30.542979 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.542933    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 29 02:02:30.542979 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.542965    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 29 02:02:30.543115 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543083    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 29 02:02:30.543179 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543130    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 29 02:02:30.543317 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543272    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 29 02:02:30.543317 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543299    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 29 02:02:30.543481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543333    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 29 02:02:30.543481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543349    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-scdk7\""
May 29 02:02:30.543481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543333    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bf8c7q843davc\""
May 29 02:02:30.543481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543420    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 29 02:02:30.543653 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.543626    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 29 02:02:30.545769 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.545750    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 29 02:02:30.568299 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.565744    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 29 02:02:30.581691 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.581656    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/096dc173-2bfc-431a-a6a7-ca24616415db-config-out\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.581691 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.581693    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.581926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.581789    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.581926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.581845    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.581926 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.581876    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-web-config\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582049 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.581977    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582121 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582040    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582168 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582126    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582168 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582158    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-config\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582279 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582262    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582322 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582293    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582322 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582316    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmkkc\" (UniqueName: \"kubernetes.io/projected/096dc173-2bfc-431a-a6a7-ca24616415db-kube-api-access-fmkkc\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582466 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582351    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582466 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582370    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582466 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582404    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582466 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582427    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582466 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582446    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.582690 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.582481    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/096dc173-2bfc-431a-a6a7-ca24616415db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.586220 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.586197    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:02:30.683809 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.683716    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.683809 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.683758    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684005 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.683884    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/096dc173-2bfc-431a-a6a7-ca24616415db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684005 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.683936    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/096dc173-2bfc-431a-a6a7-ca24616415db-config-out\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684127 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684059    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684127 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684107    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684206 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684149    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684206 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684193    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684308 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684230    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-web-config\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684308 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684253    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684308 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684283    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684454 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684320    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684454 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684346    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-config\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684454 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684370    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684454 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684402    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684454 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684428    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmkkc\" (UniqueName: \"kubernetes.io/projected/096dc173-2bfc-431a-a6a7-ca24616415db-kube-api-access-fmkkc\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684698 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684463    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684698 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684497    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.684698 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684545    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.685796 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.684856    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.685796 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.685498    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.687637 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.686883    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/096dc173-2bfc-431a-a6a7-ca24616415db-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.687637 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.687223    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.687637 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.687225    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.687637 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.687431    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.687637 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.687586    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.687637 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.687615    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.688439 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.688398    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-web-config\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.688817 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.688796    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/096dc173-2bfc-431a-a6a7-ca24616415db-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.688952 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.688925    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.689226 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.689206    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/096dc173-2bfc-431a-a6a7-ca24616415db-config-out\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.689406 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.689387    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.689596 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.689577    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.689856 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.689841    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-config\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.690229 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.690205    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/096dc173-2bfc-431a-a6a7-ca24616415db-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.700219 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.700199    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmkkc\" (UniqueName: \"kubernetes.io/projected/096dc173-2bfc-431a-a6a7-ca24616415db-kube-api-access-fmkkc\") pod \"prometheus-k8s-0\" (UID: \"096dc173-2bfc-431a-a6a7-ca24616415db\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:30.845234 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:30.845200    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:02:31.015944 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:31.015868    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 02:02:31.018861 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:02:31.018833    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096dc173_2bfc_431a_a6a7_ca24616415db.slice/crio-bc1a8319d6c166cae7e27d894f9739143c64cc0373dbe865f4a8f608ec50377e WatchSource:0}: Error finding container bc1a8319d6c166cae7e27d894f9739143c64cc0373dbe865f4a8f608ec50377e: Status 404 returned error can't find the container with id bc1a8319d6c166cae7e27d894f9739143c64cc0373dbe865f4a8f608ec50377e
May 29 02:02:31.412928 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:31.412897    2550 generic.go:358] "Generic (PLEG): container finished" podID="096dc173-2bfc-431a-a6a7-ca24616415db" containerID="077add855c7aa72ef339b0066b15308b6e730bd83b29e441fbfbf9665c0f8db6" exitCode=0
May 29 02:02:31.413132 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:31.412948    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerDied","Data":"077add855c7aa72ef339b0066b15308b6e730bd83b29e441fbfbf9665c0f8db6"}
May 29 02:02:31.413132 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:31.412968    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerStarted","Data":"bc1a8319d6c166cae7e27d894f9739143c64cc0373dbe865f4a8f608ec50377e"}
May 29 02:02:31.584549 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:31.583251    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0dccc30-4092-47a8-a887-21ed2d91596a" path="/var/lib/kubelet/pods/a0dccc30-4092-47a8-a887-21ed2d91596a/volumes"
May 29 02:02:32.419276 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:32.419240    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerStarted","Data":"e646e2896bfe325029b74ef0b2afae251ca3a641510c18b02d979c0d816d73ad"}
May 29 02:02:32.419276 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:32.419280    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerStarted","Data":"c29adce5aba19ad1a2be50a30b8820f09096e799d6e16ed8ae867c304469a0ee"}
May 29 02:02:32.419481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:32.419289    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerStarted","Data":"534050409e252b8f2d3242069ff456c8c449cd85cce93b11afd2c3ccd9d99d12"}
May 29 02:02:32.419481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:32.419298    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerStarted","Data":"a276f21f2763f713918eb483f63a5af0783a8a0a91d061237013d0251f30ceed"}
May 29 02:02:32.419481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:32.419307    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerStarted","Data":"921986969f55b1c0f4e13d03657278c3ee95d3bc720021db9146b30f1ea22147"}
May 29 02:02:32.419481 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:32.419316    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"096dc173-2bfc-431a-a6a7-ca24616415db","Type":"ContainerStarted","Data":"c60df937b4626ef7c7825c8e94a03d5bef84a1902896e1e995e85e7bc970703d"}
May 29 02:02:32.497043 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:32.496996    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.496980498 podStartE2EDuration="2.496980498s" podCreationTimestamp="2026-05-29 02:02:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:02:32.491797381 +0000 UTC m=+249.470504195" watchObservedRunningTime="2026-05-29 02:02:32.496980498 +0000 UTC m=+249.475687312"
May 29 02:02:35.846084 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:02:35.846022    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:03:23.497576 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:03:23.497543    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:03:23.498376 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:03:23.498349    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:03:23.503113 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:03:23.503093    2550 kubelet.go:1628] "Image garbage collection succeeded"
May 29 02:03:30.845670 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:03:30.845616    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:03:30.861676 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:03:30.861648    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:03:31.613665 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:03:31.613636    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 02:06:23.996049 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:23.996008    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cf5f94df7-d4kcs"]
May 29 02:06:23.998318 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:23.998299    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.002287 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.002260    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 29 02:06:24.003417 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.003398    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 29 02:06:24.005579 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.005082    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 29 02:06:24.005579 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.005159    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 29 02:06:24.005579 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.005182    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 29 02:06:24.005579 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.005330    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8pztx\""
May 29 02:06:24.005579 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.005503    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 29 02:06:24.005914 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.005664    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 29 02:06:24.008349 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.008331    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 29 02:06:24.017928 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.017903    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf5f94df7-d4kcs"]
May 29 02:06:24.123837 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.123804    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-trusted-ca-bundle\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.123837 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.123850    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-serving-cert\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.124057 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.123938    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-service-ca\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.124057 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.123980    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-oauth-config\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.124057 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.124014    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-oauth-serving-cert\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.124057 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.124048    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-config\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.124234 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.124106    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h64z\" (UniqueName: \"kubernetes.io/projected/a7dd43d7-49d0-4f68-a487-8d59648751d8-kube-api-access-4h64z\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225006 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.224961    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-config\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225006 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225009    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4h64z\" (UniqueName: \"kubernetes.io/projected/a7dd43d7-49d0-4f68-a487-8d59648751d8-kube-api-access-4h64z\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225264 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225046    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-trusted-ca-bundle\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225264 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225104    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-serving-cert\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225264 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225171    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-service-ca\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225264 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225198    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-oauth-config\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225264 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225239    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-oauth-serving-cert\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225875 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225841    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-config\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.225998 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.225919    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-trusted-ca-bundle\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.226103 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.226084    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-oauth-serving-cert\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.226173 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.226131    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a7dd43d7-49d0-4f68-a487-8d59648751d8-service-ca\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.228275 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.228252    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-oauth-config\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.228347 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.228260    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a7dd43d7-49d0-4f68-a487-8d59648751d8-console-serving-cert\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.237706 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.237679    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h64z\" (UniqueName: \"kubernetes.io/projected/a7dd43d7-49d0-4f68-a487-8d59648751d8-kube-api-access-4h64z\") pod \"console-7cf5f94df7-d4kcs\" (UID: \"a7dd43d7-49d0-4f68-a487-8d59648751d8\") " pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.308538 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.308441    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:24.442762 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.442731    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf5f94df7-d4kcs"]
May 29 02:06:24.444528 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:06:24.444501    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7dd43d7_49d0_4f68_a487_8d59648751d8.slice/crio-a1fda42f8e032623efc7248194c9a5d4e1303dabec1cac2300bbac73743e0194 WatchSource:0}: Error finding container a1fda42f8e032623efc7248194c9a5d4e1303dabec1cac2300bbac73743e0194: Status 404 returned error can't find the container with id a1fda42f8e032623efc7248194c9a5d4e1303dabec1cac2300bbac73743e0194
May 29 02:06:24.446244 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:24.446228    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:06:25.109267 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:25.109231    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf5f94df7-d4kcs" event={"ID":"a7dd43d7-49d0-4f68-a487-8d59648751d8","Type":"ContainerStarted","Data":"6487ad83437d264ed325d453a37e8acac412b0cc9cbe33e1c75d21a174d77a77"}
May 29 02:06:25.109267 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:25.109267    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf5f94df7-d4kcs" event={"ID":"a7dd43d7-49d0-4f68-a487-8d59648751d8","Type":"ContainerStarted","Data":"a1fda42f8e032623efc7248194c9a5d4e1303dabec1cac2300bbac73743e0194"}
May 29 02:06:25.134405 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:25.134344    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7cf5f94df7-d4kcs" podStartSLOduration=2.134327726 podStartE2EDuration="2.134327726s" podCreationTimestamp="2026-05-29 02:06:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:06:25.134300908 +0000 UTC m=+482.113007724" watchObservedRunningTime="2026-05-29 02:06:25.134327726 +0000 UTC m=+482.113034543"
May 29 02:06:34.309024 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:34.308981    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:34.309024 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:34.309028    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:34.313911 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:34.313885    2550 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:06:35.143344 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:06:35.143315    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cf5f94df7-d4kcs"
May 29 02:08:23.522240 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:08:23.522205    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:08:23.523519 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:08:23.523491    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:13:23.545087 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:13:23.544986    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:13:23.547511 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:13:23.547485    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:18:23.568823 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:18:23.568792    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:18:23.571571 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:18:23.571548    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:23:23.600908 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:23:23.600878    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:23:23.604955 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:23:23.604933    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:27:38.355893 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:38.355861    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hn8pt_c80ba141-974c-4344-8219-17a591c8aedc/global-pull-secret-syncer/0.log"
May 29 02:27:38.357128 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:38.357112    2550 ???:1] "http: TLS handshake error from 10.0.129.62:53702: EOF"
May 29 02:27:38.470623 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:38.470589    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fs7b9_c811a74b-d63a-4fb1-ac95-194f129942a9/konnectivity-agent/0.log"
May 29 02:27:38.604541 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:38.604510    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-250.ec2.internal_11f2ffcb97183e73f25ffbb03ac0679e/haproxy/0.log"
May 29 02:27:41.328206 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.328154    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f9786bc-d972-488d-b6f5-d178ce1b8eda/alertmanager/0.log"
May 29 02:27:41.367365 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.367329    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f9786bc-d972-488d-b6f5-d178ce1b8eda/config-reloader/0.log"
May 29 02:27:41.413168 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.413135    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f9786bc-d972-488d-b6f5-d178ce1b8eda/kube-rbac-proxy-web/0.log"
May 29 02:27:41.439174 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.439130    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f9786bc-d972-488d-b6f5-d178ce1b8eda/kube-rbac-proxy/0.log"
May 29 02:27:41.468399 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.468371    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f9786bc-d972-488d-b6f5-d178ce1b8eda/kube-rbac-proxy-metric/0.log"
May 29 02:27:41.491954 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.491929    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f9786bc-d972-488d-b6f5-d178ce1b8eda/prom-label-proxy/0.log"
May 29 02:27:41.515965 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.515943    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f9786bc-d972-488d-b6f5-d178ce1b8eda/init-config-reloader/0.log"
May 29 02:27:41.557011 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.556992    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-tx59c_a041f7bf-9420-4d09-b7c3-6897933d87ea/cluster-monitoring-operator/0.log"
May 29 02:27:41.585361 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.585291    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-7wsmg_98480750-8ff4-43a2-8a06-333baaaf9623/kube-state-metrics/0.log"
May 29 02:27:41.603378 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.603353    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-7wsmg_98480750-8ff4-43a2-8a06-333baaaf9623/kube-rbac-proxy-main/0.log"
May 29 02:27:41.626841 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.626818    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-7wsmg_98480750-8ff4-43a2-8a06-333baaaf9623/kube-rbac-proxy-self/0.log"
May 29 02:27:41.684136 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.684107    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-wgrdh_9de66a04-b164-46b6-a326-f4d3623c1b2b/monitoring-plugin/0.log"
May 29 02:27:41.788941 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.788907    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dclzf_6876f49c-c16e-4e04-a9a1-a93c1676613e/node-exporter/0.log"
May 29 02:27:41.812570 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.812541    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dclzf_6876f49c-c16e-4e04-a9a1-a93c1676613e/kube-rbac-proxy/0.log"
May 29 02:27:41.836775 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.836717    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dclzf_6876f49c-c16e-4e04-a9a1-a93c1676613e/init-textfile/0.log"
May 29 02:27:41.931009 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.930975    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-fzz6f_ec5e7a97-ebd1-48d3-b222-3f5b70a363eb/kube-rbac-proxy-main/0.log"
May 29 02:27:41.963165 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:41.963136    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-fzz6f_ec5e7a97-ebd1-48d3-b222-3f5b70a363eb/kube-rbac-proxy-self/0.log"
May 29 02:27:42.004274 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.004250    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-fzz6f_ec5e7a97-ebd1-48d3-b222-3f5b70a363eb/openshift-state-metrics/0.log"
May 29 02:27:42.054577 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.054547    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_096dc173-2bfc-431a-a6a7-ca24616415db/prometheus/0.log"
May 29 02:27:42.097471 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.097397    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_096dc173-2bfc-431a-a6a7-ca24616415db/config-reloader/0.log"
May 29 02:27:42.135247 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.135223    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_096dc173-2bfc-431a-a6a7-ca24616415db/thanos-sidecar/0.log"
May 29 02:27:42.180235 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.180208    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_096dc173-2bfc-431a-a6a7-ca24616415db/kube-rbac-proxy-web/0.log"
May 29 02:27:42.222236 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.222199    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_096dc173-2bfc-431a-a6a7-ca24616415db/kube-rbac-proxy/0.log"
May 29 02:27:42.252695 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.252673    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_096dc173-2bfc-431a-a6a7-ca24616415db/kube-rbac-proxy-thanos/0.log"
May 29 02:27:42.290294 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.290269    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_096dc173-2bfc-431a-a6a7-ca24616415db/init-config-reloader/0.log"
May 29 02:27:42.425614 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.425585    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695f4d8d48-f5c48_750ad25f-05c6-450d-a685-4a8923a33b4e/telemeter-client/0.log"
May 29 02:27:42.453377 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.453351    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695f4d8d48-f5c48_750ad25f-05c6-450d-a685-4a8923a33b4e/reload/0.log"
May 29 02:27:42.480706 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.480672    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695f4d8d48-f5c48_750ad25f-05c6-450d-a685-4a8923a33b4e/kube-rbac-proxy/0.log"
May 29 02:27:42.512377 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.512352    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbbb77c6-8zk88_07bb1dc0-f3b7-4079-adbb-5fcddb37def1/thanos-query/0.log"
May 29 02:27:42.541438 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.541415    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbbb77c6-8zk88_07bb1dc0-f3b7-4079-adbb-5fcddb37def1/kube-rbac-proxy-web/0.log"
May 29 02:27:42.563749 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.563726    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbbb77c6-8zk88_07bb1dc0-f3b7-4079-adbb-5fcddb37def1/kube-rbac-proxy/0.log"
May 29 02:27:42.587336 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.587309    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbbb77c6-8zk88_07bb1dc0-f3b7-4079-adbb-5fcddb37def1/prom-label-proxy/0.log"
May 29 02:27:42.613560 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.613535    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbbb77c6-8zk88_07bb1dc0-f3b7-4079-adbb-5fcddb37def1/kube-rbac-proxy-rules/0.log"
May 29 02:27:42.642998 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:42.642967    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cbbb77c6-8zk88_07bb1dc0-f3b7-4079-adbb-5fcddb37def1/kube-rbac-proxy-metrics/0.log"
May 29 02:27:43.745877 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:43.745839    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-bxk79_b6ebdc10-821d-44f8-b9ea-d0c98cf530e7/networking-console-plugin/0.log"
May 29 02:27:44.454250 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:44.454227    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cf5f94df7-d4kcs_a7dd43d7-49d0-4f68-a487-8d59648751d8/console/0.log"
May 29 02:27:44.935520 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:44.935487    2550 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"]
May 29 02:27:44.938323 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:44.938304    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:44.940877 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:44.940856    2550 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bphng\"/\"default-dockercfg-5v6cc\""
May 29 02:27:44.941099 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:44.941085    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bphng\"/\"kube-root-ca.crt\""
May 29 02:27:44.942160 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:44.942136    2550 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bphng\"/\"openshift-service-ca.crt\""
May 29 02:27:44.946596 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:44.945042    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"]
May 29 02:27:45.053593 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.053547    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-sys\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.053593 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.053596    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-lib-modules\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.053824 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.053622    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-podres\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.053824 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.053667    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5hb\" (UniqueName: \"kubernetes.io/projected/c050a302-a8ac-49ba-aa5f-32ef383251ed-kube-api-access-nx5hb\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.053824 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.053759    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-proc\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.154656 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154618    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5hb\" (UniqueName: \"kubernetes.io/projected/c050a302-a8ac-49ba-aa5f-32ef383251ed-kube-api-access-nx5hb\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.154853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154688    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-proc\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.154853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154741    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-sys\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.154853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154765    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-lib-modules\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.154853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154789    2550 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-podres\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.154853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154817    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-sys\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.154853 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154818    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-proc\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.155152 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154914    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-podres\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.155152 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.154919    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c050a302-a8ac-49ba-aa5f-32ef383251ed-lib-modules\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.163539 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.163500    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5hb\" (UniqueName: \"kubernetes.io/projected/c050a302-a8ac-49ba-aa5f-32ef383251ed-kube-api-access-nx5hb\") pod \"perf-node-gather-daemonset-7th4b\" (UID: \"c050a302-a8ac-49ba-aa5f-32ef383251ed\") " pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.255672 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.255575    2550 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:45.381977 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.381951    2550 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"]
May 29 02:27:45.384152 ip-10-0-141-250 kubenswrapper[2550]: W0529 02:27:45.384127    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc050a302_a8ac_49ba_aa5f_32ef383251ed.slice/crio-3c0ba87c0e021bd4d9215ba25b59fe1cfb389f3c87326313f9ff7e8dd5799c4c WatchSource:0}: Error finding container 3c0ba87c0e021bd4d9215ba25b59fe1cfb389f3c87326313f9ff7e8dd5799c4c: Status 404 returned error can't find the container with id 3c0ba87c0e021bd4d9215ba25b59fe1cfb389f3c87326313f9ff7e8dd5799c4c
May 29 02:27:45.385855 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.385836    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:27:45.459037 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.459011    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4sqjp_c76f1fdf-243d-43d9-a2db-3221ff958fe8/dns/0.log"
May 29 02:27:45.476288 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.476262    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4sqjp_c76f1fdf-243d-43d9-a2db-3221ff958fe8/kube-rbac-proxy/0.log"
May 29 02:27:45.573704 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.573621    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpsvs_1e0de9e7-453e-4a47-a70a-1112edc41370/dns-node-resolver/0.log"
May 29 02:27:45.995056 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:45.995024    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-85d6fcddcf-kgq92_903eacee-51c0-4a5a-bb87-777ec3e63d21/registry/0.log"
May 29 02:27:46.018594 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:46.018546    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-72m4c_47539a4c-963c-40bb-8e9c-0e46eb16ff79/node-ca/0.log"
May 29 02:27:46.020625 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:46.020600    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b" event={"ID":"c050a302-a8ac-49ba-aa5f-32ef383251ed","Type":"ContainerStarted","Data":"1f5f3e7dd2d92754bf324af606d001c5309100a2be4e37f28ecf78b78b0d5e78"}
May 29 02:27:46.020745 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:46.020632    2550 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b" event={"ID":"c050a302-a8ac-49ba-aa5f-32ef383251ed","Type":"ContainerStarted","Data":"3c0ba87c0e021bd4d9215ba25b59fe1cfb389f3c87326313f9ff7e8dd5799c4c"}
May 29 02:27:46.020745 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:46.020715    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:46.040918 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:46.040871    2550 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b" podStartSLOduration=2.040858162 podStartE2EDuration="2.040858162s" podCreationTimestamp="2026-05-29 02:27:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:27:46.039749 +0000 UTC m=+1763.018455815" watchObservedRunningTime="2026-05-29 02:27:46.040858162 +0000 UTC m=+1763.019565017"
May 29 02:27:47.066540 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:47.066513    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gs4fc_a1366c6d-ab3a-4885-863c-afc4c22d7330/serve-healthcheck-canary/0.log"
May 29 02:27:47.468175 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:47.468135    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-wkc46_9a1987b3-8d48-403a-8c6b-c0f077176fca/insights-operator/1.log"
May 29 02:27:47.468175 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:47.468178    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-wkc46_9a1987b3-8d48-403a-8c6b-c0f077176fca/insights-operator/0.log"
May 29 02:27:47.607885 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:47.607856    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh8m5_5ae808a5-a3dd-4908-ae9b-3e79845eb41d/kube-rbac-proxy/0.log"
May 29 02:27:47.627289 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:47.627261    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh8m5_5ae808a5-a3dd-4908-ae9b-3e79845eb41d/exporter/0.log"
May 29 02:27:47.646930 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:47.646899    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh8m5_5ae808a5-a3dd-4908-ae9b-3e79845eb41d/extractor/0.log"
May 29 02:27:52.032697 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.032669    2550 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bphng/perf-node-gather-daemonset-7th4b"
May 29 02:27:52.737464 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.737435    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9vq_27416c3a-bd51-40b1-82f3-246aa67620dc/kube-multus-additional-cni-plugins/0.log"
May 29 02:27:52.756711 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.756685    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9vq_27416c3a-bd51-40b1-82f3-246aa67620dc/egress-router-binary-copy/0.log"
May 29 02:27:52.776589 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.776558    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9vq_27416c3a-bd51-40b1-82f3-246aa67620dc/cni-plugins/0.log"
May 29 02:27:52.794994 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.794971    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9vq_27416c3a-bd51-40b1-82f3-246aa67620dc/bond-cni-plugin/0.log"
May 29 02:27:52.817444 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.817413    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9vq_27416c3a-bd51-40b1-82f3-246aa67620dc/routeoverride-cni/0.log"
May 29 02:27:52.837601 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.837568    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9vq_27416c3a-bd51-40b1-82f3-246aa67620dc/whereabouts-cni-bincopy/0.log"
May 29 02:27:52.856233 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:52.856209    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6q9vq_27416c3a-bd51-40b1-82f3-246aa67620dc/whereabouts-cni/0.log"
May 29 02:27:53.213713 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:53.213679    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ssb7m_3a44aa4c-fcaf-424b-8aee-c0f141363937/kube-multus/0.log"
May 29 02:27:53.341126 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:53.341097    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l9z94_0cfe0b02-2217-4c1c-a6e1-6f432167e1c1/network-metrics-daemon/0.log"
May 29 02:27:53.364050 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:53.364013    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l9z94_0cfe0b02-2217-4c1c-a6e1-6f432167e1c1/kube-rbac-proxy/0.log"
May 29 02:27:54.194880 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.194847    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-controller/0.log"
May 29 02:27:54.211296 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.211203    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/0.log"
May 29 02:27:54.227875 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.227847    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovn-acl-logging/1.log"
May 29 02:27:54.252586 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.252556    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/kube-rbac-proxy-node/0.log"
May 29 02:27:54.277094 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.277038    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/kube-rbac-proxy-ovn-metrics/0.log"
May 29 02:27:54.295140 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.295111    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/northd/0.log"
May 29 02:27:54.314019 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.313989    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/nbdb/0.log"
May 29 02:27:54.332978 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.332944    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/sbdb/0.log"
May 29 02:27:54.502283 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:54.502187    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7v5zh_3bcad6ba-25c6-4f4f-a565-5659a0e0adf1/ovnkube-controller/0.log"
May 29 02:27:55.890432 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:55.890403    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-x6vdm_5f735939-dae5-4d7f-853a-9565a9c4c6df/check-endpoints/0.log"
May 29 02:27:55.933770 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:55.933736    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gftwp_d4de6ec4-d835-4663-a7e8-8cf16be6e492/network-check-target-container/0.log"
May 29 02:27:56.785259 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:56.785231    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6kzbs_1ee1741e-1566-4108-aee5-d7e7894466f1/iptables-alerter/0.log"
May 29 02:27:57.346315 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:27:57.346267    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-52f7n_89e5c49b-cc90-4667-9ae6-b0919f55c4d8/tuned/0.log"
May 29 02:28:00.317890 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:28:00.317861    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-ttsmn_c3af8daa-79ec-4389-b4d6-a907ca803106/service-ca-controller/0.log"
May 29 02:28:00.677811 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:28:00.677783    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-84jl2_ac51130d-1272-49be-b72e-81eaf857f870/csi-driver/0.log"
May 29 02:28:00.694528 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:28:00.694497    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-84jl2_ac51130d-1272-49be-b72e-81eaf857f870/csi-node-driver-registrar/0.log"
May 29 02:28:00.711114 ip-10-0-141-250 kubenswrapper[2550]: I0529 02:28:00.711091    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-84jl2_ac51130d-1272-49be-b72e-81eaf857f870/csi-liveness-probe/0.log"