May 28 16:00:01.262743 ip-10-0-129-162 systemd[1]: Starting Kubernetes Kubelet...
May 28 16:00:01.716067 ip-10-0-129-162 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:00:01.716067 ip-10-0-129-162 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 16:00:01.716067 ip-10-0-129-162 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:00:01.716067 ip-10-0-129-162 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 16:00:01.716067 ip-10-0-129-162 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:00:01.717028 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.716931    2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 16:00:01.721224 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721182    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:00:01.721224 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721221    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:00:01.721224 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721230    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721238    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721246    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721253    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721261    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721270    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721277    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721284    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721294    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721305    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721309    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721314    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721318    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721323    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721327    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721331    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721336    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721340    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721358    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721363    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:00:01.721467 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721368    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721377    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721381    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721385    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721389    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721393    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721397    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721401    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721405    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721410    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721414    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721420    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721424    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721430    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721438    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721443    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721448    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721452    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721456    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721461    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:00:01.722187 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721465    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721469    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721474    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721479    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721486    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721490    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721498    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721502    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721506    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721511    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721516    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721520    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721524    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721528    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721533    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721537    2569 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721541    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721546    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721554    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:00:01.722728 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721558    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721565    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721573    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721578    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721582    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721588    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721593    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721597    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721600    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721604    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721607    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721610    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721646    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721652    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721657    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721664    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721668    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721678    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721683    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721688    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:00:01.723189 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721692    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721697    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721702    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721711    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.721715    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722559    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722572    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722575    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722578    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722583    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722588    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722591    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722594    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722597    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722600    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722602    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722605    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722607    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722612    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:00:01.723692 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722616    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722619    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722622    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722625    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722636    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722640    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722643    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722646    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722649    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722652    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722656    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722659    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722662    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722665    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722667    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722670    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722673    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722675    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722678    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722682    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:00:01.724152 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722684    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722688    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722690    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722693    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722696    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722698    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722701    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722704    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722706    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722709    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722711    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722714    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722717    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722719    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722722    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722724    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722727    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722729    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722732    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722735    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:00:01.724675 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722738    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722741    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722744    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722746    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722749    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722751    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722753    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722756    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722758    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722761    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722763    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722767    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722770    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722773    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722775    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722778    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722780    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722783    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722786    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722788    2569 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:00:01.725163 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722791    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722793    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722796    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722798    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722801    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722804    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722807    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722810    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722813    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722815    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722817    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.722820    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723785    2569 flags.go:64] FLAG: --address="0.0.0.0"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723795    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723802    2569 flags.go:64] FLAG: --anonymous-auth="true"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723807    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723812    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723815    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723820    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723824    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723827    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 16:00:01.725669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723831    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723834    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723839    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723842    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723845    2569 flags.go:64] FLAG: --cgroup-root=""
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723848    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723852    2569 flags.go:64] FLAG: --client-ca-file=""
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723854    2569 flags.go:64] FLAG: --cloud-config=""
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723857    2569 flags.go:64] FLAG: --cloud-provider="external"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723861    2569 flags.go:64] FLAG: --cluster-dns="[]"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723866    2569 flags.go:64] FLAG: --cluster-domain=""
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723869    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723873    2569 flags.go:64] FLAG: --config-dir=""
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723876    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723879    2569 flags.go:64] FLAG: --container-log-max-files="5"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723883    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723886    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723889    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723893    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723896    2569 flags.go:64] FLAG: --contention-profiling="false"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723899    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723902    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723905    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723909    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723913    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 16:00:01.726194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723916    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723919    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723922    2569 flags.go:64] FLAG: --enable-load-reader="false"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723926    2569 flags.go:64] FLAG: --enable-server="true"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723929    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723933    2569 flags.go:64] FLAG: --event-burst="100"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723936    2569 flags.go:64] FLAG: --event-qps="50"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723940    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723943    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723947    2569 flags.go:64] FLAG: --eviction-hard=""
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723951    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723954    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723957    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723960    2569 flags.go:64] FLAG: --eviction-soft=""
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723963    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723966    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723969    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723972    2569 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723975    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723978    2569 flags.go:64] FLAG: --fail-swap-on="true"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723981    2569 flags.go:64] FLAG: --feature-gates=""
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723985    2569 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723988    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723991    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723995    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.723998    2569 flags.go:64] FLAG: --healthz-port="10248"
May 28 16:00:01.726830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724000    2569 flags.go:64] FLAG: --help="false"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724003    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-129-162.ec2.internal"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724006    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724009    2569 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724012    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724016    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724020    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724023    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724025    2569 flags.go:64] FLAG: --image-service-endpoint=""
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724028    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724032    2569 flags.go:64] FLAG: --kube-api-burst="100"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724035    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724038    2569 flags.go:64] FLAG: --kube-api-qps="50"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724042    2569 flags.go:64] FLAG: --kube-reserved=""
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724045    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724048    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724052    2569 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724055    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724058    2569 flags.go:64] FLAG: --lock-file=""
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724061    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724064    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724067    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724073    2569 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 16:00:01.727499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724076    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724078    2569 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724081    2569 flags.go:64] FLAG: --logging-format="text"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724084    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724088    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724091    2569 flags.go:64] FLAG: --manifest-url=""
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724094    2569 flags.go:64] FLAG: --manifest-url-header=""
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724099    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724102    2569 flags.go:64] FLAG: --max-open-files="1000000"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724112    2569 flags.go:64] FLAG: --max-pods="110"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724115    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724118    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724121    2569 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724124    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724127    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724130    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724134    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724145    2569 flags.go:64] FLAG: --node-status-max-images="50"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724148    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724151    2569 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724155    2569 flags.go:64] FLAG: --pod-cidr=""
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724159    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724164    2569 flags.go:64] FLAG: --pod-manifest-path=""
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724168    2569 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 16:00:01.728054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724171    2569 flags.go:64] FLAG: --pods-per-core="0"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724175    2569 flags.go:64] FLAG: --port="10250"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724178    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724181    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0163f0c1fac9f1035"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724184    2569 flags.go:64] FLAG: --qos-reserved=""
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724187    2569 flags.go:64] FLAG: --read-only-port="10255"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724190    2569 flags.go:64] FLAG: --register-node="true"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724193    2569 flags.go:64] FLAG: --register-schedulable="true"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724196    2569 flags.go:64] FLAG: --register-with-taints=""
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724200    2569 flags.go:64] FLAG: --registry-burst="10"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724203    2569 flags.go:64] FLAG: --registry-qps="5"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724206    2569 flags.go:64] FLAG: --reserved-cpus=""
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724209    2569 flags.go:64] FLAG: --reserved-memory=""
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724213    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724216    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724219    2569 flags.go:64] FLAG: --rotate-certificates="false"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724222    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724225    2569 flags.go:64] FLAG: --runonce="false"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724228    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724231    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724234    2569 flags.go:64] FLAG: --seccomp-default="false"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724236    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724239    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724242    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724246    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724249    2569 flags.go:64] FLAG: --storage-driver-password="root"
May 28 16:00:01.728724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724252    2569 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724255    2569 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724258    2569 flags.go:64] FLAG: --storage-driver-user="root"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724261    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724265    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724268    2569 flags.go:64] FLAG: --system-cgroups=""
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724271    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724277    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724280    2569 flags.go:64] FLAG: --tls-cert-file=""
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724283    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724289    2569 flags.go:64] FLAG: --tls-min-version=""
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724292    2569 flags.go:64] FLAG: --tls-private-key-file=""
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724294    2569 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724297    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724301    2569 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724304    2569 flags.go:64] FLAG: --v="2"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724308    2569 flags.go:64] FLAG: --version="false"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724313    2569 flags.go:64] FLAG: --vmodule=""
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724317    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.724320    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724429    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724433    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724438    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:00:01.729391 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724442    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724445    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724448    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724451    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724453    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724456    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724459    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724461    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724464    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724467    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724469    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724472    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724475    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724479    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724482    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724484    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724492    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724495    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724497    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724500    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:00:01.729936 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724503    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724506    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724509    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724511    2569 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724514    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724516    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724519    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724521    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724524    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724526    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724529    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724532    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724534    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724537    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724539    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724542    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724545    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724547    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724550    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724552    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:00:01.730487 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724555    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724557    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724560    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724562    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724565    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724568    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724571    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724574    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724578    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724581    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724583    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724586    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724588    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724591    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724593    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724597    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724601    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724605    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724607    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:00:01.731011 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724610    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724613    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724616    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724618    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724621    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724624    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724626    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724629    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724632    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724635    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724637    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724640    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724642    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724645    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724647    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724650    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724652    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724655    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724658    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724660    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:00:01.731489 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724663    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:00:01.731967 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724668    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:00:01.731967 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724670    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:00:01.731967 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.724673    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:00:01.731967 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.725304    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:00:01.733662 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.733642    2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 16:00:01.733662 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.733663    2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 16:00:01.733732 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733717    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:00:01.733732 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733722    2569 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:00:01.733732 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733725    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:00:01.733732 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733729    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:00:01.733732 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733732    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733735    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733738    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733741    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733744    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733747    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733750    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733753    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733756    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733759    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733761    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733764    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733767    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733770    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733773    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733775    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733778    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733781    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733784    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733786    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:00:01.733855 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733789    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733793    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733795    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733798    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733800    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733803    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733805    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733808    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733811    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733814    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733816    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733819    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733821    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733824    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733829    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733832    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733835    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733838    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733841    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733843    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:00:01.734406 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733846    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733849    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733852    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733854    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733857    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733859    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733862    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733865    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733868    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733871    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733873    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733876    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733880    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733883    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733887    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733889    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733892    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733895    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733897    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:00:01.734906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733900    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733903    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733906    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733908    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733911    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733914    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733916    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733919    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733921    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733924    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733927    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733929    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733932    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733935    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733937    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733940    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733942    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733945    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733947    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733950    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:00:01.735387 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733952    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733955    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.733958    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.733963    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734062    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734066    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734069    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734072    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734075    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734078    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734081    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734084    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734086    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734089    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734092    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734094    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:00:01.735884 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734097    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734099    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734102    2569 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734105    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734108    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734110    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734113    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734115    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734118    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734120    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734123    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734125    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734128    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734131    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734133    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734136    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734138    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734141    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734143    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:00:01.736289 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734146    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734149    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734151    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734154    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734156    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734158    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734161    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734164    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734166    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734169    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734172    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734174    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734177    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734179    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734182    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734184    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734187    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734190    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734192    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734195    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:00:01.736876 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734197    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734200    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734202    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734205    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734207    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734210    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734212    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734215    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734219    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734222    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734225    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734228    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734230    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734233    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734236    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734238    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734241    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734243    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734246    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734249    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:00:01.737367 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734251    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734255    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734259    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734261    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734264    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734266    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734268    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734271    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734274    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734277    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734279    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734282    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734284    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734287    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:01.734289    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:00:01.737906 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.734294    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:00:01.738280 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.735105    2569 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 16:00:01.738280 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.737094    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 16:00:01.738280 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.738189    2569 server.go:1019] "Starting client certificate rotation"
May 28 16:00:01.738386 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.738286    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 16:00:01.738386 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.738323    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 16:00:01.764058 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.764034    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 16:00:01.766174 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.766151    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 16:00:01.782025 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.781999    2569 log.go:25] "Validated CRI v1 runtime API"
May 28 16:00:01.787279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.787260    2569 log.go:25] "Validated CRI v1 image API"
May 28 16:00:01.788512 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.788494    2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 16:00:01.792179 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.792161    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 16:00:01.794209 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.794184    2569 fs.go:135] Filesystem UUIDs: map[130c8f8f-9364-464d-8933-7a8e470dda10:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fb9838c0-0128-425d-afc9-2a857d297b1b:/dev/nvme0n1p4]
May 28 16:00:01.794291 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.794207    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 16:00:01.798637 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.798509    2569 manager.go:217] Machine: {Timestamp:2026-05-28 16:00:01.797978562 +0000 UTC m=+0.418041350 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092201 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20c181fb02a3c6a39f8bbd0b53895f SystemUUID:ec20c181-fb02-a3c6-a39f-8bbd0b53895f BootID:4a4554e9-488c-4039-b48b-6a6dec55c7d2 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:b3:5d:cc:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:b3:5d:cc:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:43:a1:95:c1:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 16:00:01.799520 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.799506    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 16:00:01.799637 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.799622    2569 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 16:00:01.801391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.801366    2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 16:00:01.801535 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.801395    2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 16:00:01.801586 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.801545    2569 topology_manager.go:138] "Creating topology manager with none policy"
May 28 16:00:01.801586 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.801554    2569 container_manager_linux.go:306] "Creating device plugin manager"
May 28 16:00:01.801586 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.801562    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 16:00:01.802036 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.802027    2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 16:00:01.804481 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.804469    2569 state_mem.go:36] "Initialized new in-memory state store"
May 28 16:00:01.804594 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.804585    2569 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 16:00:01.807380 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.807370    2569 kubelet.go:491] "Attempting to sync node with API server"
May 28 16:00:01.807422 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.807384    2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 16:00:01.807422 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.807397    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 16:00:01.807422 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.807408    2569 kubelet.go:397] "Adding apiserver pod source"
May 28 16:00:01.807422 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.807417    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 16:00:01.808591 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.808579    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 16:00:01.808629 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.808598    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 16:00:01.810365 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.810330    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vkf5b"
May 28 16:00:01.811867 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.811839    2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 16:00:01.813705 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.813691    2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 16:00:01.815098 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815084    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 16:00:01.815142 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815106    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 16:00:01.815142 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815117    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 16:00:01.815142 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815123    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 16:00:01.815142 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815137    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 16:00:01.815142 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815143    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 16:00:01.815269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815148    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 16:00:01.815269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815155    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 16:00:01.815269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815165    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 16:00:01.815269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815172    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 16:00:01.815269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815181    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 16:00:01.815269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.815186    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 16:00:01.816623 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.816611    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 16:00:01.816655 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.816626    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 16:00:01.818220 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.818203    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vkf5b"
May 28 16:00:01.820772 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.820756    2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 16:00:01.820843 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.820767    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 16:00:01.820940 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.820922    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 16:00:01.821126 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.821115    2569 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 16:00:01.821177 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.821169    2569 server.go:1295] "Started kubelet"
May 28 16:00:01.821227 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.821200    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 16:00:01.821374 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.821309    2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 16:00:01.821416 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.821401    2569 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 16:00:01.822234 ip-10-0-129-162 systemd[1]: Started Kubernetes Kubelet.
May 28 16:00:01.824869 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.824832    2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 16:00:01.827974 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.827958    2569 server.go:317] "Adding debug handlers to kubelet server"
May 28 16:00:01.831639 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.831621    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 16:00:01.831639 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.831622    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 16:00:01.831779 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.831713    2569 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 16:00:01.831779 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.831724    2569 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 16:00:01.831869 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.831810    2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 16:00:01.831909 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.831886    2569 reconstruct.go:97] "Volume reconstruction finished"
May 28 16:00:01.831909 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.831895    2569 reconciler.go:26] "Reconciler: start to sync state"
May 28 16:00:01.833091 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.833072    2569 factory.go:55] Registering systemd factory
May 28 16:00:01.833091 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.833089    2569 factory.go:223] Registration of the systemd container factory successfully
May 28 16:00:01.833507 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.833482    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:01.833581 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.833566    2569 factory.go:153] Registering CRI-O factory
May 28 16:00:01.833581 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.833577    2569 factory.go:223] Registration of the crio container factory successfully
May 28 16:00:01.833665 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.833631    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 16:00:01.833665 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.833649    2569 factory.go:103] Registering Raw factory
May 28 16:00:01.833665 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.833663    2569 manager.go:1196] Started watching for new ooms in manager
May 28 16:00:01.834031 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.834020    2569 manager.go:319] Starting recovery of all containers
May 28 16:00:01.834253 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.834234    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:00:01.836605 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.836580    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-162.ec2.internal\" not found" node="ip-10-0-129-162.ec2.internal"
May 28 16:00:01.844027 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.843874    2569 manager.go:324] Recovery completed
May 28 16:00:01.848967 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.848952    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:00:01.851212 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.851189    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:00:01.851320 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.851235    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:00:01.851320 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.851252    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientPID"
May 28 16:00:01.852121 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.852101    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 16:00:01.852121 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.852120    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 16:00:01.852248 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.852141    2569 state_mem.go:36] "Initialized new in-memory state store"
May 28 16:00:01.854702 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.854685    2569 policy_none.go:49] "None policy: Start"
May 28 16:00:01.854761 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.854711    2569 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 16:00:01.854761 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.854722    2569 state_mem.go:35] "Initializing new in-memory state store"
May 28 16:00:01.898087 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.898069    2569 manager.go:341] "Starting Device Plugin manager"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.898113    2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.898127    2569 server.go:85] "Starting device plugin registration server"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.898458    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.898472    2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.898561    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.898655    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.898662    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.899224    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 16:00:01.913669 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.899265    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:01.983627 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.983531    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 16:00:01.984801 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.984784    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 16:00:01.984874 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.984807    2569 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 16:00:01.984874 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.984827    2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 16:00:01.984874 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.984834    2569 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 16:00:01.985030 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:01.984878    2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 16:00:01.986926 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.986902    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:00:01.998759 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:01.998737    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:00:02.000056 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.000040    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:00:02.000124 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.000071    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:00:02.000124 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.000083    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientPID"
May 28 16:00:02.000124 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.000106    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-162.ec2.internal"
May 28 16:00:02.007127 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.007110    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-162.ec2.internal"
May 28 16:00:02.007187 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.007136    2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-162.ec2.internal\": node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.025708 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.025681    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.085436 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.085392    2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"]
May 28 16:00:02.085545 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.085488    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:00:02.087411 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.087394    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:00:02.087480 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.087424    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:00:02.087480 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.087439    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientPID"
May 28 16:00:02.088949 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.088935    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:00:02.089137 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089123    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.089177 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089154    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:00:02.089746 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089731    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:00:02.089798 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089733    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:00:02.089798 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089783    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:00:02.089798 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089797    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientPID"
May 28 16:00:02.089901 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089759    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:00:02.089901 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.089845    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientPID"
May 28 16:00:02.091428 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.091414    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.091476 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.091442    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:00:02.092099 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.092084    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:00:02.092160 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.092109    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:00:02.092160 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.092120    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeHasSufficientPID"
May 28 16:00:02.116225 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.116200    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-162.ec2.internal\" not found" node="ip-10-0-129-162.ec2.internal"
May 28 16:00:02.120884 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.120866    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-162.ec2.internal\" not found" node="ip-10-0-129-162.ec2.internal"
May 28 16:00:02.125928 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.125910    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.226059 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.226010    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.233358 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.233316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6df5d7107bc5dae1b7137d097e8becbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal\" (UID: \"6df5d7107bc5dae1b7137d097e8becbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.233470 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.233373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6df5d7107bc5dae1b7137d097e8becbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal\" (UID: \"6df5d7107bc5dae1b7137d097e8becbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.233470 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.233453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f924e8114472614b63d1d03a6fe2dc94-config\") pod \"kube-apiserver-proxy-ip-10-0-129-162.ec2.internal\" (UID: \"f924e8114472614b63d1d03a6fe2dc94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.326803 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.326729    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.334024 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.334004    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f924e8114472614b63d1d03a6fe2dc94-config\") pod \"kube-apiserver-proxy-ip-10-0-129-162.ec2.internal\" (UID: \"f924e8114472614b63d1d03a6fe2dc94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.334092 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.334030    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6df5d7107bc5dae1b7137d097e8becbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal\" (UID: \"6df5d7107bc5dae1b7137d097e8becbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.334092 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.334049    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6df5d7107bc5dae1b7137d097e8becbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal\" (UID: \"6df5d7107bc5dae1b7137d097e8becbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.334092 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.334089    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6df5d7107bc5dae1b7137d097e8becbf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal\" (UID: \"6df5d7107bc5dae1b7137d097e8becbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.334216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.334127    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6df5d7107bc5dae1b7137d097e8becbf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal\" (UID: \"6df5d7107bc5dae1b7137d097e8becbf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.334216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.334130    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f924e8114472614b63d1d03a6fe2dc94-config\") pod \"kube-apiserver-proxy-ip-10-0-129-162.ec2.internal\" (UID: \"f924e8114472614b63d1d03a6fe2dc94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.419223 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.419191    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.423932 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.423910    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:02.426946 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.426931    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.527483 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.527440    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.627989 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.627912    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.728568 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.728511    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.737972 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.737943    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 16:00:02.738141 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.738123    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 16:00:02.738202 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.738144    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 16:00:02.820594 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.820542    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 15:55:01 +0000 UTC" deadline="2027-11-16 12:52:46.140248442 +0000 UTC"
May 28 16:00:02.820594 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.820584    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12884h52m43.319667168s"
May 28 16:00:02.829502 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.829474    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.831727 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.831706    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 16:00:02.841684 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.841662    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 16:00:02.861432 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.861401    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lk77l"
May 28 16:00:02.866276 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.866254    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lk77l"
May 28 16:00:02.929992 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:02.929919    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:02.947050 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:02.947009    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df5d7107bc5dae1b7137d097e8becbf.slice/crio-81863b5750fbe5f379d8c06a861862309012b3334ecc04d74f7aa984d7017a49 WatchSource:0}: Error finding container 81863b5750fbe5f379d8c06a861862309012b3334ecc04d74f7aa984d7017a49: Status 404 returned error can't find the container with id 81863b5750fbe5f379d8c06a861862309012b3334ecc04d74f7aa984d7017a49
May 28 16:00:02.954507 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.954490    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:00:02.962584 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:02.962560    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf924e8114472614b63d1d03a6fe2dc94.slice/crio-4ab7f129d1fd27855cab8a4b7df30da4f9ac630ac69a78271a2d69a9eb053672 WatchSource:0}: Error finding container 4ab7f129d1fd27855cab8a4b7df30da4f9ac630ac69a78271a2d69a9eb053672: Status 404 returned error can't find the container with id 4ab7f129d1fd27855cab8a4b7df30da4f9ac630ac69a78271a2d69a9eb053672
May 28 16:00:02.988079 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.988032    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal" event={"ID":"f924e8114472614b63d1d03a6fe2dc94","Type":"ContainerStarted","Data":"4ab7f129d1fd27855cab8a4b7df30da4f9ac630ac69a78271a2d69a9eb053672"}
May 28 16:00:02.988924 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:02.988901    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal" event={"ID":"6df5d7107bc5dae1b7137d097e8becbf","Type":"ContainerStarted","Data":"81863b5750fbe5f379d8c06a861862309012b3334ecc04d74f7aa984d7017a49"}
May 28 16:00:03.030069 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.030035    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:03.130491 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.130464    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:03.231036 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.230946    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:03.280795 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.280766    2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:00:03.331276 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.331229    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-162.ec2.internal\" not found"
May 28 16:00:03.390405 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.390377    2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:00:03.432021 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.431986    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal"
May 28 16:00:03.444931 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.444904    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 16:00:03.446093 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.446068    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal"
May 28 16:00:03.454525 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.454500    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 16:00:03.808715 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.808676    2569 apiserver.go:52] "Watching apiserver"
May 28 16:00:03.817625 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.817596    2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 16:00:03.818831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.818805    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h","openshift-dns/node-resolver-h9dbh","openshift-image-registry/node-ca-4qg6r","openshift-multus/multus-additional-cni-plugins-p5zqc","openshift-multus/multus-crxmj","openshift-network-diagnostics/network-check-target-zx25w","openshift-ovn-kubernetes/ovnkube-node-5z2kh","kube-system/konnectivity-agent-8zhdh","openshift-cluster-node-tuning-operator/tuned-lf6b5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal","openshift-multus/network-metrics-daemon-kts5f","openshift-network-operator/iptables-alerter-8pln9","kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal"]
May 28 16:00:03.820521 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.820499    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.821713 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.821689    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.823207 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823183    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.823313 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823299    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-45n7z\""
May 28 16:00:03.823552 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823529    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 16:00:03.823632 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823535    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 16:00:03.823688 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823641    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 16:00:03.823953 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823929    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 16:00:03.824050 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823954    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 16:00:03.824050 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.823982    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 16:00:03.824215 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.824196    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 16:00:03.824464 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.824445    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.824560 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.824491    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 16:00:03.824969 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.824950    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lqwfl\""
May 28 16:00:03.825438 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.825417    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 16:00:03.825582 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.825563    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 16:00:03.825657 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.825611    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b46fv\""
May 28 16:00:03.825856 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.825830    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crxmj"
May 28 16:00:03.826139 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.826026    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 16:00:03.826701 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.826646    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 16:00:03.826701 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.826682    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 16:00:03.826880 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.826861    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 16:00:03.827100 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.827086    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 16:00:03.827178 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.827141    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b2h8l\""
May 28 16:00:03.827277 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.827243    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 16:00:03.827519 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.827501    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:03.827598 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.827565    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:03.828628 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.828199    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 16:00:03.828628 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.828227    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x5lrk\""
May 28 16:00:03.829150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.829134    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.831581 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.831501    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 16:00:03.831849 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.831820    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 16:00:03.832175 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.832160    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-95ph8\""
May 28 16:00:03.832499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.832474    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 16:00:03.833218 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.832772    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:03.835107 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.835087    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.835214 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.835195    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:03.835300 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.835275    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:03.835778 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.835761    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gnxnx\""
May 28 16:00:03.835869 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.835809    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 16:00:03.835869 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.835828    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 16:00:03.836588 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.836572    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:03.837324 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.837306    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nlv45\""
May 28 16:00:03.837577 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.837557    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 16:00:03.837860 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.837616    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 16:00:03.838797 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.838780    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 16:00:03.838921 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.838902    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 16:00:03.838992 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.838977    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l8q9v\""
May 28 16:00:03.839030 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.839013    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 16:00:03.840738 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840719    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-systemd\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.840846 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.840846 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.840846 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-device-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.841010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-systemd\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.841010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d07df59-b2b2-41cf-ad45-87f59accfcb1-cni-binary-copy\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-netns\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840926    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-cni-multus\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbzrp\" (UniqueName: \"kubernetes.io/projected/1d07df59-b2b2-41cf-ad45-87f59accfcb1-kube-api-access-cbzrp\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-sys\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.841010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.840985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-lib-modules\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-etc-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmj9n\" (UniqueName: \"kubernetes.io/projected/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-kube-api-access-bmj9n\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-conf-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841100    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-var-lib-kubelet\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841149    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-kubelet\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-tuned\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.841317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841292    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de5e856f-d624-4277-b328-654d0c5f92f7-ovn-node-metrics-cert\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-cnibin\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-kubelet\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841414    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-k8s-cni-cncf-io\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841469    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-socket-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841511    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-slash\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-node-log\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-cni-bin\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-modprobe-d\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841718    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysconfig\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.841751 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59-konnectivity-ca\") pod \"konnectivity-agent-8zhdh\" (UID: \"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59\") " pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841777    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-cni-bin\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-etc-kubernetes\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-systemd-units\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-hosts-file\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-kubernetes\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841877    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysctl-d\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-system-cni-dir\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.841958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcq2b\" (UniqueName: \"kubernetes.io/projected/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-kube-api-access-qcq2b\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-serviceca\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-cni-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842054    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-socket-dir-parent\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-multus-certs\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842124    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-sys-fs\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-os-release\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.842270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-cni-netd\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-ovnkube-config\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842199    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-host\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842228    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-daemon-config\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59-agent-certs\") pod \"konnectivity-agent-8zhdh\" (UID: \"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59\") " pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjm7r\" (UniqueName: \"kubernetes.io/projected/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-kube-api-access-jjm7r\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxw7\" (UniqueName: \"kubernetes.io/projected/5a806bb5-7457-4709-a2e9-b99bfff01dd6-kube-api-access-5jxw7\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842325    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysctl-conf\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-host\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842412    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842437    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-run-netns\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-var-lib-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-ovnkube-script-lib\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842517    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-system-cni-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842541    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-os-release\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.843037 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-hostroot\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-registration-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842615    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-env-overrides\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-tmp-dir\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842668    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-run\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cnibin\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842738    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-ovn\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842760    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-log-socket\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842783    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7st69\" (UniqueName: \"kubernetes.io/projected/de5e856f-d624-4277-b328-654d0c5f92f7-kube-api-access-7st69\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9d111b1-ab4e-4450-af5b-a107d85fedb6-tmp\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.843813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.842856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwlml\" (UniqueName: \"kubernetes.io/projected/c9d111b1-ab4e-4450-af5b-a107d85fedb6-kube-api-access-gwlml\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.867298 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.867262    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:55:02 +0000 UTC" deadline="2027-11-03 19:15:08.382538409 +0000 UTC"
May 28 16:00:03.867298 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.867294    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12579h15m4.515247929s"
May 28 16:00:03.933177 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.933149    2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 16:00:03.943073 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943048    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-cni-netd\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.943073 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943080    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-ovnkube-config\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.943288 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943104    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-host\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.943288 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943174    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-cni-netd\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.943288 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943223    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-daemon-config\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.943288 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943238    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-host\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.943288 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943252    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59-agent-certs\") pod \"konnectivity-agent-8zhdh\" (UID: \"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59\") " pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943301    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjm7r\" (UniqueName: \"kubernetes.io/projected/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-kube-api-access-jjm7r\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943328    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxw7\" (UniqueName: \"kubernetes.io/projected/5a806bb5-7457-4709-a2e9-b99bfff01dd6-kube-api-access-5jxw7\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943366    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysctl-conf\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943389    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-host\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943415    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943441    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943466    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-run-netns\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943488    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-var-lib-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943513    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-ovnkube-script-lib\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.943553 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943537    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-system-cni-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943561    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-os-release\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943584    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-hostroot\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943608    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-registration-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943631    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-env-overrides\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943657    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-tmp-dir\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943676    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943687    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943710    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-run\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943735    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cnibin\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943756    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-ovn\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943776    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-log-socket\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943782    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-ovnkube-config\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943815    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-daemon-config\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943820    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7st69\" (UniqueName: \"kubernetes.io/projected/de5e856f-d624-4277-b328-654d0c5f92f7-kube-api-access-7st69\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943861    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-host\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943876    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9d111b1-ab4e-4450-af5b-a107d85fedb6-tmp\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943903    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwlml\" (UniqueName: \"kubernetes.io/projected/c9d111b1-ab4e-4450-af5b-a107d85fedb6-kube-api-access-gwlml\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943913    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-var-lib-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s54dw\" (UniqueName: \"kubernetes.io/projected/c9798092-6dc7-41c1-891a-4c5c71d35ad0-kube-api-access-s54dw\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943960    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-systemd\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943986    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944013    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944026    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944039    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-device-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944064    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-systemd\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944090    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d07df59-b2b2-41cf-ad45-87f59accfcb1-cni-binary-copy\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.943704    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-run-netns\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944116    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-netns\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944144    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-cni-multus\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944170    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbzrp\" (UniqueName: \"kubernetes.io/projected/1d07df59-b2b2-41cf-ad45-87f59accfcb1-kube-api-access-cbzrp\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944182    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-run\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944196    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-sys\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944222    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-lib-modules\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944229    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-hostroot\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.944819 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944252    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9798092-6dc7-41c1-891a-4c5c71d35ad0-host-slash\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944281    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-etc-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944310    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmj9n\" (UniqueName: \"kubernetes.io/projected/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-kube-api-access-bmj9n\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944331    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-conf-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944330    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-os-release\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944383    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-netns\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944416    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944441    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-etc-selinux\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944445    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-var-lib-kubelet\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944468    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-cni-multus\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944474    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-kubelet\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944502    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-tuned\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944544    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944578    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de5e856f-d624-4277-b328-654d0c5f92f7-ovn-node-metrics-cert\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944603    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-cnibin\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944610    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysctl-conf\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944641    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-sys\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944636    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-kubelet\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.945451 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944685    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-k8s-cni-cncf-io\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944716    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-socket-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945917    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945962    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945998    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-slash\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946028    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-node-log\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946031    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-ovnkube-script-lib\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945405    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-conf-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946062    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-cni-bin\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945583    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de5e856f-d624-4277-b328-654d0c5f92f7-env-overrides\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945779    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cnibin\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945831    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-ovn\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946105    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-modprobe-d\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945873    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-log-socket\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946140    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysconfig\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946180    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9798092-6dc7-41c1-891a-4c5c71d35ad0-iptables-alerter-script\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946225    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59-konnectivity-ca\") pod \"konnectivity-agent-8zhdh\" (UID: \"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59\") " pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:03.946279 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946260    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-cni-bin\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946338    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-etc-kubernetes\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6llm\" (UniqueName: \"kubernetes.io/projected/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-kube-api-access-s6llm\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946428    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-systemd-units\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946458    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-hosts-file\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946496    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-kubernetes\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946527    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysctl-d\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946559    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-system-cni-dir\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946593    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946631    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcq2b\" (UniqueName: \"kubernetes.io/projected/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-kube-api-access-qcq2b\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946664    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-serviceca\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946699    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-cni-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946733    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-socket-dir-parent\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946768    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-multus-certs\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946781    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-systemd\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946797    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-sys-fs\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.946996 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946836    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-os-release\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944995    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-tmp-dir\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947153    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-cnibin\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947211    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947497    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-kubelet\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947562    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947610    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947696    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944676    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-systemd\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-etc-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947989    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59-agent-certs\") pod \"konnectivity-agent-8zhdh\" (UID: \"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59\") " pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948015    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-slash\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.944282    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-system-cni-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d07df59-b2b2-41cf-ad45-87f59accfcb1-cni-binary-copy\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948119    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-device-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.946457    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948157    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-var-lib-kubelet\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-kubelet\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.952176 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948218    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-hosts-file\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948262    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-kubernetes\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948266    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-node-log\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945133    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-registration-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948325    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-var-lib-cni-bin\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948334    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-cni-dir\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.945620    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-lib-modules\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948416    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-system-cni-dir\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948434    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysctl-d\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948442    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-modprobe-d\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.947617    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-run-openvswitch\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-os-release\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948966    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-host-cni-bin\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.948984    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949058    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-sysconfig\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949083    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-k8s-cni-cncf-io\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949111    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-etc-kubernetes\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949144    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-sys-fs\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.957304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949160    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de5e856f-d624-4277-b328-654d0c5f92f7-systemd-units\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949214    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-host-run-multus-certs\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949270    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d07df59-b2b2-41cf-ad45-87f59accfcb1-multus-socket-dir-parent\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949447    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59-konnectivity-ca\") pod \"konnectivity-agent-8zhdh\" (UID: \"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59\") " pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949657    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a806bb5-7457-4709-a2e9-b99bfff01dd6-socket-dir\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.949679    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-serviceca\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.953139    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9d111b1-ab4e-4450-af5b-a107d85fedb6-tmp\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.953999    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.954100    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbzrp\" (UniqueName: \"kubernetes.io/projected/1d07df59-b2b2-41cf-ad45-87f59accfcb1-kube-api-access-cbzrp\") pod \"multus-crxmj\" (UID: \"1d07df59-b2b2-41cf-ad45-87f59accfcb1\") " pod="openshift-multus/multus-crxmj"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.954018    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.954177    2569 projected.go:194] Error preparing data for projected volume kube-api-access-qkg7t for pod openshift-network-diagnostics/network-check-target-zx25w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:03.954262    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t podName:d00f2fd4-46f3-4b34-97a9-f7231291f9a0 nodeName:}" failed. No retries permitted until 2026-05-28 16:00:04.454229051 +0000 UTC m=+3.074291850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qkg7t" (UniqueName: "kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t") pod "network-check-target-zx25w" (UID: "d00f2fd4-46f3-4b34-97a9-f7231291f9a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.954474    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9d111b1-ab4e-4450-af5b-a107d85fedb6-etc-tuned\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.954744    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de5e856f-d624-4277-b328-654d0c5f92f7-ovn-node-metrics-cert\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.955150    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmj9n\" (UniqueName: \"kubernetes.io/projected/5947a6a7-d0ff-4a55-aae1-458c3de5fbdc-kube-api-access-bmj9n\") pod \"node-ca-4qg6r\" (UID: \"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc\") " pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.955647    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxw7\" (UniqueName: \"kubernetes.io/projected/5a806bb5-7457-4709-a2e9-b99bfff01dd6-kube-api-access-5jxw7\") pod \"aws-ebs-csi-driver-node-7ng8h\" (UID: \"5a806bb5-7457-4709-a2e9-b99bfff01dd6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.956510    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7st69\" (UniqueName: \"kubernetes.io/projected/de5e856f-d624-4277-b328-654d0c5f92f7-kube-api-access-7st69\") pod \"ovnkube-node-5z2kh\" (UID: \"de5e856f-d624-4277-b328-654d0c5f92f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:03.958182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.956514    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjm7r\" (UniqueName: \"kubernetes.io/projected/5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce-kube-api-access-jjm7r\") pod \"node-resolver-h9dbh\" (UID: \"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce\") " pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:03.959069 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.957236    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwlml\" (UniqueName: \"kubernetes.io/projected/c9d111b1-ab4e-4450-af5b-a107d85fedb6-kube-api-access-gwlml\") pod \"tuned-lf6b5\" (UID: \"c9d111b1-ab4e-4450-af5b-a107d85fedb6\") " pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:03.959069 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.957238    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcq2b\" (UniqueName: \"kubernetes.io/projected/5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85-kube-api-access-qcq2b\") pod \"multus-additional-cni-plugins-p5zqc\" (UID: \"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85\") " pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:03.996618 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:03.996588    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:00:04.043038 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.043012    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:00:04.047470 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.047444    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9798092-6dc7-41c1-891a-4c5c71d35ad0-host-slash\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:04.047603 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.047494    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9798092-6dc7-41c1-891a-4c5c71d35ad0-iptables-alerter-script\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:04.047603 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.047512    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:04.047603 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.047552    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9798092-6dc7-41c1-891a-4c5c71d35ad0-host-slash\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:04.047709 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.047603    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6llm\" (UniqueName: \"kubernetes.io/projected/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-kube-api-access-s6llm\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:04.047709 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.047619    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:04.047709 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.047664    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s54dw\" (UniqueName: \"kubernetes.io/projected/c9798092-6dc7-41c1-891a-4c5c71d35ad0-kube-api-access-s54dw\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:04.047709 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.047690    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:00:04.547670055 +0000 UTC m=+3.167732832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:04.047912 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.047893    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9798092-6dc7-41c1-891a-4c5c71d35ad0-iptables-alerter-script\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:04.056163 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.056139    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s54dw\" (UniqueName: \"kubernetes.io/projected/c9798092-6dc7-41c1-891a-4c5c71d35ad0-kube-api-access-s54dw\") pod \"iptables-alerter-8pln9\" (UID: \"c9798092-6dc7-41c1-891a-4c5c71d35ad0\") " pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:04.056272 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.056220    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6llm\" (UniqueName: \"kubernetes.io/projected/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-kube-api-access-s6llm\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:04.132306 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.132213    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:04.142243 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.142193    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h9dbh"
May 28 16:00:04.149029 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.149004    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4qg6r"
May 28 16:00:04.158606 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.158581    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p5zqc"
May 28 16:00:04.165260 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.165238    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crxmj"
May 28 16:00:04.170872 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.170853    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h"
May 28 16:00:04.178470 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.178447    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:04.184096 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.184075    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lf6b5"
May 28 16:00:04.190713 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.190688    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8pln9"
May 28 16:00:04.551053 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.550981    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:04.551053 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.551026    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:04.551266 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.551118    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:00:04.551266 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.551143    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:00:04.551266 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.551152    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:04.551266 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.551207    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:00:05.551189787 +0000 UTC m=+4.171252562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:04.551266 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.551155    2569 projected.go:194] Error preparing data for projected volume kube-api-access-qkg7t for pod openshift-network-diagnostics/network-check-target-zx25w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:04.551519 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.551306    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t podName:d00f2fd4-46f3-4b34-97a9-f7231291f9a0 nodeName:}" failed. No retries permitted until 2026-05-28 16:00:05.551290394 +0000 UTC m=+4.171353174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkg7t" (UniqueName: "kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t") pod "network-check-target-zx25w" (UID: "d00f2fd4-46f3-4b34-97a9-f7231291f9a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:04.567636 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:04.567614    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d111b1_ab4e_4450_af5b_a107d85fedb6.slice/crio-0341cfb5820169f6114cb727fdc7068257781a7b9ef58c0621d37ba051eedff4 WatchSource:0}: Error finding container 0341cfb5820169f6114cb727fdc7068257781a7b9ef58c0621d37ba051eedff4: Status 404 returned error can't find the container with id 0341cfb5820169f6114cb727fdc7068257781a7b9ef58c0621d37ba051eedff4
May 28 16:00:04.568614 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:04.568575    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9798092_6dc7_41c1_891a_4c5c71d35ad0.slice/crio-ac37fceb7a0e92e2392633c8b3339e61a1799a23624670bd525fa9f0d8785493 WatchSource:0}: Error finding container ac37fceb7a0e92e2392633c8b3339e61a1799a23624670bd525fa9f0d8785493: Status 404 returned error can't find the container with id ac37fceb7a0e92e2392633c8b3339e61a1799a23624670bd525fa9f0d8785493
May 28 16:00:04.569414 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:04.569388    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d68fa3a_13ae_4126_8e5a_b09b2d8e3e85.slice/crio-5bdba150b0f880194571262763b60f9780917a44cfa0c69d6e57dd651f058a14 WatchSource:0}: Error finding container 5bdba150b0f880194571262763b60f9780917a44cfa0c69d6e57dd651f058a14: Status 404 returned error can't find the container with id 5bdba150b0f880194571262763b60f9780917a44cfa0c69d6e57dd651f058a14
May 28 16:00:04.570040 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:04.570015    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a806bb5_7457_4709_a2e9_b99bfff01dd6.slice/crio-3e6f8d9d24410f6a782b430faac5620238a0db85e0e84e821cf9412f3965cf46 WatchSource:0}: Error finding container 3e6f8d9d24410f6a782b430faac5620238a0db85e0e84e821cf9412f3965cf46: Status 404 returned error can't find the container with id 3e6f8d9d24410f6a782b430faac5620238a0db85e0e84e821cf9412f3965cf46
May 28 16:00:04.573589 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:00:04.573565    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d07df59_b2b2_41cf_ad45_87f59accfcb1.slice/crio-4a26c98d379bba9cdedfddb38a055dbeb8319c01321bb53589bfad565f4600ff WatchSource:0}: Error finding container 4a26c98d379bba9cdedfddb38a055dbeb8319c01321bb53589bfad565f4600ff: Status 404 returned error can't find the container with id 4a26c98d379bba9cdedfddb38a055dbeb8319c01321bb53589bfad565f4600ff
May 28 16:00:04.868110 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.867935    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 15:55:02 +0000 UTC" deadline="2028-01-11 12:36:13.179709644 +0000 UTC"
May 28 16:00:04.868391 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.868111    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14228h36m8.311601988s"
May 28 16:00:04.985605 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.985057    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:04.985605 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:04.985210    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:04.994083 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.994047    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h9dbh" event={"ID":"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce","Type":"ContainerStarted","Data":"b62ff3cc09a1ed4a0470178b3bf4cccb42062320506ebcc81f26b5c8ef914fb5"}
May 28 16:00:04.995689 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.995657    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"3f3484152392eb7a98a808a5c75b2670941cfb1a58b6c62cc1212d68f0085d4b"}
May 28 16:00:04.997386 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.997304    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4qg6r" event={"ID":"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc","Type":"ContainerStarted","Data":"4e4af35f7cbff431cdfbed834675722cdeb15aeeb6e85abc040f570b24ce6c88"}
May 28 16:00:04.998474 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:04.998446    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crxmj" event={"ID":"1d07df59-b2b2-41cf-ad45-87f59accfcb1","Type":"ContainerStarted","Data":"4a26c98d379bba9cdedfddb38a055dbeb8319c01321bb53589bfad565f4600ff"}
May 28 16:00:05.001042 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.000993    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lf6b5" event={"ID":"c9d111b1-ab4e-4450-af5b-a107d85fedb6","Type":"ContainerStarted","Data":"0341cfb5820169f6114cb727fdc7068257781a7b9ef58c0621d37ba051eedff4"}
May 28 16:00:05.003454 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.003427    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal" event={"ID":"f924e8114472614b63d1d03a6fe2dc94","Type":"ContainerStarted","Data":"56b770a5bf7ec4db4dd6690df6ae1bf804f306d2362c696381386728e7a1a709"}
May 28 16:00:05.004639 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.004615    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zhdh" event={"ID":"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59","Type":"ContainerStarted","Data":"adc8c0ceaef32720a24fe9eb431ba49641e275f8e2a259da27ea6421f1021623"}
May 28 16:00:05.005903 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.005878    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8pln9" event={"ID":"c9798092-6dc7-41c1-891a-4c5c71d35ad0","Type":"ContainerStarted","Data":"ac37fceb7a0e92e2392633c8b3339e61a1799a23624670bd525fa9f0d8785493"}
May 28 16:00:05.007720 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.007697    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h" event={"ID":"5a806bb5-7457-4709-a2e9-b99bfff01dd6","Type":"ContainerStarted","Data":"3e6f8d9d24410f6a782b430faac5620238a0db85e0e84e821cf9412f3965cf46"}
May 28 16:00:05.010247 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.010199    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerStarted","Data":"5bdba150b0f880194571262763b60f9780917a44cfa0c69d6e57dd651f058a14"}
May 28 16:00:05.011997 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.011962    2569 generic.go:358] "Generic (PLEG): container finished" podID="6df5d7107bc5dae1b7137d097e8becbf" containerID="4ac13bdd68370caaf08163b9a165509061ad1784b475eda49d125fea8567e782" exitCode=0
May 28 16:00:05.012117 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.011997    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal" event={"ID":"6df5d7107bc5dae1b7137d097e8becbf","Type":"ContainerDied","Data":"4ac13bdd68370caaf08163b9a165509061ad1784b475eda49d125fea8567e782"}
May 28 16:00:05.018826 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.018774    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-162.ec2.internal" podStartSLOduration=2.018756988 podStartE2EDuration="2.018756988s" podCreationTimestamp="2026-05-28 16:00:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:00:05.017441224 +0000 UTC m=+3.637504022" watchObservedRunningTime="2026-05-28 16:00:05.018756988 +0000 UTC m=+3.638819788"
May 28 16:00:05.559670 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.559581    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:05.559670 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.559646    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:05.559904 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:05.559810    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:05.559904 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:05.559875    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:00:07.559856223 +0000 UTC m=+6.179919005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:05.560019 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:05.559963    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:00:05.560019 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:05.559976    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:00:05.560019 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:05.559990    2569 projected.go:194] Error preparing data for projected volume kube-api-access-qkg7t for pod openshift-network-diagnostics/network-check-target-zx25w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:05.560160 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:05.560028    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t podName:d00f2fd4-46f3-4b34-97a9-f7231291f9a0 nodeName:}" failed. No retries permitted until 2026-05-28 16:00:07.560015656 +0000 UTC m=+6.180078433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkg7t" (UniqueName: "kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t") pod "network-check-target-zx25w" (UID: "d00f2fd4-46f3-4b34-97a9-f7231291f9a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:05.987624 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:05.987526    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:05.988057 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:05.987731    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:06.043772 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:06.043736    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal" event={"ID":"6df5d7107bc5dae1b7137d097e8becbf","Type":"ContainerStarted","Data":"298bb143f5de9bf2ed57042efd57021be18644894822ab78e744d9aa6cfa7849"}
May 28 16:00:06.986088 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:06.986045    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:06.986255 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:06.986152    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:07.575292 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:07.575255    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:07.575769 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:07.575313    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:07.575769 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:07.575466    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:07.575769 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:07.575524    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:00:11.575506057 +0000 UTC m=+10.195568836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:07.575997 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:07.575925    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:00:07.575997 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:07.575943    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:00:07.575997 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:07.575955    2569 projected.go:194] Error preparing data for projected volume kube-api-access-qkg7t for pod openshift-network-diagnostics/network-check-target-zx25w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:07.576158 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:07.575999    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t podName:d00f2fd4-46f3-4b34-97a9-f7231291f9a0 nodeName:}" failed. No retries permitted until 2026-05-28 16:00:11.575984766 +0000 UTC m=+10.196047544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkg7t" (UniqueName: "kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t") pod "network-check-target-zx25w" (UID: "d00f2fd4-46f3-4b34-97a9-f7231291f9a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:07.985954 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:07.985870    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:07.986124 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:07.986007    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:08.985807 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:08.985676    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:08.986322 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:08.985826    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:09.986818 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:09.986733    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:09.987285 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:09.986893    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:10.985544 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:10.985501    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:10.985750 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:10.985660    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:11.611078 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:11.611036    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:11.611587 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:11.611096    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:11.611587 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:11.611217    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:00:11.611587 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:11.611237    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:11.611587 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:11.611241    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:00:11.611587 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:11.611260    2569 projected.go:194] Error preparing data for projected volume kube-api-access-qkg7t for pod openshift-network-diagnostics/network-check-target-zx25w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:11.611587 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:11.611304    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:00:19.611285504 +0000 UTC m=+18.231348296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:11.611587 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:11.611322    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t podName:d00f2fd4-46f3-4b34-97a9-f7231291f9a0 nodeName:}" failed. No retries permitted until 2026-05-28 16:00:19.61131407 +0000 UTC m=+18.231376845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkg7t" (UniqueName: "kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t") pod "network-check-target-zx25w" (UID: "d00f2fd4-46f3-4b34-97a9-f7231291f9a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:11.986405 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:11.986305    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:11.986570 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:11.986436    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:12.985664 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:12.985634    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:12.986105 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:12.985765    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:13.985697 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:13.985651    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:13.986122 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:13.985787    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:14.985933 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:14.985894    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:14.986397 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:14.986022    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:15.987990 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:15.987961    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:15.988385 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:15.988073    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:16.985551 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:16.985512    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:16.985742 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:16.985653    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:17.986152 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:17.986115    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:17.986650 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:17.986247    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:18.985098 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:18.985053    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:18.985273 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:18.985201    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:19.664206 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:19.664165    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:19.664206 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:19.664210    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:19.664731 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:19.664327    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:19.664731 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:19.664368    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:00:19.664731 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:19.664397    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:00:19.664731 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:19.664405    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:00:35.664384852 +0000 UTC m=+34.284447652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:19.664731 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:19.664411    2569 projected.go:194] Error preparing data for projected volume kube-api-access-qkg7t for pod openshift-network-diagnostics/network-check-target-zx25w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:19.664731 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:19.664467    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t podName:d00f2fd4-46f3-4b34-97a9-f7231291f9a0 nodeName:}" failed. No retries permitted until 2026-05-28 16:00:35.664449519 +0000 UTC m=+34.284512317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkg7t" (UniqueName: "kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t") pod "network-check-target-zx25w" (UID: "d00f2fd4-46f3-4b34-97a9-f7231291f9a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:19.988426 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:19.988341    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:19.988574 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:19.988461    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:20.986050 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:20.986017    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:20.986521 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:20.986152    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:21.986463 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:21.986431    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:21.986827 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:21.986523    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:22.986186 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:22.985978    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:22.986340 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:22.986315    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:23.076965 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.076935    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crxmj" event={"ID":"1d07df59-b2b2-41cf-ad45-87f59accfcb1","Type":"ContainerStarted","Data":"e49a040e0f9d196b398c96ec2eff160f1d68eb1d65d6033ea1aeedfdcd56f5df"}
May 28 16:00:23.078531 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.078501    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lf6b5" event={"ID":"c9d111b1-ab4e-4450-af5b-a107d85fedb6","Type":"ContainerStarted","Data":"c99fa656a16a21b8ae0cdb63038ced8e48358529a7de321d54ce236832867a83"}
May 28 16:00:23.079835 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.079783    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zhdh" event={"ID":"bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59","Type":"ContainerStarted","Data":"15f4335e20941839553ca57f77391bc5c5f3ca05a4f829652fc4a911a8243d52"}
May 28 16:00:23.081227 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.081207    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h" event={"ID":"5a806bb5-7457-4709-a2e9-b99bfff01dd6","Type":"ContainerStarted","Data":"8a612260e79afcc332c14293242d8e6d586f2f0857c1f20bd120274da3c4a2d3"}
May 28 16:00:23.082541 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.082519    2569 generic.go:358] "Generic (PLEG): container finished" podID="5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85" containerID="b8f2727225621125435d416a55869eae5809f7a444864affaaedd130c3d1cda2" exitCode=0
May 28 16:00:23.082654 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.082618    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerDied","Data":"b8f2727225621125435d416a55869eae5809f7a444864affaaedd130c3d1cda2"}
May 28 16:00:23.083984 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.083902    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h9dbh" event={"ID":"5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce","Type":"ContainerStarted","Data":"a089f2f507a8b28a59e8f7ab80b0d4c75b533631a822c12cf8e756a050662b5f"}
May 28 16:00:23.085905 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.085889    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:00:23.086198 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.086166    2569 generic.go:358] "Generic (PLEG): container finished" podID="de5e856f-d624-4277-b328-654d0c5f92f7" containerID="a7f3cebeaad8e94e294dfa515c37dd231352caf82a6a120bfe3c909b2a9b3d5f" exitCode=1
May 28 16:00:23.086284 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.086242    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"c705488d96085b337a2a3a2d99f3bc1162dc5fa113560a83f9b3ed778763111c"}
May 28 16:00:23.086284 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.086266    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerDied","Data":"a7f3cebeaad8e94e294dfa515c37dd231352caf82a6a120bfe3c909b2a9b3d5f"}
May 28 16:00:23.086284 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.086277    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"2a73d345ef4366f5daf250a93567687d728d6f665103346225a91664621019de"}
May 28 16:00:23.087448 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.087413    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4qg6r" event={"ID":"5947a6a7-d0ff-4a55-aae1-458c3de5fbdc","Type":"ContainerStarted","Data":"05bcdaa3b597484aba4077016a98a474024257be0e239f45232fef567a9d71b4"}
May 28 16:00:23.095098 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.093204    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-162.ec2.internal" podStartSLOduration=20.093188582 podStartE2EDuration="20.093188582s" podCreationTimestamp="2026-05-28 16:00:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:00:06.059410465 +0000 UTC m=+4.679473263" watchObservedRunningTime="2026-05-28 16:00:23.093188582 +0000 UTC m=+21.713251380"
May 28 16:00:23.095098 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.094272    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-crxmj" podStartSLOduration=3.223352935 podStartE2EDuration="21.094261876s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.575285557 +0000 UTC m=+3.195348348" lastFinishedPulling="2026-05-28 16:00:22.446194508 +0000 UTC m=+21.066257289" observedRunningTime="2026-05-28 16:00:23.092949448 +0000 UTC m=+21.713012246" watchObservedRunningTime="2026-05-28 16:00:23.094261876 +0000 UTC m=+21.714324672"
May 28 16:00:23.106780 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.106730    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-h9dbh" podStartSLOduration=3.648145436 podStartE2EDuration="21.106716511s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.581217157 +0000 UTC m=+3.201279936" lastFinishedPulling="2026-05-28 16:00:22.039788212 +0000 UTC m=+20.659851011" observedRunningTime="2026-05-28 16:00:23.106435378 +0000 UTC m=+21.726498176" watchObservedRunningTime="2026-05-28 16:00:23.106716511 +0000 UTC m=+21.726779307"
May 28 16:00:23.119721 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.119678    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4qg6r" podStartSLOduration=3.3126758609999998 podStartE2EDuration="21.119659304s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.579506016 +0000 UTC m=+3.199568791" lastFinishedPulling="2026-05-28 16:00:22.386489445 +0000 UTC m=+21.006552234" observedRunningTime="2026-05-28 16:00:23.119280469 +0000 UTC m=+21.739343268" watchObservedRunningTime="2026-05-28 16:00:23.119659304 +0000 UTC m=+21.739722103"
May 28 16:00:23.157380 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.157316    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8zhdh" podStartSLOduration=7.943363219 podStartE2EDuration="21.157301553s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.582869637 +0000 UTC m=+3.202932417" lastFinishedPulling="2026-05-28 16:00:17.796807958 +0000 UTC m=+16.416870751" observedRunningTime="2026-05-28 16:00:23.157082631 +0000 UTC m=+21.777145429" watchObservedRunningTime="2026-05-28 16:00:23.157301553 +0000 UTC m=+21.777364350"
May 28 16:00:23.174019 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.173961    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lf6b5" podStartSLOduration=3.30321916 podStartE2EDuration="21.173945161s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.570766659 +0000 UTC m=+3.190829457" lastFinishedPulling="2026-05-28 16:00:22.441492675 +0000 UTC m=+21.061555458" observedRunningTime="2026-05-28 16:00:23.173511532 +0000 UTC m=+21.793574332" watchObservedRunningTime="2026-05-28 16:00:23.173945161 +0000 UTC m=+21.794007957"
May 28 16:00:23.968310 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.968262    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 16:00:23.985935 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:23.985905    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:23.986100 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:23.985999    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:24.092390 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.092337    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:00:24.092808 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.092680    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"9cce8864289912544ddcca8fb5db448e43f0a2328bd0491998a199dcbdf9da16"}
May 28 16:00:24.092808 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.092718    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"9246a0a4c43291803dd3e2ef0b7ac9898f3302798181e773d971087d61780a0e"}
May 28 16:00:24.092808 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.092727    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"a6fd8fad6409e4ec5b2d62e65b70fa7a54eecac7d6c2adc86660cae8197ca4b1"}
May 28 16:00:24.093804 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.093778    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8pln9" event={"ID":"c9798092-6dc7-41c1-891a-4c5c71d35ad0","Type":"ContainerStarted","Data":"2305a1b857d8cead9fd18db883f797b94e46c54388265caf7967d278d6dd0f30"}
May 28 16:00:24.095666 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.095637    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h" event={"ID":"5a806bb5-7457-4709-a2e9-b99bfff01dd6","Type":"ContainerStarted","Data":"d4fa764765ecf09535087f770fff0e27d73e155111ed09edf18766ca43c3160a"}
May 28 16:00:24.110256 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.110209    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8pln9" podStartSLOduration=8.884151020000001 podStartE2EDuration="22.110192039s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.570770372 +0000 UTC m=+3.190833151" lastFinishedPulling="2026-05-28 16:00:17.796811389 +0000 UTC m=+16.416874170" observedRunningTime="2026-05-28 16:00:24.109789283 +0000 UTC m=+22.729852081" watchObservedRunningTime="2026-05-28 16:00:24.110192039 +0000 UTC m=+22.730254836"
May 28 16:00:24.914947 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.914839    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T16:00:23.968285979Z","UUID":"16c5cf83-0ee5-40a4-87ac-ad50f6919c4f","Handler":null,"Name":"","Endpoint":""}
May 28 16:00:24.916521 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.916500    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 16:00:24.916640 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.916537    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 16:00:24.985062 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:24.985027    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:24.985228 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:24.985149    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:25.985557 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:25.985383    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:25.985927 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:25.985630    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:26.102006 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:26.101981    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:00:26.102363 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:26.102327    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"1e84ad789c7c5679f5afbd7f6aeda359a9321315e98b5ab1bbc38cb9d5e390b1"}
May 28 16:00:26.103984 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:26.103962    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h" event={"ID":"5a806bb5-7457-4709-a2e9-b99bfff01dd6","Type":"ContainerStarted","Data":"3808e5d5342fcf867b43546f7f593b1fefeab09d9857cd1ec68c83789359f6be"}
May 28 16:00:26.457098 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:26.457059    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:26.458146 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:26.458126    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:26.473995 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:26.473949    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7ng8h" podStartSLOduration=4.00574455 podStartE2EDuration="24.473933549s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.572440749 +0000 UTC m=+3.192503524" lastFinishedPulling="2026-05-28 16:00:25.040629733 +0000 UTC m=+23.660692523" observedRunningTime="2026-05-28 16:00:26.12049702 +0000 UTC m=+24.740559816" watchObservedRunningTime="2026-05-28 16:00:26.473933549 +0000 UTC m=+25.093996346"
May 28 16:00:26.986047 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:26.986014    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:26.986544 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:26.986129    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:27.106575 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:27.106543    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:27.106770 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:27.106754    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8zhdh"
May 28 16:00:27.985824 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:27.985738    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:27.985988 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:27.985863    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:28.985105 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:28.985066    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:28.985661 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:28.985220    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:29.985698 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:29.985512    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:29.986334 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:29.985788    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:30.113101 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.113066    2569 generic.go:358] "Generic (PLEG): container finished" podID="5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85" containerID="a275f0791f832e7d1b07ce5671187de27b34692215989cd524545e840387e5f9" exitCode=0
May 28 16:00:30.113242 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.113159    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerDied","Data":"a275f0791f832e7d1b07ce5671187de27b34692215989cd524545e840387e5f9"}
May 28 16:00:30.115994 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.115978    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:00:30.116278 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.116258    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"60f97a69eb320d3aa36c73e19de83f991d3b3d8a0a1d887a412a380808f8bc81"}
May 28 16:00:30.116580 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.116563    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:30.116634 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.116589    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:30.116739 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.116722    2569 scope.go:117] "RemoveContainer" containerID="a7f3cebeaad8e94e294dfa515c37dd231352caf82a6a120bfe3c909b2a9b3d5f"
May 28 16:00:30.132643 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.132616    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:30.132798 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.132778    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:30.985582 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:30.985546    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:30.985736 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:30.985720    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:31.099649 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.099608    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kts5f"]
May 28 16:00:31.101872 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.101844    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zx25w"]
May 28 16:00:31.102001 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.101957    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:31.102073 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:31.102034    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:31.120805 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.120773    2569 generic.go:358] "Generic (PLEG): container finished" podID="5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85" containerID="00c3d15674bd79e5789092e92580724d3b735ede207d01ed86ad17ef74d7cce7" exitCode=0
May 28 16:00:31.120955 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.120863    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerDied","Data":"00c3d15674bd79e5789092e92580724d3b735ede207d01ed86ad17ef74d7cce7"}
May 28 16:00:31.124837 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.124816    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:00:31.125266 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.125246    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:31.125387 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:31.125367    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:31.125522 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.125501    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" event={"ID":"de5e856f-d624-4277-b328-654d0c5f92f7","Type":"ContainerStarted","Data":"e6ee00dbd9f980018f84f20599220f60362232c60d05f32832f59a9b0865d5eb"}
May 28 16:00:31.125567 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.125541    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 16:00:31.162738 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.162642    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh" podStartSLOduration=11.253415128 podStartE2EDuration="29.162627551s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.579038913 +0000 UTC m=+3.199101703" lastFinishedPulling="2026-05-28 16:00:22.488251338 +0000 UTC m=+21.108314126" observedRunningTime="2026-05-28 16:00:31.161769614 +0000 UTC m=+29.781832411" watchObservedRunningTime="2026-05-28 16:00:31.162627551 +0000 UTC m=+29.782690348"
May 28 16:00:31.631898 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:31.631860    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:00:32.132655 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:32.132425    2569 generic.go:358] "Generic (PLEG): container finished" podID="5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85" containerID="e6deee4b29da274afa20e507b5c726d06f1b5bd0d0614e9fb8f5d074663199fc" exitCode=0
May 28 16:00:32.132994 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:32.132511    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerDied","Data":"e6deee4b29da274afa20e507b5c726d06f1b5bd0d0614e9fb8f5d074663199fc"}
May 28 16:00:32.986006 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:32.985972    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:32.986184 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:32.986018    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:32.986184 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:32.986098    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:32.986271 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:32.986224    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:34.985798 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:34.985762    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:34.986409 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:34.985778    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:34.986409 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:34.985884    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zx25w" podUID="d00f2fd4-46f3-4b34-97a9-f7231291f9a0"
May 28 16:00:34.986409 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:34.985967    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kts5f" podUID="81550bb3-ca36-4a57-9717-e0f1aa3bf42b"
May 28 16:00:35.223480 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.223447    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-162.ec2.internal" event="NodeReady"
May 28 16:00:35.223655 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.223598    2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 16:00:35.264727 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.264693    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ffj8h"]
May 28 16:00:35.316420 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.316381    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fmtj4"]
May 28 16:00:35.316608 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.316564    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.319858 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.319823    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 16:00:35.319993 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.319901    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ptwfd\""
May 28 16:00:35.320260 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.320242    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 16:00:35.337363 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.337320    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ffj8h"]
May 28 16:00:35.337363 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.337370    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmtj4"]
May 28 16:00:35.337567 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.337549    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:35.340582 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.340438    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 16:00:35.340582 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.340457    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 16:00:35.340582 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.340517    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 16:00:35.340815 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.340630    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9w77f\""
May 28 16:00:35.390326 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.390288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df192315-bb48-45c5-b0e5-65126b2e140a-tmp-dir\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.390519 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.390371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df192315-bb48-45c5-b0e5-65126b2e140a-config-volume\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.390519 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.390457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.390519 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.390505    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8xkz\" (UniqueName: \"kubernetes.io/projected/df192315-bb48-45c5-b0e5-65126b2e140a-kube-api-access-g8xkz\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.491213 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.491177    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df192315-bb48-45c5-b0e5-65126b2e140a-tmp-dir\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.491413 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.491267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n64sp\" (UniqueName: \"kubernetes.io/projected/8c07099c-979a-4281-b39e-ce93481a20dd-kube-api-access-n64sp\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:35.491413 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.491294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:35.491413 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.491328    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df192315-bb48-45c5-b0e5-65126b2e140a-config-volume\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.491413 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.491377    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.491627 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.491445    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8xkz\" (UniqueName: \"kubernetes.io/projected/df192315-bb48-45c5-b0e5-65126b2e140a-kube-api-access-g8xkz\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.491627 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.491473    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:00:35.491627 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.491531    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls podName:df192315-bb48-45c5-b0e5-65126b2e140a nodeName:}" failed. No retries permitted until 2026-05-28 16:00:35.991512806 +0000 UTC m=+34.611575595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls") pod "dns-default-ffj8h" (UID: "df192315-bb48-45c5-b0e5-65126b2e140a") : secret "dns-default-metrics-tls" not found
May 28 16:00:35.491627 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.491583    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df192315-bb48-45c5-b0e5-65126b2e140a-tmp-dir\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.492063 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.492041    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/df192315-bb48-45c5-b0e5-65126b2e140a-config-volume\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.502555 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.502525    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8xkz\" (UniqueName: \"kubernetes.io/projected/df192315-bb48-45c5-b0e5-65126b2e140a-kube-api-access-g8xkz\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.592634 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.592550    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n64sp\" (UniqueName: \"kubernetes.io/projected/8c07099c-979a-4281-b39e-ce93481a20dd-kube-api-access-n64sp\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:35.592634 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.592586    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:35.592827 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.592738    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:00:35.592827 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.592806    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert podName:8c07099c-979a-4281-b39e-ce93481a20dd nodeName:}" failed. No retries permitted until 2026-05-28 16:00:36.092787355 +0000 UTC m=+34.712850133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert") pod "ingress-canary-fmtj4" (UID: "8c07099c-979a-4281-b39e-ce93481a20dd") : secret "canary-serving-cert" not found
May 28 16:00:35.604242 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.604212    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n64sp\" (UniqueName: \"kubernetes.io/projected/8c07099c-979a-4281-b39e-ce93481a20dd-kube-api-access-n64sp\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:35.693420 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.693381    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:35.693420 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.693426    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:35.693679 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.693548    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:00:35.693679 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.693560    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:35.693679 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.693569    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:00:35.693679 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.693581    2569 projected.go:194] Error preparing data for projected volume kube-api-access-qkg7t for pod openshift-network-diagnostics/network-check-target-zx25w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:35.693679 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.693632    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:01:07.693615415 +0000 UTC m=+66.313678209 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:00:35.693679 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.693648    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t podName:d00f2fd4-46f3-4b34-97a9-f7231291f9a0 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:07.693640685 +0000 UTC m=+66.313703473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkg7t" (UniqueName: "kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t") pod "network-check-target-zx25w" (UID: "d00f2fd4-46f3-4b34-97a9-f7231291f9a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:00:35.996458 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:35.996388    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:35.997007 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.996500    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:00:35.997007 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:35.996548    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls podName:df192315-bb48-45c5-b0e5-65126b2e140a nodeName:}" failed. No retries permitted until 2026-05-28 16:00:36.996535969 +0000 UTC m=+35.616598757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls") pod "dns-default-ffj8h" (UID: "df192315-bb48-45c5-b0e5-65126b2e140a") : secret "dns-default-metrics-tls" not found
May 28 16:00:36.097722 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.097685    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:36.097972 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:36.097852    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:00:36.097972 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:36.097928    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert podName:8c07099c-979a-4281-b39e-ce93481a20dd nodeName:}" failed. No retries permitted until 2026-05-28 16:00:37.097907191 +0000 UTC m=+35.717970024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert") pod "ingress-canary-fmtj4" (UID: "8c07099c-979a-4281-b39e-ce93481a20dd") : secret "canary-serving-cert" not found
May 28 16:00:36.985683 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.985649    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:00:36.985962 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.985663    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:00:36.990054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.990013    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 16:00:36.990054 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.990030    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6wrpt\""
May 28 16:00:36.990255 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.990030    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4ck6s\""
May 28 16:00:36.990255 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.990032    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 16:00:36.990255 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:36.990030    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 16:00:37.004588 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:37.004560    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:37.004921 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:37.004689    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:00:37.004921 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:37.004744    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls podName:df192315-bb48-45c5-b0e5-65126b2e140a nodeName:}" failed. No retries permitted until 2026-05-28 16:00:39.004727196 +0000 UTC m=+37.624789971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls") pod "dns-default-ffj8h" (UID: "df192315-bb48-45c5-b0e5-65126b2e140a") : secret "dns-default-metrics-tls" not found
May 28 16:00:37.105731 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:37.105690    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:37.105913 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:37.105893    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:00:37.105983 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:37.105960    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert podName:8c07099c-979a-4281-b39e-ce93481a20dd nodeName:}" failed. No retries permitted until 2026-05-28 16:00:39.105941223 +0000 UTC m=+37.726004002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert") pod "ingress-canary-fmtj4" (UID: "8c07099c-979a-4281-b39e-ce93481a20dd") : secret "canary-serving-cert" not found
May 28 16:00:39.021914 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:39.021725    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:39.022286 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:39.021885    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:00:39.022286 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:39.021978    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls podName:df192315-bb48-45c5-b0e5-65126b2e140a nodeName:}" failed. No retries permitted until 2026-05-28 16:00:43.021963239 +0000 UTC m=+41.642026013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls") pod "dns-default-ffj8h" (UID: "df192315-bb48-45c5-b0e5-65126b2e140a") : secret "dns-default-metrics-tls" not found
May 28 16:00:39.122962 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:39.122924    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:39.123158 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:39.123048    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:00:39.123158 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:39.123100    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert podName:8c07099c-979a-4281-b39e-ce93481a20dd nodeName:}" failed. No retries permitted until 2026-05-28 16:00:43.123084901 +0000 UTC m=+41.743147676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert") pod "ingress-canary-fmtj4" (UID: "8c07099c-979a-4281-b39e-ce93481a20dd") : secret "canary-serving-cert" not found
May 28 16:00:39.149157 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:39.149124    2569 generic.go:358] "Generic (PLEG): container finished" podID="5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85" containerID="5e91dfe1c8c36d595e42fc13ade59298c597e46d3e317ae039cee78e578f9b7f" exitCode=0
May 28 16:00:39.149315 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:39.149186    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerDied","Data":"5e91dfe1c8c36d595e42fc13ade59298c597e46d3e317ae039cee78e578f9b7f"}
May 28 16:00:40.153742 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:40.153707    2569 generic.go:358] "Generic (PLEG): container finished" podID="5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85" containerID="e71d7ae4726b7e0b18402e9df28525b5ac075423a42478199a0da0c799e17ac5" exitCode=0
May 28 16:00:40.154107 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:40.153764    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerDied","Data":"e71d7ae4726b7e0b18402e9df28525b5ac075423a42478199a0da0c799e17ac5"}
May 28 16:00:41.159799 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:41.159764    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" event={"ID":"5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85","Type":"ContainerStarted","Data":"ea6cd4507cb53987ed228a064397b0f92425fee7348928de4babe1e440f2e6b5"}
May 28 16:00:41.184069 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:41.183977    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p5zqc" podStartSLOduration=5.314968709 podStartE2EDuration="39.183957007s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:00:04.571848334 +0000 UTC m=+3.191911125" lastFinishedPulling="2026-05-28 16:00:38.440836646 +0000 UTC m=+37.060899423" observedRunningTime="2026-05-28 16:00:41.182407506 +0000 UTC m=+39.802470303" watchObservedRunningTime="2026-05-28 16:00:41.183957007 +0000 UTC m=+39.804019803"
May 28 16:00:43.052414 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:43.052369    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:43.052876 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:43.052448    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:00:43.052876 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:43.052516    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls podName:df192315-bb48-45c5-b0e5-65126b2e140a nodeName:}" failed. No retries permitted until 2026-05-28 16:00:51.052499759 +0000 UTC m=+49.672562539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls") pod "dns-default-ffj8h" (UID: "df192315-bb48-45c5-b0e5-65126b2e140a") : secret "dns-default-metrics-tls" not found
May 28 16:00:43.153642 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:43.153606    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:43.153811 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:43.153740    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:00:43.153811 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:43.153798    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert podName:8c07099c-979a-4281-b39e-ce93481a20dd nodeName:}" failed. No retries permitted until 2026-05-28 16:00:51.153783353 +0000 UTC m=+49.773846133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert") pod "ingress-canary-fmtj4" (UID: "8c07099c-979a-4281-b39e-ce93481a20dd") : secret "canary-serving-cert" not found
May 28 16:00:51.111259 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:51.111218    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:00:51.111670 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:51.111343    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:00:51.111670 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:51.111418    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls podName:df192315-bb48-45c5-b0e5-65126b2e140a nodeName:}" failed. No retries permitted until 2026-05-28 16:01:07.111403567 +0000 UTC m=+65.731466343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls") pod "dns-default-ffj8h" (UID: "df192315-bb48-45c5-b0e5-65126b2e140a") : secret "dns-default-metrics-tls" not found
May 28 16:00:51.212208 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:00:51.212173    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:00:51.212408 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:51.212284    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:00:51.212408 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:00:51.212333    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert podName:8c07099c-979a-4281-b39e-ce93481a20dd nodeName:}" failed. No retries permitted until 2026-05-28 16:01:07.212319821 +0000 UTC m=+65.832382595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert") pod "ingress-canary-fmtj4" (UID: "8c07099c-979a-4281-b39e-ce93481a20dd") : secret "canary-serving-cert" not found
May 28 16:01:03.145436 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:03.145403    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5z2kh"
May 28 16:01:07.123292 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.123254    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:01:07.123691 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:07.123417    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:01:07.123691 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:07.123489    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls podName:df192315-bb48-45c5-b0e5-65126b2e140a nodeName:}" failed. No retries permitted until 2026-05-28 16:01:39.123470526 +0000 UTC m=+97.743533303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls") pod "dns-default-ffj8h" (UID: "df192315-bb48-45c5-b0e5-65126b2e140a") : secret "dns-default-metrics-tls" not found
May 28 16:01:07.223895 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.223860    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:01:07.224050 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:07.223999    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:01:07.224092 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:07.224054    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert podName:8c07099c-979a-4281-b39e-ce93481a20dd nodeName:}" failed. No retries permitted until 2026-05-28 16:01:39.22403962 +0000 UTC m=+97.844102396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert") pod "ingress-canary-fmtj4" (UID: "8c07099c-979a-4281-b39e-ce93481a20dd") : secret "canary-serving-cert" not found
May 28 16:01:07.726704 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.726666    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:01:07.726883 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.726716    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:01:07.729955 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.729936    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 16:01:07.730025 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.729982    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 16:01:07.737632 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:07.737611    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 16:01:07.737702 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:07.737671    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs podName:81550bb3-ca36-4a57-9717-e0f1aa3bf42b nodeName:}" failed. No retries permitted until 2026-05-28 16:02:11.737654769 +0000 UTC m=+130.357717544 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs") pod "network-metrics-daemon-kts5f" (UID: "81550bb3-ca36-4a57-9717-e0f1aa3bf42b") : secret "metrics-daemon-secret" not found
May 28 16:01:07.740956 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.740937    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 16:01:07.751632 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.751598    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkg7t\" (UniqueName: \"kubernetes.io/projected/d00f2fd4-46f3-4b34-97a9-f7231291f9a0-kube-api-access-qkg7t\") pod \"network-check-target-zx25w\" (UID: \"d00f2fd4-46f3-4b34-97a9-f7231291f9a0\") " pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:01:07.900409 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.900382    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6wrpt\""
May 28 16:01:07.908195 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:07.908167    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:01:08.042787 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:08.040653    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zx25w"]
May 28 16:01:08.046179 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:08.046153    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00f2fd4_46f3_4b34_97a9_f7231291f9a0.slice/crio-0b3e0f8c65343d2adc425ade2504c3f90b412b0d78d56a63690d36d13a5eebe4 WatchSource:0}: Error finding container 0b3e0f8c65343d2adc425ade2504c3f90b412b0d78d56a63690d36d13a5eebe4: Status 404 returned error can't find the container with id 0b3e0f8c65343d2adc425ade2504c3f90b412b0d78d56a63690d36d13a5eebe4
May 28 16:01:08.210793 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:08.210756    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zx25w" event={"ID":"d00f2fd4-46f3-4b34-97a9-f7231291f9a0","Type":"ContainerStarted","Data":"0b3e0f8c65343d2adc425ade2504c3f90b412b0d78d56a63690d36d13a5eebe4"}
May 28 16:01:12.220088 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:12.220045    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zx25w" event={"ID":"d00f2fd4-46f3-4b34-97a9-f7231291f9a0","Type":"ContainerStarted","Data":"2726748bc8c2b1460c44289a07b32f0e4b6642fff1eb689ccea9ff209e2f9532"}
May 28 16:01:12.220537 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:12.220201    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:01:12.240283 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:12.240222    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zx25w" podStartSLOduration=66.619980785 podStartE2EDuration="1m10.240203555s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:01:08.048051351 +0000 UTC m=+66.668114126" lastFinishedPulling="2026-05-28 16:01:11.668274109 +0000 UTC m=+70.288336896" observedRunningTime="2026-05-28 16:01:12.240060004 +0000 UTC m=+70.860122813" watchObservedRunningTime="2026-05-28 16:01:12.240203555 +0000 UTC m=+70.860266353"
May 28 16:01:15.002275 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.002242    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-646659fbd6-gztfn"]
May 28 16:01:15.004067 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.004051    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.006868 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.006840    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 28 16:01:15.007002 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.006886    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j92q2\""
May 28 16:01:15.007002 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.006900    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 28 16:01:15.007002 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.006891    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 28 16:01:15.007362 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.007330    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 28 16:01:15.007441 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.007362    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 16:01:15.008013 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.007999    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 16:01:15.059389 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.059356    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-646659fbd6-gztfn"]
May 28 16:01:15.179052 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.179012    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-default-certificate\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.179052 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.179060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.179270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.179078    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-stats-auth\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.179270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.179181    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.179270 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.179221    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhbj5\" (UniqueName: \"kubernetes.io/projected/d94218ef-2ca8-463d-94ff-4019d77e3273-kube-api-access-qhbj5\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.201044 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.201006    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"]
May 28 16:01:15.202916 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.202900    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.206836 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.206813    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 28 16:01:15.206955 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.206880    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c45vv\""
May 28 16:01:15.206955 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.206880    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 16:01:15.207065 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.206880    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 16:01:15.207065 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.206887    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 28 16:01:15.214804 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.214781    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"]
May 28 16:01:15.280435 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280400    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.280621 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.280621 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280468    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhbj5\" (UniqueName: \"kubernetes.io/projected/d94218ef-2ca8-463d-94ff-4019d77e3273-kube-api-access-qhbj5\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.280621 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.280550    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:01:15.280764 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280641    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-default-certificate\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.280764 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.280660    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:15.780642981 +0000 UTC m=+74.400705757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : secret "router-metrics-certs-default" not found
May 28 16:01:15.280764 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h55j8\" (UniqueName: \"kubernetes.io/projected/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-kube-api-access-h55j8\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.280764 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.280764 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280758    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.280993 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.280780    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-stats-auth\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.280993 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.280908    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:15.780888531 +0000 UTC m=+74.400951330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : configmap references non-existent config key: service-ca.crt
May 28 16:01:15.283003 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.282978    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-stats-auth\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.283132 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.283112    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-default-certificate\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.290932 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.290906    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhbj5\" (UniqueName: \"kubernetes.io/projected/d94218ef-2ca8-463d-94ff-4019d77e3273-kube-api-access-qhbj5\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.381546 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.381501    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h55j8\" (UniqueName: \"kubernetes.io/projected/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-kube-api-access-h55j8\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.381710 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.381565    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.381710 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.381637    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.381710 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.381696    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:01:15.381889 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.381781    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls podName:110ab087-4c08-4d4c-bbd5-a2af80b54ad7 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:15.881761479 +0000 UTC m=+74.501824279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hvgpp" (UID: "110ab087-4c08-4d4c-bbd5-a2af80b54ad7") : secret "cluster-monitoring-operator-tls" not found
May 28 16:01:15.382318 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.382291    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.391955 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.391932    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h55j8\" (UniqueName: \"kubernetes.io/projected/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-kube-api-access-h55j8\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.785000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.784965    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.785159 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.785021    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:15.785159 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.785123    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:01:15.785159 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.785124    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:16.785107658 +0000 UTC m=+75.405170433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : configmap references non-existent config key: service-ca.crt
May 28 16:01:15.785259 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.785177    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:16.785160916 +0000 UTC m=+75.405223691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : secret "router-metrics-certs-default" not found
May 28 16:01:15.885516 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:15.885479    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:15.885655 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.885640    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:01:15.885713 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:15.885702    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls podName:110ab087-4c08-4d4c-bbd5-a2af80b54ad7 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:16.885683891 +0000 UTC m=+75.505746688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hvgpp" (UID: "110ab087-4c08-4d4c-bbd5-a2af80b54ad7") : secret "cluster-monitoring-operator-tls" not found
May 28 16:01:16.791635 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:16.791599    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:16.792002 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:16.791654    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:16.792002 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:16.791759    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:01:16.792002 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:16.791769    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:18.791752871 +0000 UTC m=+77.411815646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : configmap references non-existent config key: service-ca.crt
May 28 16:01:16.792002 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:16.791798    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:18.791786344 +0000 UTC m=+77.411849120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : secret "router-metrics-certs-default" not found
May 28 16:01:16.892093 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:16.892059    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:16.892200 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:16.892182    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:01:16.892250 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:16.892240    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls podName:110ab087-4c08-4d4c-bbd5-a2af80b54ad7 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:18.892225532 +0000 UTC m=+77.512288307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hvgpp" (UID: "110ab087-4c08-4d4c-bbd5-a2af80b54ad7") : secret "cluster-monitoring-operator-tls" not found
May 28 16:01:18.806274 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:18.806229    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:18.806787 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:18.806288    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:18.806787 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:18.806456    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:22.806429146 +0000 UTC m=+81.426491938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : configmap references non-existent config key: service-ca.crt
May 28 16:01:18.806787 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:18.806522    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:01:18.806787 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:18.806590    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:22.806576981 +0000 UTC m=+81.426639755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : secret "router-metrics-certs-default" not found
May 28 16:01:18.907894 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:18.907851    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:18.908075 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:18.907983    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:01:18.908075 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:18.908054    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls podName:110ab087-4c08-4d4c-bbd5-a2af80b54ad7 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:22.90803972 +0000 UTC m=+81.528102495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hvgpp" (UID: "110ab087-4c08-4d4c-bbd5-a2af80b54ad7") : secret "cluster-monitoring-operator-tls" not found
May 28 16:01:21.278221 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:21.278186    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h9dbh_5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce/dns-node-resolver/0.log"
May 28 16:01:21.870123 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:21.870096    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4qg6r_5947a6a7-d0ff-4a55-aae1-458c3de5fbdc/node-ca/0.log"
May 28 16:01:22.835568 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:22.835524    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:22.835950 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:22.835582    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:22.835950 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:22.835689    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:01:22.835950 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:22.835723    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:30.835704089 +0000 UTC m=+89.455766864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : configmap references non-existent config key: service-ca.crt
May 28 16:01:22.835950 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:22.835751    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:30.835742786 +0000 UTC m=+89.455805561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : secret "router-metrics-certs-default" not found
May 28 16:01:22.936866 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:22.936832    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:22.937000 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:22.936980    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:01:22.937058 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:22.937049    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls podName:110ab087-4c08-4d4c-bbd5-a2af80b54ad7 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:30.937035521 +0000 UTC m=+89.557098323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hvgpp" (UID: "110ab087-4c08-4d4c-bbd5-a2af80b54ad7") : secret "cluster-monitoring-operator-tls" not found
May 28 16:01:25.084878 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.084844    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"]
May 28 16:01:25.087316 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.087298    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.091832 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.091808    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 28 16:01:25.091941 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.091808    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 28 16:01:25.091941 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.091853    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 28 16:01:25.092688 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.092665    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nmcb9\""
May 28 16:01:25.093301 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.093274    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 28 16:01:25.104426 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.104403    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"]
May 28 16:01:25.154089 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.154057    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575a9c9c-d387-45cf-97dd-92edc864214e-config\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.154257 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.154105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5lqf\" (UniqueName: \"kubernetes.io/projected/575a9c9c-d387-45cf-97dd-92edc864214e-kube-api-access-c5lqf\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.154257 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.154142    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575a9c9c-d387-45cf-97dd-92edc864214e-serving-cert\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.254969 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.254934    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575a9c9c-d387-45cf-97dd-92edc864214e-serving-cert\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.255140 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.255031    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575a9c9c-d387-45cf-97dd-92edc864214e-config\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.255140 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.255066    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5lqf\" (UniqueName: \"kubernetes.io/projected/575a9c9c-d387-45cf-97dd-92edc864214e-kube-api-access-c5lqf\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.255657 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.255640    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575a9c9c-d387-45cf-97dd-92edc864214e-config\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.257174 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.257157    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575a9c9c-d387-45cf-97dd-92edc864214e-serving-cert\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.266786 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.266762    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5lqf\" (UniqueName: \"kubernetes.io/projected/575a9c9c-d387-45cf-97dd-92edc864214e-kube-api-access-c5lqf\") pod \"service-ca-operator-57b5b68b8-lqvm4\" (UID: \"575a9c9c-d387-45cf-97dd-92edc864214e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.396481 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.396385    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"
May 28 16:01:25.523065 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:25.523039    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4"]
May 28 16:01:25.524727 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:25.524681    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575a9c9c_d387_45cf_97dd_92edc864214e.slice/crio-4412df72fea382610da1f86acb6ace7e258536843bb78708b2a966cceba1fbfe WatchSource:0}: Error finding container 4412df72fea382610da1f86acb6ace7e258536843bb78708b2a966cceba1fbfe: Status 404 returned error can't find the container with id 4412df72fea382610da1f86acb6ace7e258536843bb78708b2a966cceba1fbfe
May 28 16:01:26.247821 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:26.247787    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4" event={"ID":"575a9c9c-d387-45cf-97dd-92edc864214e","Type":"ContainerStarted","Data":"4412df72fea382610da1f86acb6ace7e258536843bb78708b2a966cceba1fbfe"}
May 28 16:01:27.007876 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.007843    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"]
May 28 16:01:27.009823 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.009808    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"
May 28 16:01:27.012919 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.012893    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 16:01:27.013839 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.013824    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-87n5b\""
May 28 16:01:27.013911 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.013826    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 16:01:27.027654 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.027623    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"]
May 28 16:01:27.070115 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.070083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5qdn\" (UniqueName: \"kubernetes.io/projected/ff9d2ef8-c6d4-451c-95fc-0158c8200e13-kube-api-access-c5qdn\") pod \"migrator-b985f5d89-j2zhl\" (UID: \"ff9d2ef8-c6d4-451c-95fc-0158c8200e13\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"
May 28 16:01:27.170928 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.170879    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5qdn\" (UniqueName: \"kubernetes.io/projected/ff9d2ef8-c6d4-451c-95fc-0158c8200e13-kube-api-access-c5qdn\") pod \"migrator-b985f5d89-j2zhl\" (UID: \"ff9d2ef8-c6d4-451c-95fc-0158c8200e13\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"
May 28 16:01:27.179949 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.179925    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5qdn\" (UniqueName: \"kubernetes.io/projected/ff9d2ef8-c6d4-451c-95fc-0158c8200e13-kube-api-access-c5qdn\") pod \"migrator-b985f5d89-j2zhl\" (UID: \"ff9d2ef8-c6d4-451c-95fc-0158c8200e13\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"
May 28 16:01:27.318245 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.318161    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"
May 28 16:01:27.711227 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:27.711169    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl"]
May 28 16:01:27.714820 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:27.714786    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9d2ef8_c6d4_451c_95fc_0158c8200e13.slice/crio-aa49ec262d64af32bf7d4cb9a94a096d3f1d86a40a1f6a11e762c3ba2d2e5572 WatchSource:0}: Error finding container aa49ec262d64af32bf7d4cb9a94a096d3f1d86a40a1f6a11e762c3ba2d2e5572: Status 404 returned error can't find the container with id aa49ec262d64af32bf7d4cb9a94a096d3f1d86a40a1f6a11e762c3ba2d2e5572
May 28 16:01:28.252980 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:28.252931    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4" event={"ID":"575a9c9c-d387-45cf-97dd-92edc864214e","Type":"ContainerStarted","Data":"1596f566a1de7a3c086f3ce1b7ae145fe0ded93c3aa07716010ebaea380f8cda"}
May 28 16:01:28.254683 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:28.254645    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl" event={"ID":"ff9d2ef8-c6d4-451c-95fc-0158c8200e13","Type":"ContainerStarted","Data":"aa49ec262d64af32bf7d4cb9a94a096d3f1d86a40a1f6a11e762c3ba2d2e5572"}
May 28 16:01:28.272127 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:28.272069    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4" podStartSLOduration=1.179189907 podStartE2EDuration="3.272055034s" podCreationTimestamp="2026-05-28 16:01:25 +0000 UTC" firstStartedPulling="2026-05-28 16:01:25.526630498 +0000 UTC m=+84.146693278" lastFinishedPulling="2026-05-28 16:01:27.61949563 +0000 UTC m=+86.239558405" observedRunningTime="2026-05-28 16:01:28.271598906 +0000 UTC m=+86.891661703" watchObservedRunningTime="2026-05-28 16:01:28.272055034 +0000 UTC m=+86.892117825"
May 28 16:01:29.258140 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:29.258110    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl" event={"ID":"ff9d2ef8-c6d4-451c-95fc-0158c8200e13","Type":"ContainerStarted","Data":"30c95819281b297a051b689f2c2bb4950ed74afee54a546aac3ed2267052b6b2"}
May 28 16:01:29.258585 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:29.258147    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl" event={"ID":"ff9d2ef8-c6d4-451c-95fc-0158c8200e13","Type":"ContainerStarted","Data":"4c46b11b4967021029a01a8c08f3ac2eeab408ab2d7db4be072258f135fc923c"}
May 28 16:01:29.278610 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:29.278554    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-j2zhl" podStartSLOduration=2.028850821 podStartE2EDuration="3.278540029s" podCreationTimestamp="2026-05-28 16:01:26 +0000 UTC" firstStartedPulling="2026-05-28 16:01:27.718204763 +0000 UTC m=+86.338267559" lastFinishedPulling="2026-05-28 16:01:28.967893989 +0000 UTC m=+87.587956767" observedRunningTime="2026-05-28 16:01:29.278235979 +0000 UTC m=+87.898298777" watchObservedRunningTime="2026-05-28 16:01:29.278540029 +0000 UTC m=+87.898602826"
May 28 16:01:30.715118 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.715083    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ghwff"]
May 28 16:01:30.717756 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.717739    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.720480 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.720455    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 16:01:30.721531 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.721509    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 16:01:30.721641 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.721549    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7jrjx\""
May 28 16:01:30.721641 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.721596    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 16:01:30.721641 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.721612    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 16:01:30.729726 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.729703    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ghwff"]
May 28 16:01:30.799599 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.799559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-signing-cabundle\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.799775 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.799612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxp5x\" (UniqueName: \"kubernetes.io/projected/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-kube-api-access-rxp5x\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.799775 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.799682    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-signing-key\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.900453 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.900408    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-signing-cabundle\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.900622 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.900465    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:30.900622 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:30.900582    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:46.900564937 +0000 UTC m=+105.520627713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : configmap references non-existent config key: service-ca.crt
May 28 16:01:30.900622 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.900599    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxp5x\" (UniqueName: \"kubernetes.io/projected/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-kube-api-access-rxp5x\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.900735 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.900645    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:30.900735 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.900685    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-signing-key\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.900831 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:30.900808    2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:01:30.900881 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:30.900870    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs podName:d94218ef-2ca8-463d-94ff-4019d77e3273 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:46.900855971 +0000 UTC m=+105.520918751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs") pod "router-default-646659fbd6-gztfn" (UID: "d94218ef-2ca8-463d-94ff-4019d77e3273") : secret "router-metrics-certs-default" not found
May 28 16:01:30.901079 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.901057    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-signing-cabundle\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.903115 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.903095    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-signing-key\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:30.909495 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:30.909466    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxp5x\" (UniqueName: \"kubernetes.io/projected/cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b-kube-api-access-rxp5x\") pod \"service-ca-67d667c7d-ghwff\" (UID: \"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b\") " pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:31.002008 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:31.001911    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:31.002153 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:31.002076    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:01:31.002153 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:01:31.002149    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls podName:110ab087-4c08-4d4c-bbd5-a2af80b54ad7 nodeName:}" failed. No retries permitted until 2026-05-28 16:01:47.002132511 +0000 UTC m=+105.622195290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hvgpp" (UID: "110ab087-4c08-4d4c-bbd5-a2af80b54ad7") : secret "cluster-monitoring-operator-tls" not found
May 28 16:01:31.026575 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:31.026540    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-ghwff"
May 28 16:01:31.146059 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:31.146029    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-ghwff"]
May 28 16:01:31.150137 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:31.150100    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe3ad3f_ffcf_403b_99bb_67af7b03bb6b.slice/crio-561e4de79b03ab71fa777b806c668716658169debb66566e6e02a36913735198 WatchSource:0}: Error finding container 561e4de79b03ab71fa777b806c668716658169debb66566e6e02a36913735198: Status 404 returned error can't find the container with id 561e4de79b03ab71fa777b806c668716658169debb66566e6e02a36913735198
May 28 16:01:31.263439 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:31.263404    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ghwff" event={"ID":"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b","Type":"ContainerStarted","Data":"60b791a5b4ece0da83264c61be2061292e9edbb4f56dff04684aad8a6ac61eec"}
May 28 16:01:31.263439 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:31.263442    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-ghwff" event={"ID":"cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b","Type":"ContainerStarted","Data":"561e4de79b03ab71fa777b806c668716658169debb66566e6e02a36913735198"}
May 28 16:01:39.164198 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.164153    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:01:39.166632 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.166593    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/df192315-bb48-45c5-b0e5-65126b2e140a-metrics-tls\") pod \"dns-default-ffj8h\" (UID: \"df192315-bb48-45c5-b0e5-65126b2e140a\") " pod="openshift-dns/dns-default-ffj8h"
May 28 16:01:39.229897 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.229862    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ptwfd\""
May 28 16:01:39.238204 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.238179    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ffj8h"
May 28 16:01:39.265610 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.265572    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:01:39.267978 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.267959    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c07099c-979a-4281-b39e-ce93481a20dd-cert\") pod \"ingress-canary-fmtj4\" (UID: \"8c07099c-979a-4281-b39e-ce93481a20dd\") " pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:01:39.364102 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.364048    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-ghwff" podStartSLOduration=9.364029617 podStartE2EDuration="9.364029617s" podCreationTimestamp="2026-05-28 16:01:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:01:31.292432263 +0000 UTC m=+89.912495063" watchObservedRunningTime="2026-05-28 16:01:39.364029617 +0000 UTC m=+97.984092415"
May 28 16:01:39.364848 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.364824    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ffj8h"]
May 28 16:01:39.369319 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:39.369291    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf192315_bb48_45c5_b0e5_65126b2e140a.slice/crio-784a0aa1baf941d6b0172cece044a9c938bafe13a796b703cc9b2a1e188f560e WatchSource:0}: Error finding container 784a0aa1baf941d6b0172cece044a9c938bafe13a796b703cc9b2a1e188f560e: Status 404 returned error can't find the container with id 784a0aa1baf941d6b0172cece044a9c938bafe13a796b703cc9b2a1e188f560e
May 28 16:01:39.549845 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.549815    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9w77f\""
May 28 16:01:39.558189 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.558164    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmtj4"
May 28 16:01:39.676602 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:39.676569    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmtj4"]
May 28 16:01:39.679632 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:39.679591    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c07099c_979a_4281_b39e_ce93481a20dd.slice/crio-f743bc240ac1c5902882b0ad3f5b973af78076858bc9603f32c90edf5c4c25d1 WatchSource:0}: Error finding container f743bc240ac1c5902882b0ad3f5b973af78076858bc9603f32c90edf5c4c25d1: Status 404 returned error can't find the container with id f743bc240ac1c5902882b0ad3f5b973af78076858bc9603f32c90edf5c4c25d1
May 28 16:01:40.282868 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:40.282830    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmtj4" event={"ID":"8c07099c-979a-4281-b39e-ce93481a20dd","Type":"ContainerStarted","Data":"f743bc240ac1c5902882b0ad3f5b973af78076858bc9603f32c90edf5c4c25d1"}
May 28 16:01:40.283969 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:40.283941    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ffj8h" event={"ID":"df192315-bb48-45c5-b0e5-65126b2e140a","Type":"ContainerStarted","Data":"784a0aa1baf941d6b0172cece044a9c938bafe13a796b703cc9b2a1e188f560e"}
May 28 16:01:41.288870 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:41.288830    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ffj8h" event={"ID":"df192315-bb48-45c5-b0e5-65126b2e140a","Type":"ContainerStarted","Data":"ed5900fd85adabb700d69e2a35a9605442dc0ce1c0a9a32edfbd721138e07b0a"}
May 28 16:01:42.292300 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:42.292263    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmtj4" event={"ID":"8c07099c-979a-4281-b39e-ce93481a20dd","Type":"ContainerStarted","Data":"1cfe7b4ce3340deb6a20af53680cd3616d2e88c6283de13acedce8ab8e7fe67f"}
May 28 16:01:42.293777 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:42.293757    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ffj8h" event={"ID":"df192315-bb48-45c5-b0e5-65126b2e140a","Type":"ContainerStarted","Data":"7090b24b1cc8e3409f577941b7ca322650436da64aa1e61f3c83b00eaff12b5f"}
May 28 16:01:42.293911 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:42.293893    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ffj8h"
May 28 16:01:42.308408 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:42.308342    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fmtj4" podStartSLOduration=65.332774047 podStartE2EDuration="1m7.308327515s" podCreationTimestamp="2026-05-28 16:00:35 +0000 UTC" firstStartedPulling="2026-05-28 16:01:39.681486543 +0000 UTC m=+98.301549318" lastFinishedPulling="2026-05-28 16:01:41.657040007 +0000 UTC m=+100.277102786" observedRunningTime="2026-05-28 16:01:42.307335134 +0000 UTC m=+100.927397932" watchObservedRunningTime="2026-05-28 16:01:42.308327515 +0000 UTC m=+100.928390311"
May 28 16:01:42.323932 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:42.323880    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-ffj8h" podStartSLOduration=65.619572007 podStartE2EDuration="1m7.323865252s" podCreationTimestamp="2026-05-28 16:00:35 +0000 UTC" firstStartedPulling="2026-05-28 16:01:39.371144381 +0000 UTC m=+97.991207156" lastFinishedPulling="2026-05-28 16:01:41.075437612 +0000 UTC m=+99.695500401" observedRunningTime="2026-05-28 16:01:42.323301074 +0000 UTC m=+100.943363871" watchObservedRunningTime="2026-05-28 16:01:42.323865252 +0000 UTC m=+100.943928048"
May 28 16:01:43.224403 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:43.224372    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zx25w"
May 28 16:01:46.924796 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:46.924758    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:46.925211 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:46.924900    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:46.925415 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:46.925398    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d94218ef-2ca8-463d-94ff-4019d77e3273-service-ca-bundle\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:46.927110 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:46.927087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d94218ef-2ca8-463d-94ff-4019d77e3273-metrics-certs\") pod \"router-default-646659fbd6-gztfn\" (UID: \"d94218ef-2ca8-463d-94ff-4019d77e3273\") " pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:47.025181 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.025134    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:47.027666 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.027633    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/110ab087-4c08-4d4c-bbd5-a2af80b54ad7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hvgpp\" (UID: \"110ab087-4c08-4d4c-bbd5-a2af80b54ad7\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:47.112780 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.112733    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:47.240736 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.240702    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-646659fbd6-gztfn"]
May 28 16:01:47.244493 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:47.244467    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94218ef_2ca8_463d_94ff_4019d77e3273.slice/crio-fe9a4c5e89fba469802765d6966edb4a4b590f0877ceebfd83e6ae8819e19423 WatchSource:0}: Error finding container fe9a4c5e89fba469802765d6966edb4a4b590f0877ceebfd83e6ae8819e19423: Status 404 returned error can't find the container with id fe9a4c5e89fba469802765d6966edb4a4b590f0877ceebfd83e6ae8819e19423
May 28 16:01:47.306931 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.306897    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-646659fbd6-gztfn" event={"ID":"d94218ef-2ca8-463d-94ff-4019d77e3273","Type":"ContainerStarted","Data":"3617f48cb324a8f42ef62dffa4e06b96883e5857b53937a4a2c79c4b64581f15"}
May 28 16:01:47.306931 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.306933    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-646659fbd6-gztfn" event={"ID":"d94218ef-2ca8-463d-94ff-4019d77e3273","Type":"ContainerStarted","Data":"fe9a4c5e89fba469802765d6966edb4a4b590f0877ceebfd83e6ae8819e19423"}
May 28 16:01:47.311367 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.311326    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"
May 28 16:01:47.326902 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.326760    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-646659fbd6-gztfn" podStartSLOduration=33.326740668 podStartE2EDuration="33.326740668s" podCreationTimestamp="2026-05-28 16:01:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:01:47.326519411 +0000 UTC m=+105.946582210" watchObservedRunningTime="2026-05-28 16:01:47.326740668 +0000 UTC m=+105.946803468"
May 28 16:01:47.439295 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:47.439218    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp"]
May 28 16:01:47.441893 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:47.441865    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod110ab087_4c08_4d4c_bbd5_a2af80b54ad7.slice/crio-716659137d8b5d461bc2cbb0fe3b205f592a0a0303379c885a7a6bc91358f173 WatchSource:0}: Error finding container 716659137d8b5d461bc2cbb0fe3b205f592a0a0303379c885a7a6bc91358f173: Status 404 returned error can't find the container with id 716659137d8b5d461bc2cbb0fe3b205f592a0a0303379c885a7a6bc91358f173
May 28 16:01:48.113362 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:48.113323    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:48.115925 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:48.115899    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:48.311269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:48.311226    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp" event={"ID":"110ab087-4c08-4d4c-bbd5-a2af80b54ad7","Type":"ContainerStarted","Data":"716659137d8b5d461bc2cbb0fe3b205f592a0a0303379c885a7a6bc91358f173"}
May 28 16:01:48.311580 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:48.311565    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:48.312914 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:48.312886    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-646659fbd6-gztfn"
May 28 16:01:49.041920 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.041886    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dkpt5"]
May 28 16:01:49.045661 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.045634    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.050059 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.049862    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 16:01:49.050059 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.049886    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 16:01:49.050259 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.050160    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 16:01:49.050259 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.050186    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4nwdt\""
May 28 16:01:49.050612 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.050585    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 16:01:49.055906 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.055649    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dkpt5"]
May 28 16:01:49.139463 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.139424    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.139922 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.139475    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lk8q\" (UniqueName: \"kubernetes.io/projected/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-kube-api-access-8lk8q\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.139922 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.139568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-data-volume\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.139922 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.139646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-crio-socket\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.139922 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.139709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.240315 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.240272    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.240315 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.240313    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lk8q\" (UniqueName: \"kubernetes.io/projected/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-kube-api-access-8lk8q\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.240563 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.240342    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-data-volume\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.240563 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.240402    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-crio-socket\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.240563 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.240441    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.240563 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.240509    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-crio-socket\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.240816 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.240789    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-data-volume\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.241077 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.241052    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.243263 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.243238    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.251597 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.251571    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lk8q\" (UniqueName: \"kubernetes.io/projected/6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3-kube-api-access-8lk8q\") pod \"insights-runtime-extractor-dkpt5\" (UID: \"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3\") " pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.358683 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.358661    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dkpt5"
May 28 16:01:49.491226 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.491060    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dkpt5"]
May 28 16:01:49.496364 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:49.496305    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acfce26_3d6f_4ac3_9c95_aeb564d3e0b3.slice/crio-607728e6492b986cdfcb34cf8e3f0eacd4120d95ac96a11eb0c5dc1732684f32 WatchSource:0}: Error finding container 607728e6492b986cdfcb34cf8e3f0eacd4120d95ac96a11eb0c5dc1732684f32: Status 404 returned error can't find the container with id 607728e6492b986cdfcb34cf8e3f0eacd4120d95ac96a11eb0c5dc1732684f32
May 28 16:01:49.870655 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.867000    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"]
May 28 16:01:49.872106 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.872077    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"
May 28 16:01:49.875150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.875125    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 16:01:49.875406 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.875390    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tkq86\""
May 28 16:01:49.880204 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.880185    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"]
May 28 16:01:49.947306 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:49.947255    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0f8d506a-4ad8-4746-b36f-4e02156f2cda-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4458f\" (UID: \"0f8d506a-4ad8-4746-b36f-4e02156f2cda\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"
May 28 16:01:50.047699 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.047665    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0f8d506a-4ad8-4746-b36f-4e02156f2cda-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4458f\" (UID: \"0f8d506a-4ad8-4746-b36f-4e02156f2cda\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"
May 28 16:01:50.051140 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.051104    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0f8d506a-4ad8-4746-b36f-4e02156f2cda-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4458f\" (UID: \"0f8d506a-4ad8-4746-b36f-4e02156f2cda\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"
May 28 16:01:50.181616 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.181536    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"
May 28 16:01:50.316576 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.316548    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"]
May 28 16:01:50.318598 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.318571    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkpt5" event={"ID":"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3","Type":"ContainerStarted","Data":"5d2d346c81c5b4ee58d8804f71db79d11467900fa31e21399c909157c5ec7ca4"}
May 28 16:01:50.318705 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.318607    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkpt5" event={"ID":"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3","Type":"ContainerStarted","Data":"13fcc839ae104f9c2f4d689642d46125806267a747e269edf0695ec33c35f0cf"}
May 28 16:01:50.318705 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.318624    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkpt5" event={"ID":"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3","Type":"ContainerStarted","Data":"607728e6492b986cdfcb34cf8e3f0eacd4120d95ac96a11eb0c5dc1732684f32"}
May 28 16:01:50.319777 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:50.319750    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8d506a_4ad8_4746_b36f_4e02156f2cda.slice/crio-ea9e8684a552162ef08fec19f63bf02b74496512df5479b50cb2a9a4ba875b82 WatchSource:0}: Error finding container ea9e8684a552162ef08fec19f63bf02b74496512df5479b50cb2a9a4ba875b82: Status 404 returned error can't find the container with id ea9e8684a552162ef08fec19f63bf02b74496512df5479b50cb2a9a4ba875b82
May 28 16:01:50.319917 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.319893    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp" event={"ID":"110ab087-4c08-4d4c-bbd5-a2af80b54ad7","Type":"ContainerStarted","Data":"3e95cdfc4dd6a948ffa1046a1e3059ddbdd9039bab23ae33a4fb6273c17c81cc"}
May 28 16:01:50.337299 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:50.337253    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp" podStartSLOduration=33.42925479 podStartE2EDuration="35.337237859s" podCreationTimestamp="2026-05-28 16:01:15 +0000 UTC" firstStartedPulling="2026-05-28 16:01:47.443859208 +0000 UTC m=+106.063921983" lastFinishedPulling="2026-05-28 16:01:49.351842266 +0000 UTC m=+107.971905052" observedRunningTime="2026-05-28 16:01:50.335963342 +0000 UTC m=+108.956026138" watchObservedRunningTime="2026-05-28 16:01:50.337237859 +0000 UTC m=+108.957300656"
May 28 16:01:51.324123 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:51.324080    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f" event={"ID":"0f8d506a-4ad8-4746-b36f-4e02156f2cda","Type":"ContainerStarted","Data":"ea9e8684a552162ef08fec19f63bf02b74496512df5479b50cb2a9a4ba875b82"}
May 28 16:01:52.220747 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.220672    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-d65698885-8qbc7"]
May 28 16:01:52.224584 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.224547    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.228252 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228224    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 16:01:52.228252 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228246    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 16:01:52.228488 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228262    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 16:01:52.228488 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228328    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cxgsq\""
May 28 16:01:52.228488 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228333    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 16:01:52.228488 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228235    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 16:01:52.228683 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228529    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 16:01:52.228855 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.228826    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 16:01:52.236657 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.236636    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d65698885-8qbc7"]
May 28 16:01:52.266727 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.266687    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-oauth-serving-cert\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.266893 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.266746    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksnxl\" (UniqueName: \"kubernetes.io/projected/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-kube-api-access-ksnxl\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.266893 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.266774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-oauth-config\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.266893 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.266788    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-service-ca\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.266893 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.266817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-serving-cert\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.266893 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.266831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-config\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.297940 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.297910    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ffj8h"
May 28 16:01:52.328383 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.328330    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f" event={"ID":"0f8d506a-4ad8-4746-b36f-4e02156f2cda","Type":"ContainerStarted","Data":"6af6d8ea1cb83bdfad93a60fe7b3840c89c80b0ca47c4c2ba3bcf8bc105fcbe9"}
May 28 16:01:52.328838 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.328515    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"
May 28 16:01:52.330483 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.330459    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dkpt5" event={"ID":"6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3","Type":"ContainerStarted","Data":"adaf7620aa34cdc193f2762c51ddb14a3d024dd6aace3a4481af41ef2cf9784f"}
May 28 16:01:52.334654 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.334622    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f"
May 28 16:01:52.345154 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.345109    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4458f" podStartSLOduration=1.7357203650000002 podStartE2EDuration="3.345097632s" podCreationTimestamp="2026-05-28 16:01:49 +0000 UTC" firstStartedPulling="2026-05-28 16:01:50.321608887 +0000 UTC m=+108.941671661" lastFinishedPulling="2026-05-28 16:01:51.930986147 +0000 UTC m=+110.551048928" observedRunningTime="2026-05-28 16:01:52.34504365 +0000 UTC m=+110.965106447" watchObservedRunningTime="2026-05-28 16:01:52.345097632 +0000 UTC m=+110.965160428"
May 28 16:01:52.367197 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.367167    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksnxl\" (UniqueName: \"kubernetes.io/projected/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-kube-api-access-ksnxl\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.367380 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.367205    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-oauth-config\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.367380 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.367223    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-service-ca\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.367380 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.367277    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-serving-cert\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.367380 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.367295    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-config\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.367606 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.367581    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-oauth-serving-cert\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.368028 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.368001    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-service-ca\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.368128 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.368027    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-config\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.368179 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.368149    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-oauth-serving-cert\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.370027 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.370002    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-serving-cert\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.370149 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.370097    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-oauth-config\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.376056 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.376035    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksnxl\" (UniqueName: \"kubernetes.io/projected/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-kube-api-access-ksnxl\") pod \"console-d65698885-8qbc7\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") " pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.382936 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.382894    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dkpt5" podStartSLOduration=1.006940711 podStartE2EDuration="3.382879034s" podCreationTimestamp="2026-05-28 16:01:49 +0000 UTC" firstStartedPulling="2026-05-28 16:01:49.553677632 +0000 UTC m=+108.173740407" lastFinishedPulling="2026-05-28 16:01:51.929615954 +0000 UTC m=+110.549678730" observedRunningTime="2026-05-28 16:01:52.381802056 +0000 UTC m=+111.001864857" watchObservedRunningTime="2026-05-28 16:01:52.382879034 +0000 UTC m=+111.002941830"
May 28 16:01:52.534019 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.533978    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:01:52.677841 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:52.677811    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d65698885-8qbc7"]
May 28 16:01:52.680611 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:01:52.680588    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f41240e_fdd0_47fe_b17b_eb62b2ff8a6c.slice/crio-f52507b0e3d1dfd11b878f33473cb1811a9c54ac48397cb6d6d1f7d0c71540d1 WatchSource:0}: Error finding container f52507b0e3d1dfd11b878f33473cb1811a9c54ac48397cb6d6d1f7d0c71540d1: Status 404 returned error can't find the container with id f52507b0e3d1dfd11b878f33473cb1811a9c54ac48397cb6d6d1f7d0c71540d1
May 28 16:01:53.335001 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:53.334949    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65698885-8qbc7" event={"ID":"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c","Type":"ContainerStarted","Data":"f52507b0e3d1dfd11b878f33473cb1811a9c54ac48397cb6d6d1f7d0c71540d1"}
May 28 16:01:56.344078 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:56.344039    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65698885-8qbc7" event={"ID":"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c","Type":"ContainerStarted","Data":"57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f"}
May 28 16:01:56.364773 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:56.364729    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-d65698885-8qbc7" podStartSLOduration=1.6897205610000001 podStartE2EDuration="4.364716704s" podCreationTimestamp="2026-05-28 16:01:52 +0000 UTC" firstStartedPulling="2026-05-28 16:01:52.682386972 +0000 UTC m=+111.302449747" lastFinishedPulling="2026-05-28 16:01:55.357383115 +0000 UTC m=+113.977445890" observedRunningTime="2026-05-28 16:01:56.364568173 +0000 UTC m=+114.984630974" watchObservedRunningTime="2026-05-28 16:01:56.364716704 +0000 UTC m=+114.984779500"
May 28 16:01:57.347500 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:57.347473    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:01:57.347958 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:57.347511    2569 generic.go:358] "Generic (PLEG): container finished" podID="110ab087-4c08-4d4c-bbd5-a2af80b54ad7" containerID="3e95cdfc4dd6a948ffa1046a1e3059ddbdd9039bab23ae33a4fb6273c17c81cc" exitCode=2
May 28 16:01:57.347958 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:57.347602    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp" event={"ID":"110ab087-4c08-4d4c-bbd5-a2af80b54ad7","Type":"ContainerDied","Data":"3e95cdfc4dd6a948ffa1046a1e3059ddbdd9039bab23ae33a4fb6273c17c81cc"}
May 28 16:01:57.348077 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:57.347979    2569 scope.go:117] "RemoveContainer" containerID="3e95cdfc4dd6a948ffa1046a1e3059ddbdd9039bab23ae33a4fb6273c17c81cc"
May 28 16:01:58.352399 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:58.352364    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:01:58.352865 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:01:58.352424    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hvgpp" event={"ID":"110ab087-4c08-4d4c-bbd5-a2af80b54ad7","Type":"ContainerStarted","Data":"6a5256d25e043d349a4c9e123b6d10dcbf0bd84deffcbeaf537420f7e1190151"}
May 28 16:02:01.020044 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.017919    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"]
May 28 16:02:01.024993 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.024963    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.029336 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.029314    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 16:02:01.029495 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.029372    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 16:02:01.030724 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.030705    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bvqxv\""
May 28 16:02:01.030830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.030748    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 16:02:01.044436 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.044410    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"]
May 28 16:02:01.091599 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.091560    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"]
May 28 16:02:01.095661 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.095637    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.099581 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.099561    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 16:02:01.099925 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.099891    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w5vwv\""
May 28 16:02:01.100038 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.099980    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 16:02:01.100038 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.100017    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 16:02:01.126077 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.126049    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"]
May 28 16:02:01.138166 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.138135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b46a6386-37de-4806-975d-e5e4333f2e99-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.138318 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.138192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wssxc\" (UniqueName: \"kubernetes.io/projected/b46a6386-37de-4806-975d-e5e4333f2e99-kube-api-access-wssxc\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.138318 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.138235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46a6386-37de-4806-975d-e5e4333f2e99-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.138318 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.138282    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46a6386-37de-4806-975d-e5e4333f2e99-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.208515 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.208484    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z49p6"]
May 28 16:02:01.212775 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.212750    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.216168 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.216140    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 16:02:01.216305 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.216141    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 16:02:01.216395 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.216360    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 16:02:01.216607 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.216585    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m8pv6\""
May 28 16:02:01.238907 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.238884    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wssxc\" (UniqueName: \"kubernetes.io/projected/b46a6386-37de-4806-975d-e5e4333f2e99-kube-api-access-wssxc\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.238907 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.238916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.238907 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.238939    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46a6386-37de-4806-975d-e5e4333f2e99-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.239207 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.238957    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46a6386-37de-4806-975d-e5e4333f2e99-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.239207 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.239017    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.239207 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.239067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gggb\" (UniqueName: \"kubernetes.io/projected/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-api-access-7gggb\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.239207 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.239102    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.239207 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.239170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.239207 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.239198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.239510 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.239262    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b46a6386-37de-4806-975d-e5e4333f2e99-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.239719 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.239701    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46a6386-37de-4806-975d-e5e4333f2e99-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.241938 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.241916    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b46a6386-37de-4806-975d-e5e4333f2e99-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.242300 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.242279    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b46a6386-37de-4806-975d-e5e4333f2e99-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.242734 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.242702    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64ccbbd5f-pdhtp"]
May 28 16:02:01.246890 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.246872    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.257568 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.257544    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 16:02:01.261445 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.261411    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64ccbbd5f-pdhtp"]
May 28 16:02:01.267159 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.267139    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wssxc\" (UniqueName: \"kubernetes.io/projected/b46a6386-37de-4806-975d-e5e4333f2e99-kube-api-access-wssxc\") pod \"openshift-state-metrics-9c959559f-xsn59\" (UID: \"b46a6386-37de-4806-975d-e5e4333f2e99\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.334984 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.334903    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"
May 28 16:02:01.339899 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.339869    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.340035 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.339917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-oauth-serving-cert\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.340035 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.339966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91e9c563-eaa6-4c13-a14b-5799de06bccd-metrics-client-ca\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340035 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340001    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.340035 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340030    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.340237 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340115    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-service-ca\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.340237 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340237 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-config\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.340237 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340219    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-serving-cert\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340285    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340315    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-oauth-config\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340338    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-trusted-ca-bundle\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340399    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4x25\" (UniqueName: \"kubernetes.io/projected/bd1b8cbc-ed44-41ac-b737-99782bc568c0-kube-api-access-w4x25\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340424    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-textfile\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340480    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9294g\" (UniqueName: \"kubernetes.io/projected/91e9c563-eaa6-4c13-a14b-5799de06bccd-kube-api-access-9294g\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340526 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-root\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340543    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340566    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-sys\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-wtmp\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340629    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gggb\" (UniqueName: \"kubernetes.io/projected/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-api-access-7gggb\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-tls\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.340683    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:02:01.340806    2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 16:02:01.340908 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:02:01.340869    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-tls podName:d3570778-39c2-4ec8-bb70-b37cbe9e0dc4 nodeName:}" failed. No retries permitted until 2026-05-28 16:02:01.840851714 +0000 UTC m=+120.460914495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-5tqgb" (UID: "d3570778-39c2-4ec8-bb70-b37cbe9e0dc4") : secret "kube-state-metrics-tls" not found
May 28 16:02:01.341340 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.341313    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.341464 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.341444    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.343038 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.343015    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.385441 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.385411    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gggb\" (UniqueName: \"kubernetes.io/projected/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-api-access-7gggb\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.441866 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.441835    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-service-ca\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.441866 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.441871    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442088 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.441899    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-config\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442088 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.441925    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-serving-cert\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442088 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.441995    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-oauth-config\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442228 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442112    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-trusted-ca-bundle\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442228 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442158    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4x25\" (UniqueName: \"kubernetes.io/projected/bd1b8cbc-ed44-41ac-b737-99782bc568c0-kube-api-access-w4x25\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442228 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442184    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-textfile\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442228 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442211    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442448 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442248    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9294g\" (UniqueName: \"kubernetes.io/projected/91e9c563-eaa6-4c13-a14b-5799de06bccd-kube-api-access-9294g\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442448 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442282    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-root\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442448 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442311    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-sys\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442448 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442334    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-wtmp\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442448 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442389    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-tls\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442448 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442426    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-oauth-serving-cert\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442750 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442474    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91e9c563-eaa6-4c13-a14b-5799de06bccd-metrics-client-ca\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442750 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442614    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-textfile\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442750 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442631    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-config\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442750 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442631    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-service-ca\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.442750 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442707    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-sys\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.442750 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442755    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-root\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.443031 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.442970    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-wtmp\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.443095 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.443083    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91e9c563-eaa6-4c13-a14b-5799de06bccd-metrics-client-ca\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.443529 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.443500    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-accelerators-collector-config\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.443655 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.443508    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-trusted-ca-bundle\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.443720 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.443658    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-oauth-serving-cert\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.444860 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.444834    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-serving-cert\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.445409 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.445390    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-tls\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.445520 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.445470    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-oauth-config\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.445717 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.445698    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91e9c563-eaa6-4c13-a14b-5799de06bccd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.453725 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.453701    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4x25\" (UniqueName: \"kubernetes.io/projected/bd1b8cbc-ed44-41ac-b737-99782bc568c0-kube-api-access-w4x25\") pod \"console-64ccbbd5f-pdhtp\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") " pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.453929 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.453909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9294g\" (UniqueName: \"kubernetes.io/projected/91e9c563-eaa6-4c13-a14b-5799de06bccd-kube-api-access-9294g\") pod \"node-exporter-z49p6\" (UID: \"91e9c563-eaa6-4c13-a14b-5799de06bccd\") " pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.480481 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.480455    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-xsn59"]
May 28 16:02:01.482781 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:01.482758    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46a6386_37de_4806_975d_e5e4333f2e99.slice/crio-2324b30cd14be6310ae160fcf6b1416c0a320227f8ca8b48f14e1568df6f5e02 WatchSource:0}: Error finding container 2324b30cd14be6310ae160fcf6b1416c0a320227f8ca8b48f14e1568df6f5e02: Status 404 returned error can't find the container with id 2324b30cd14be6310ae160fcf6b1416c0a320227f8ca8b48f14e1568df6f5e02
May 28 16:02:01.524046 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.524024    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z49p6"
May 28 16:02:01.531930 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:01.531900    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e9c563_eaa6_4c13_a14b_5799de06bccd.slice/crio-c44373b302f145ff9562661a719ea9644a2b1ca5d26f6ae46b5d225e6ea43b76 WatchSource:0}: Error finding container c44373b302f145ff9562661a719ea9644a2b1ca5d26f6ae46b5d225e6ea43b76: Status 404 returned error can't find the container with id c44373b302f145ff9562661a719ea9644a2b1ca5d26f6ae46b5d225e6ea43b76
May 28 16:02:01.561424 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.561396    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:01.711050 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.711019    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64ccbbd5f-pdhtp"]
May 28 16:02:01.715066 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:01.715024    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1b8cbc_ed44_41ac_b737_99782bc568c0.slice/crio-20cf82d429e5affe9b01ebf27386cba165acccda40756c2ea7bc058e1dd15354 WatchSource:0}: Error finding container 20cf82d429e5affe9b01ebf27386cba165acccda40756c2ea7bc058e1dd15354: Status 404 returned error can't find the container with id 20cf82d429e5affe9b01ebf27386cba165acccda40756c2ea7bc058e1dd15354
May 28 16:02:01.845769 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.845738    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:01.848189 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:01.848141    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3570778-39c2-4ec8-bb70-b37cbe9e0dc4-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-5tqgb\" (UID: \"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:02.008654 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.008621    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w5vwv\""
May 28 16:02:02.015365 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.015309    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"
May 28 16:02:02.192678 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.192515    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb"]
May 28 16:02:02.197364 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:02.197322    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3570778_39c2_4ec8_bb70_b37cbe9e0dc4.slice/crio-81d9abb7faac2bd98f53b6ccf9aaf1e9b659ae4f7e2b735bbec10d230fa0b2c1 WatchSource:0}: Error finding container 81d9abb7faac2bd98f53b6ccf9aaf1e9b659ae4f7e2b735bbec10d230fa0b2c1: Status 404 returned error can't find the container with id 81d9abb7faac2bd98f53b6ccf9aaf1e9b659ae4f7e2b735bbec10d230fa0b2c1
May 28 16:02:02.366272 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.366232    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59" event={"ID":"b46a6386-37de-4806-975d-e5e4333f2e99","Type":"ContainerStarted","Data":"9a25a2906e284b731956fc7f1885334a88c41b1bb9e1a56c40fd9580de72c952"}
May 28 16:02:02.366490 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.366279    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59" event={"ID":"b46a6386-37de-4806-975d-e5e4333f2e99","Type":"ContainerStarted","Data":"f4d906d0e852f8120ad438c50ebedc98235f10204882d0a62fa09a4ab7ddbb40"}
May 28 16:02:02.366490 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.366294    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59" event={"ID":"b46a6386-37de-4806-975d-e5e4333f2e99","Type":"ContainerStarted","Data":"2324b30cd14be6310ae160fcf6b1416c0a320227f8ca8b48f14e1568df6f5e02"}
May 28 16:02:02.367321 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.367296    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb" event={"ID":"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4","Type":"ContainerStarted","Data":"81d9abb7faac2bd98f53b6ccf9aaf1e9b659ae4f7e2b735bbec10d230fa0b2c1"}
May 28 16:02:02.368727 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.368704    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64ccbbd5f-pdhtp" event={"ID":"bd1b8cbc-ed44-41ac-b737-99782bc568c0","Type":"ContainerStarted","Data":"5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262"}
May 28 16:02:02.368831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.368733    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64ccbbd5f-pdhtp" event={"ID":"bd1b8cbc-ed44-41ac-b737-99782bc568c0","Type":"ContainerStarted","Data":"20cf82d429e5affe9b01ebf27386cba165acccda40756c2ea7bc058e1dd15354"}
May 28 16:02:02.370065 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.370037    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z49p6" event={"ID":"91e9c563-eaa6-4c13-a14b-5799de06bccd","Type":"ContainerStarted","Data":"c44373b302f145ff9562661a719ea9644a2b1ca5d26f6ae46b5d225e6ea43b76"}
May 28 16:02:02.395568 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.395511    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64ccbbd5f-pdhtp" podStartSLOduration=1.3954915909999999 podStartE2EDuration="1.395491591s" podCreationTimestamp="2026-05-28 16:02:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:02:02.394598869 +0000 UTC m=+121.014661667" watchObservedRunningTime="2026-05-28 16:02:02.395491591 +0000 UTC m=+121.015554388"
May 28 16:02:02.534502 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.534465    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:02:02.534705 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.534516    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:02:02.540078 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:02.540052    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:02:03.272499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.272470    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-594884f89d-9gcfb"]
May 28 16:02:03.274831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.274814    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.279939 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.279631    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5mjgd4ajurtnn\""
May 28 16:02:03.279939 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.279719    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8hwwq\""
May 28 16:02:03.279939 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.279761    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 16:02:03.280164 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.279959    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 16:02:03.280164 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.280042    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 16:02:03.280854 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.280814    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 16:02:03.281075 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.281062    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 16:02:03.315382 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.315336    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-594884f89d-9gcfb"]
May 28 16:02:03.357339 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357298    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.357514 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.357514 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/238569eb-ded3-4e16-8f17-7c176a4fd24f-metrics-client-ca\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.357514 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v7p5\" (UniqueName: \"kubernetes.io/projected/238569eb-ded3-4e16-8f17-7c176a4fd24f-kube-api-access-6v7p5\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.357514 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-tls\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.357748 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.357748 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.357748 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.357665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-grpc-tls\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.375126 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.375089    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59" event={"ID":"b46a6386-37de-4806-975d-e5e4333f2e99","Type":"ContainerStarted","Data":"a751068a749adb898d6538f444c2faa45b804b0137e88ba0964d7edbb09e8ee0"}
May 28 16:02:03.376687 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.376657    2569 generic.go:358] "Generic (PLEG): container finished" podID="91e9c563-eaa6-4c13-a14b-5799de06bccd" containerID="008123d7ef34851c2038008fbfca81143bc3b683c5fbca93d255f85a29b58eda" exitCode=0
May 28 16:02:03.376831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.376748    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z49p6" event={"ID":"91e9c563-eaa6-4c13-a14b-5799de06bccd","Type":"ContainerDied","Data":"008123d7ef34851c2038008fbfca81143bc3b683c5fbca93d255f85a29b58eda"}
May 28 16:02:03.381390 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.381371    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:02:03.409578 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.409531    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-xsn59" podStartSLOduration=2.162226324 podStartE2EDuration="3.409516352s" podCreationTimestamp="2026-05-28 16:02:00 +0000 UTC" firstStartedPulling="2026-05-28 16:02:01.608153495 +0000 UTC m=+120.228216270" lastFinishedPulling="2026-05-28 16:02:02.855443523 +0000 UTC m=+121.475506298" observedRunningTime="2026-05-28 16:02:03.407060309 +0000 UTC m=+122.027123106" watchObservedRunningTime="2026-05-28 16:02:03.409516352 +0000 UTC m=+122.029579194"
May 28 16:02:03.459056 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.459026    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/238569eb-ded3-4e16-8f17-7c176a4fd24f-metrics-client-ca\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.459192 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.459172    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v7p5\" (UniqueName: \"kubernetes.io/projected/238569eb-ded3-4e16-8f17-7c176a4fd24f-kube-api-access-6v7p5\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.459259 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.459219    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-tls\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.459317 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.459263    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.460301 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.459812    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/238569eb-ded3-4e16-8f17-7c176a4fd24f-metrics-client-ca\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.460456 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.460324    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.460456 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.460401    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-grpc-tls\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.460581 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.460552    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.460641 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.460592    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.465221 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.465187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.465372 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.465332    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-tls\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.466045 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.465796    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.466150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.466097    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.466424 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.466405    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-grpc-tls\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.466869 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.466849    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/238569eb-ded3-4e16-8f17-7c176a4fd24f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.472588 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.472386    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v7p5\" (UniqueName: \"kubernetes.io/projected/238569eb-ded3-4e16-8f17-7c176a4fd24f-kube-api-access-6v7p5\") pod \"thanos-querier-594884f89d-9gcfb\" (UID: \"238569eb-ded3-4e16-8f17-7c176a4fd24f\") " pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:03.586540 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:03.586500    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:04.033480 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.033447    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-594884f89d-9gcfb"]
May 28 16:02:04.037635 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:04.037593    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238569eb_ded3_4e16_8f17_7c176a4fd24f.slice/crio-1f9644d39d9e0f271765bee098614df2d8c796faa551c66167345e5c30e0af9c WatchSource:0}: Error finding container 1f9644d39d9e0f271765bee098614df2d8c796faa551c66167345e5c30e0af9c: Status 404 returned error can't find the container with id 1f9644d39d9e0f271765bee098614df2d8c796faa551c66167345e5c30e0af9c
May 28 16:02:04.384626 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.384586    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" event={"ID":"238569eb-ded3-4e16-8f17-7c176a4fd24f","Type":"ContainerStarted","Data":"1f9644d39d9e0f271765bee098614df2d8c796faa551c66167345e5c30e0af9c"}
May 28 16:02:04.386938 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.386902    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb" event={"ID":"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4","Type":"ContainerStarted","Data":"d1bad03ef8c11c9f1bdc32685fe4578fa7d78591fb72294f5d0df16e807c3641"}
May 28 16:02:04.387101 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.386947    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb" event={"ID":"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4","Type":"ContainerStarted","Data":"5a316f18b8e2a8a9d5de5e4761575227cfd21e7fca243e547d14f0bab53cfb13"}
May 28 16:02:04.387101 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.386962    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb" event={"ID":"d3570778-39c2-4ec8-bb70-b37cbe9e0dc4","Type":"ContainerStarted","Data":"9fb3615d90b338801a52ce27b4a3a22365e18c57aef50581a45546570f4b599b"}
May 28 16:02:04.389976 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.389921    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z49p6" event={"ID":"91e9c563-eaa6-4c13-a14b-5799de06bccd","Type":"ContainerStarted","Data":"fc8e7c206865fa904d20360b03efa3085fe64a1ec169b68b046f0648b7ea303d"}
May 28 16:02:04.389976 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.389956    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z49p6" event={"ID":"91e9c563-eaa6-4c13-a14b-5799de06bccd","Type":"ContainerStarted","Data":"8b09c2f2f7910d2e24e28b2d06a8b118a1775c331572cf8e9b7d008f8f651240"}
May 28 16:02:04.427579 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.427519    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5tqgb" podStartSLOduration=1.760237531 podStartE2EDuration="3.427500844s" podCreationTimestamp="2026-05-28 16:02:01 +0000 UTC" firstStartedPulling="2026-05-28 16:02:02.199977258 +0000 UTC m=+120.820040036" lastFinishedPulling="2026-05-28 16:02:03.867240574 +0000 UTC m=+122.487303349" observedRunningTime="2026-05-28 16:02:04.425565072 +0000 UTC m=+123.045627867" watchObservedRunningTime="2026-05-28 16:02:04.427500844 +0000 UTC m=+123.047563643"
May 28 16:02:04.470939 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:04.470889    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z49p6" podStartSLOduration=2.150769065 podStartE2EDuration="3.470876035s" podCreationTimestamp="2026-05-28 16:02:01 +0000 UTC" firstStartedPulling="2026-05-28 16:02:01.533552488 +0000 UTC m=+120.153615264" lastFinishedPulling="2026-05-28 16:02:02.853659458 +0000 UTC m=+121.473722234" observedRunningTime="2026-05-28 16:02:04.469232768 +0000 UTC m=+123.089295588" watchObservedRunningTime="2026-05-28 16:02:04.470876035 +0000 UTC m=+123.090938832"
May 28 16:02:05.618499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.618457    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f79c88cb7-69cqn"]
May 28 16:02:05.623585 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.623553    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.626661 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.626624    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fn8gm\""
May 28 16:02:05.627806 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.627780    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 16:02:05.627974 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.627951    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-n29ob6r09vkn\""
May 28 16:02:05.628028 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.627993    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 16:02:05.628147 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.628125    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 16:02:05.628271 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.628194    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 16:02:05.635758 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.635733    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f79c88cb7-69cqn"]
May 28 16:02:05.681841 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.681793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f268b9-49fd-4699-95dc-ca7ef6bbd049-audit-log\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.682043 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.681855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f268b9-49fd-4699-95dc-ca7ef6bbd049-metrics-server-audit-profiles\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.682043 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.681944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-secret-metrics-server-client-certs\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.682161 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.682071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-client-ca-bundle\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.682206 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.682162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-secret-metrics-server-tls\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.682249 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.682204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjfs\" (UniqueName: \"kubernetes.io/projected/63f268b9-49fd-4699-95dc-ca7ef6bbd049-kube-api-access-tmjfs\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.682249 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.682232    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f268b9-49fd-4699-95dc-ca7ef6bbd049-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.783301 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.783258    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f268b9-49fd-4699-95dc-ca7ef6bbd049-metrics-server-audit-profiles\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.783474 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.783321    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-secret-metrics-server-client-certs\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.783474 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.783387    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-client-ca-bundle\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.783565 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.783479    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-secret-metrics-server-tls\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.783565 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.783512    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjfs\" (UniqueName: \"kubernetes.io/projected/63f268b9-49fd-4699-95dc-ca7ef6bbd049-kube-api-access-tmjfs\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.783565 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.783541    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f268b9-49fd-4699-95dc-ca7ef6bbd049-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.783760 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.783739    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f268b9-49fd-4699-95dc-ca7ef6bbd049-audit-log\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.784169 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.784120    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f268b9-49fd-4699-95dc-ca7ef6bbd049-audit-log\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.784423 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.784375    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f268b9-49fd-4699-95dc-ca7ef6bbd049-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.784583 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.784451    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f268b9-49fd-4699-95dc-ca7ef6bbd049-metrics-server-audit-profiles\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.786607 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.786577    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-secret-metrics-server-client-certs\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.786723 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.786690    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-client-ca-bundle\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.786723 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.786703    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f268b9-49fd-4699-95dc-ca7ef6bbd049-secret-metrics-server-tls\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.803609 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.803583    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjfs\" (UniqueName: \"kubernetes.io/projected/63f268b9-49fd-4699-95dc-ca7ef6bbd049-kube-api-access-tmjfs\") pod \"metrics-server-5f79c88cb7-69cqn\" (UID: \"63f268b9-49fd-4699-95dc-ca7ef6bbd049\") " pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.935910 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.935853    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:05.956976 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.956946    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"]
May 28 16:02:05.961630 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.961608    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"
May 28 16:02:05.965646 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.965416    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 28 16:02:05.966334 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.966316    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-ck6lj\""
May 28 16:02:05.973545 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:05.973517    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"]
May 28 16:02:06.086222 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.086200    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db7a374c-429c-460d-bf74-a95192214731-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8k7sh\" (UID: \"db7a374c-429c-460d-bf74-a95192214731\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"
May 28 16:02:06.093906 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.093874    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f79c88cb7-69cqn"]
May 28 16:02:06.096388 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:06.096362    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f268b9_49fd_4699_95dc_ca7ef6bbd049.slice/crio-81ea5b933774d6de71b98cd5e4265d3a30424180c907e09fc77617bc8eff9c0f WatchSource:0}: Error finding container 81ea5b933774d6de71b98cd5e4265d3a30424180c907e09fc77617bc8eff9c0f: Status 404 returned error can't find the container with id 81ea5b933774d6de71b98cd5e4265d3a30424180c907e09fc77617bc8eff9c0f
May 28 16:02:06.187439 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.187329    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db7a374c-429c-460d-bf74-a95192214731-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8k7sh\" (UID: \"db7a374c-429c-460d-bf74-a95192214731\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"
May 28 16:02:06.189818 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.189793    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db7a374c-429c-460d-bf74-a95192214731-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8k7sh\" (UID: \"db7a374c-429c-460d-bf74-a95192214731\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"
May 28 16:02:06.280990 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.280950    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"
May 28 16:02:06.397836 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.397796    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" event={"ID":"238569eb-ded3-4e16-8f17-7c176a4fd24f","Type":"ContainerStarted","Data":"618d674ecccaba45e58274776d6dfd63d2295520d11548c61b83d0d7e0326b4d"}
May 28 16:02:06.397836 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.397836    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" event={"ID":"238569eb-ded3-4e16-8f17-7c176a4fd24f","Type":"ContainerStarted","Data":"540ec3b465bc7f38801fb928f37cad7005291a47c389e4f5ec5204d96284574f"}
May 28 16:02:06.398051 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.397849    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" event={"ID":"238569eb-ded3-4e16-8f17-7c176a4fd24f","Type":"ContainerStarted","Data":"6a38ec6c206bc430f1e2e2446e5046f470cb0631f8a570ed7b300bd22f69d615"}
May 28 16:02:06.398916 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.398887    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn" event={"ID":"63f268b9-49fd-4699-95dc-ca7ef6bbd049","Type":"ContainerStarted","Data":"81ea5b933774d6de71b98cd5e4265d3a30424180c907e09fc77617bc8eff9c0f"}
May 28 16:02:06.408701 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:06.408674    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"]
May 28 16:02:06.411490 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:06.411460    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7a374c_429c_460d_bf74_a95192214731.slice/crio-47f743ca4b7a90f0fa8a09cd20f1b01ba87ec6adba1460cf1afe61c9f344827f WatchSource:0}: Error finding container 47f743ca4b7a90f0fa8a09cd20f1b01ba87ec6adba1460cf1afe61c9f344827f: Status 404 returned error can't find the container with id 47f743ca4b7a90f0fa8a09cd20f1b01ba87ec6adba1460cf1afe61c9f344827f
May 28 16:02:07.407175 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.407133    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" event={"ID":"238569eb-ded3-4e16-8f17-7c176a4fd24f","Type":"ContainerStarted","Data":"e2d77af6674fcb23fd8888c09f87709d7ad54ae1e1d85ec5870ebe0615284ce5"}
May 28 16:02:07.407676 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.407185    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" event={"ID":"238569eb-ded3-4e16-8f17-7c176a4fd24f","Type":"ContainerStarted","Data":"26d86841f6428127ecb7a48aad214863d8dfe58b2c5f2608537b7750acef16d3"}
May 28 16:02:07.407676 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.407199    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" event={"ID":"238569eb-ded3-4e16-8f17-7c176a4fd24f","Type":"ContainerStarted","Data":"3ab6232fe0ee6ce73dd9aa8091914da272fee57545dad5fcd129853a4c55399c"}
May 28 16:02:07.407676 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.407459    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:07.408589 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.408546    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh" event={"ID":"db7a374c-429c-460d-bf74-a95192214731","Type":"ContainerStarted","Data":"47f743ca4b7a90f0fa8a09cd20f1b01ba87ec6adba1460cf1afe61c9f344827f"}
May 28 16:02:07.439888 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.439638    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb" podStartSLOduration=1.683205997 podStartE2EDuration="4.439617714s" podCreationTimestamp="2026-05-28 16:02:03 +0000 UTC" firstStartedPulling="2026-05-28 16:02:04.040568296 +0000 UTC m=+122.660631086" lastFinishedPulling="2026-05-28 16:02:06.796980014 +0000 UTC m=+125.417042803" observedRunningTime="2026-05-28 16:02:07.439558515 +0000 UTC m=+126.059621315" watchObservedRunningTime="2026-05-28 16:02:07.439617714 +0000 UTC m=+126.059680515"
May 28 16:02:07.641286 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.641249    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:02:07.645886 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.645858    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.649192 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.649163    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 16:02:07.649321 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.649247    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 16:02:07.649843 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.649820    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 16:02:07.649960 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.649886    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 16:02:07.649960 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.649926    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 16:02:07.650071 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.650027    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 16:02:07.650179 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.650157    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 16:02:07.650361 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.650325    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2h0rq4rnehq59\""
May 28 16:02:07.650424 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.650409    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 16:02:07.650572 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.650560    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 16:02:07.650753 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.650729    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wskxv\""
May 28 16:02:07.650817 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.650779    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 16:02:07.652174 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.652158    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 16:02:07.656532 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.656501    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 16:02:07.668382 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.668277    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:02:07.803232 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803200    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803232 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803243    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803469 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803265    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803469 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803469 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803377    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803469 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803424    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803615 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-config\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803615 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gm2j\" (UniqueName: \"kubernetes.io/projected/b3e5ad29-70a6-4411-90e1-90c4b9b748af-kube-api-access-8gm2j\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803615 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803615 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3e5ad29-70a6-4411-90e1-90c4b9b748af-config-out\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803615 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803815 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803675    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3e5ad29-70a6-4411-90e1-90c4b9b748af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803815 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803704    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803815 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803815 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803815 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803976 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.803976 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.803893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-web-config\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.904605 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904559    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.904802 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904612    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.904802 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904639    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.904802 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904674    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.904802 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904702    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-web-config\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905032 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904853    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905032 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904906    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905032 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904941    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905032 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.904970    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905032 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905010    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905266 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905039    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905266 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905091    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-config\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905266 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905120    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gm2j\" (UniqueName: \"kubernetes.io/projected/b3e5ad29-70a6-4411-90e1-90c4b9b748af-kube-api-access-8gm2j\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905266 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905150    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905266 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905199    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3e5ad29-70a6-4411-90e1-90c4b9b748af-config-out\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905266 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905229    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905594 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905303    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3e5ad29-70a6-4411-90e1-90c4b9b748af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905594 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905328    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.905861 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.905666    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.906944 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.906914    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.907428 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.907405    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.907798 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.907774    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.909241 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.908457    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-web-config\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.909241 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.908502    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.909241 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.908583    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b3e5ad29-70a6-4411-90e1-90c4b9b748af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.909241 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.908955    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.910650 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.910473    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.910755 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.910712    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.911008 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.910979    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3e5ad29-70a6-4411-90e1-90c4b9b748af-config-out\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.911255 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.911231    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.911545 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.911491    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-config\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.911850 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.911823    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.912268 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.912242    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.912417 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.912397    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3e5ad29-70a6-4411-90e1-90c4b9b748af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.912826 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.912794    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b3e5ad29-70a6-4411-90e1-90c4b9b748af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.919443 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.917592    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gm2j\" (UniqueName: \"kubernetes.io/projected/b3e5ad29-70a6-4411-90e1-90c4b9b748af-kube-api-access-8gm2j\") pod \"prometheus-k8s-0\" (UID: \"b3e5ad29-70a6-4411-90e1-90c4b9b748af\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:07.959149 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:07.959111    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:08.218303 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.218208    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64ccbbd5f-pdhtp"]
May 28 16:02:08.256845 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.256808    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fb86b6659-4rxwz"]
May 28 16:02:08.260698 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.260673    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.269781 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.269752    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb86b6659-4rxwz"]
May 28 16:02:08.410131 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.410099    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-serving-cert\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.410551 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.410215    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-oauth-config\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.410551 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.410246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-trusted-ca-bundle\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.410551 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.410293    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4zbb\" (UniqueName: \"kubernetes.io/projected/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-kube-api-access-f4zbb\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.410551 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.410359    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-service-ca\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.410551 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.410410    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-oauth-serving-cert\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.410551 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.410445    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-config\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.413419 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.413385    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn" event={"ID":"63f268b9-49fd-4699-95dc-ca7ef6bbd049","Type":"ContainerStarted","Data":"a67717f98788904f8d4387686dda77ab419d8c6210db1c9aadf065e85a623d40"}
May 28 16:02:08.414968 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.414942    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh" event={"ID":"db7a374c-429c-460d-bf74-a95192214731","Type":"ContainerStarted","Data":"6d13ee425a6af266a3b4362abe5a1f1cf192d66e2a2b0c08555bf3d26b8b19e8"}
May 28 16:02:08.415247 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.415228    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"
May 28 16:02:08.421191 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.421165    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh"
May 28 16:02:08.431715 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.431669    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn" podStartSLOduration=1.234548422 podStartE2EDuration="3.43165595s" podCreationTimestamp="2026-05-28 16:02:05 +0000 UTC" firstStartedPulling="2026-05-28 16:02:06.0981472 +0000 UTC m=+124.718209988" lastFinishedPulling="2026-05-28 16:02:08.295254737 +0000 UTC m=+126.915317516" observedRunningTime="2026-05-28 16:02:08.430540731 +0000 UTC m=+127.050603524" watchObservedRunningTime="2026-05-28 16:02:08.43165595 +0000 UTC m=+127.051718744"
May 28 16:02:08.437094 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.437074    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:02:08.438659 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:08.438628    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e5ad29_70a6_4411_90e1_90c4b9b748af.slice/crio-c89226b7899e283cddc89a867af6668e3fdd74ae6603983ce1feaf92cd6ff8a9 WatchSource:0}: Error finding container c89226b7899e283cddc89a867af6668e3fdd74ae6603983ce1feaf92cd6ff8a9: Status 404 returned error can't find the container with id c89226b7899e283cddc89a867af6668e3fdd74ae6603983ce1feaf92cd6ff8a9
May 28 16:02:08.449991 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.449950    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8k7sh" podStartSLOduration=1.571117 podStartE2EDuration="3.449937164s" podCreationTimestamp="2026-05-28 16:02:05 +0000 UTC" firstStartedPulling="2026-05-28 16:02:06.413078641 +0000 UTC m=+125.033141415" lastFinishedPulling="2026-05-28 16:02:08.291898786 +0000 UTC m=+126.911961579" observedRunningTime="2026-05-28 16:02:08.449023696 +0000 UTC m=+127.069086494" watchObservedRunningTime="2026-05-28 16:02:08.449937164 +0000 UTC m=+127.069999961"
May 28 16:02:08.511635 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.511606    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-serving-cert\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.511904 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.511884    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-oauth-config\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.511964 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.511926    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-trusted-ca-bundle\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.512109    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4zbb\" (UniqueName: \"kubernetes.io/projected/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-kube-api-access-f4zbb\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.512168    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-service-ca\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.512268    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-oauth-serving-cert\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.512371    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-config\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.513074    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-trusted-ca-bundle\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.513105    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-service-ca\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.513141    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-config\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.513503 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.513276    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-oauth-serving-cert\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.514734 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.514709    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-serving-cert\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.515168 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.515151    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-oauth-config\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.524046 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.524021    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4zbb\" (UniqueName: \"kubernetes.io/projected/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-kube-api-access-f4zbb\") pod \"console-5fb86b6659-4rxwz\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") " pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.571146 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.571107    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:08.717800 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:08.717731    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb86b6659-4rxwz"]
May 28 16:02:08.720312 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:08.720280    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74b4fa7_c86c_4d9d_9cf9_19aa940a6e39.slice/crio-f518878d29a7da740a920d62766725bb868609fb871b94ec012a8ee01f5adbf8 WatchSource:0}: Error finding container f518878d29a7da740a920d62766725bb868609fb871b94ec012a8ee01f5adbf8: Status 404 returned error can't find the container with id f518878d29a7da740a920d62766725bb868609fb871b94ec012a8ee01f5adbf8
May 28 16:02:09.421216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:09.421180    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerStarted","Data":"c89226b7899e283cddc89a867af6668e3fdd74ae6603983ce1feaf92cd6ff8a9"}
May 28 16:02:09.422746 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:09.422717    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb86b6659-4rxwz" event={"ID":"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39","Type":"ContainerStarted","Data":"7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10"}
May 28 16:02:09.422854 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:09.422754    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb86b6659-4rxwz" event={"ID":"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39","Type":"ContainerStarted","Data":"f518878d29a7da740a920d62766725bb868609fb871b94ec012a8ee01f5adbf8"}
May 28 16:02:09.444290 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:09.444242    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5fb86b6659-4rxwz" podStartSLOduration=1.44422651 podStartE2EDuration="1.44422651s" podCreationTimestamp="2026-05-28 16:02:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:02:09.443955912 +0000 UTC m=+128.064018711" watchObservedRunningTime="2026-05-28 16:02:09.44422651 +0000 UTC m=+128.064289306"
May 28 16:02:10.427906 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:10.427873    2569 generic.go:358] "Generic (PLEG): container finished" podID="b3e5ad29-70a6-4411-90e1-90c4b9b748af" containerID="c68ef0e74b9b33667baf978750e424bcab125fbf84a4eda0f9d7e5c3a07cbc22" exitCode=0
May 28 16:02:10.428286 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:10.427954    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerDied","Data":"c68ef0e74b9b33667baf978750e424bcab125fbf84a4eda0f9d7e5c3a07cbc22"}
May 28 16:02:11.561983 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:11.561943    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:11.743429 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:11.743388    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:02:11.746005 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:11.745971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81550bb3-ca36-4a57-9717-e0f1aa3bf42b-metrics-certs\") pod \"network-metrics-daemon-kts5f\" (UID: \"81550bb3-ca36-4a57-9717-e0f1aa3bf42b\") " pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:02:11.806045 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:11.806010    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4ck6s\""
May 28 16:02:11.813539 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:11.813458    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kts5f"
May 28 16:02:11.949304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:11.949274    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kts5f"]
May 28 16:02:11.951945 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:02:11.951918    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81550bb3_ca36_4a57_9717_e0f1aa3bf42b.slice/crio-acd5d97fa5a1c5daffa623ebe44f5c6fceea0fc2f561a56b677a2e4023fb52f3 WatchSource:0}: Error finding container acd5d97fa5a1c5daffa623ebe44f5c6fceea0fc2f561a56b677a2e4023fb52f3: Status 404 returned error can't find the container with id acd5d97fa5a1c5daffa623ebe44f5c6fceea0fc2f561a56b677a2e4023fb52f3
May 28 16:02:12.437902 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:12.437864    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kts5f" event={"ID":"81550bb3-ca36-4a57-9717-e0f1aa3bf42b","Type":"ContainerStarted","Data":"acd5d97fa5a1c5daffa623ebe44f5c6fceea0fc2f561a56b677a2e4023fb52f3"}
May 28 16:02:13.421904 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.421875    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-594884f89d-9gcfb"
May 28 16:02:13.528501 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.528469    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb86b6659-4rxwz"]
May 28 16:02:13.564334 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.564303    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc478cd74-cwgct"]
May 28 16:02:13.567614 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.567591    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.579578 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.579536    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc478cd74-cwgct"]
May 28 16:02:13.660123 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.660074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-serving-cert\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.660294 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.660131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-oauth-config\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.660294 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.660183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-service-ca\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.660294 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.660227    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flvkg\" (UniqueName: \"kubernetes.io/projected/9520598a-7941-4755-a8c9-0224317eafdc-kube-api-access-flvkg\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.660294 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.660244    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-console-config\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.660294 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.660267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-oauth-serving-cert\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.660576 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.660477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-trusted-ca-bundle\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.761080 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761046    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-trusted-ca-bundle\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.761271 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761127    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-serving-cert\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.761271 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761161    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-oauth-config\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.761271 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761187    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-service-ca\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.761271 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761221    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flvkg\" (UniqueName: \"kubernetes.io/projected/9520598a-7941-4755-a8c9-0224317eafdc-kube-api-access-flvkg\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.761271 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761244    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-console-config\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.761271 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761268    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-oauth-serving-cert\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.762013 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.761983    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-service-ca\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.762144 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.762074    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-console-config\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.762144 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.762103    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-trusted-ca-bundle\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.762263 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.762208    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-oauth-serving-cert\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.764450 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.764425    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-oauth-config\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.764568 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.764452    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-serving-cert\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.770602 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.770581    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flvkg\" (UniqueName: \"kubernetes.io/projected/9520598a-7941-4755-a8c9-0224317eafdc-kube-api-access-flvkg\") pod \"console-6cc478cd74-cwgct\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") " pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:13.880586 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:13.880544    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:14.088109 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.088067    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc478cd74-cwgct"]
May 28 16:02:14.448477 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.448444    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerStarted","Data":"28d823cb8fa96438eca8a607d5ec74c046645c88b8e7337047bec665bbd83672"}
May 28 16:02:14.448871 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.448485    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerStarted","Data":"d84f9ef65d5c92fb0e02f0fd1e0a3a2dd3520f789315de4b579c4275e5069ef8"}
May 28 16:02:14.448871 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.448495    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerStarted","Data":"957e42df9adff51f0a94ad5e57fcffa8d2b2ed6a0059cedac067c05b5c0d7edd"}
May 28 16:02:14.448871 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.448507    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerStarted","Data":"47285c89879d5266ce03b066416222d3a185f67c01dc793467f047e0c9e78c71"}
May 28 16:02:14.448871 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.448520    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerStarted","Data":"938e18f0627ab0d481ae26174a3dc8a303548f86ac694d359ba574dc8bdca653"}
May 28 16:02:14.450220 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.450188    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kts5f" event={"ID":"81550bb3-ca36-4a57-9717-e0f1aa3bf42b","Type":"ContainerStarted","Data":"d1165ae1588968acbff46edd403a7d9d61995e5c008516151ea3ca6eb52e4443"}
May 28 16:02:14.450332 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.450232    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kts5f" event={"ID":"81550bb3-ca36-4a57-9717-e0f1aa3bf42b","Type":"ContainerStarted","Data":"107bfbf23c8901a2cf7d676d00a4b3bdb3dd30721d07cf3fa6ea6d4fbd31176d"}
May 28 16:02:14.451630 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.451604    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc478cd74-cwgct" event={"ID":"9520598a-7941-4755-a8c9-0224317eafdc","Type":"ContainerStarted","Data":"b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4"}
May 28 16:02:14.451728 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.451634    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc478cd74-cwgct" event={"ID":"9520598a-7941-4755-a8c9-0224317eafdc","Type":"ContainerStarted","Data":"51894834b675acfbd7dde4ccaac8ffc5c98e942e5337b3ef513c5691cf0d345d"}
May 28 16:02:14.468776 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.468711    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kts5f" podStartSLOduration=130.501221606 podStartE2EDuration="2m12.46869054s" podCreationTimestamp="2026-05-28 16:00:02 +0000 UTC" firstStartedPulling="2026-05-28 16:02:11.954393238 +0000 UTC m=+130.574456013" lastFinishedPulling="2026-05-28 16:02:13.921862169 +0000 UTC m=+132.541924947" observedRunningTime="2026-05-28 16:02:14.467418993 +0000 UTC m=+133.087481793" watchObservedRunningTime="2026-05-28 16:02:14.46869054 +0000 UTC m=+133.088753338"
May 28 16:02:14.486717 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:14.486663    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6cc478cd74-cwgct" podStartSLOduration=1.486640601 podStartE2EDuration="1.486640601s" podCreationTimestamp="2026-05-28 16:02:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:02:14.48556211 +0000 UTC m=+133.105624921" watchObservedRunningTime="2026-05-28 16:02:14.486640601 +0000 UTC m=+133.106703398"
May 28 16:02:15.458385 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:15.458331    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b3e5ad29-70a6-4411-90e1-90c4b9b748af","Type":"ContainerStarted","Data":"4da4194324f4782f21a11580ae72d3551d79821625f507ceb23cb4981f1fcfdd"}
May 28 16:02:15.491535 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:15.491482    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.973202512 podStartE2EDuration="8.491468376s" podCreationTimestamp="2026-05-28 16:02:07 +0000 UTC" firstStartedPulling="2026-05-28 16:02:08.440510105 +0000 UTC m=+127.060572880" lastFinishedPulling="2026-05-28 16:02:13.958775955 +0000 UTC m=+132.578838744" observedRunningTime="2026-05-28 16:02:15.490063141 +0000 UTC m=+134.110125974" watchObservedRunningTime="2026-05-28 16:02:15.491468376 +0000 UTC m=+134.111531203"
May 28 16:02:17.960055 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:17.960015    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:02:18.571817 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:18.571773    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:23.881520 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:23.881481    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:23.881520 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:23.881527    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:23.886218 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:23.886190    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:24.493173 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:24.493145    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:02:24.543481 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:24.543443    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d65698885-8qbc7"]
May 28 16:02:25.936615 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:25.936569    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:25.936615 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:25.936625    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:33.238618 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.238527    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64ccbbd5f-pdhtp" podUID="bd1b8cbc-ed44-41ac-b737-99782bc568c0" containerName="console" containerID="cri-o://5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262" gracePeriod=15
May 28 16:02:33.494587 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.494519    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64ccbbd5f-pdhtp_bd1b8cbc-ed44-41ac-b737-99782bc568c0/console/0.log"
May 28 16:02:33.494702 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.494602    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:33.520209 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520177    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-service-ca\") pod \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") "
May 28 16:02:33.520386 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520226    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-serving-cert\") pod \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") "
May 28 16:02:33.520386 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520305    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-config\") pod \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") "
May 28 16:02:33.520386 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520381    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4x25\" (UniqueName: \"kubernetes.io/projected/bd1b8cbc-ed44-41ac-b737-99782bc568c0-kube-api-access-w4x25\") pod \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") "
May 28 16:02:33.520557 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520414    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-oauth-serving-cert\") pod \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") "
May 28 16:02:33.520557 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520444    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-trusted-ca-bundle\") pod \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") "
May 28 16:02:33.520557 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520486    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-oauth-config\") pod \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\" (UID: \"bd1b8cbc-ed44-41ac-b737-99782bc568c0\") "
May 28 16:02:33.520855 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520749    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64ccbbd5f-pdhtp_bd1b8cbc-ed44-41ac-b737-99782bc568c0/console/0.log"
May 28 16:02:33.520855 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520788    2569 generic.go:358] "Generic (PLEG): container finished" podID="bd1b8cbc-ed44-41ac-b737-99782bc568c0" containerID="5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262" exitCode=2
May 28 16:02:33.521029 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520905    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64ccbbd5f-pdhtp" event={"ID":"bd1b8cbc-ed44-41ac-b737-99782bc568c0","Type":"ContainerDied","Data":"5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262"}
May 28 16:02:33.521029 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520936    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64ccbbd5f-pdhtp" event={"ID":"bd1b8cbc-ed44-41ac-b737-99782bc568c0","Type":"ContainerDied","Data":"20cf82d429e5affe9b01ebf27386cba165acccda40756c2ea7bc058e1dd15354"}
May 28 16:02:33.521029 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520958    2569 scope.go:117] "RemoveContainer" containerID="5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262"
May 28 16:02:33.521029 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.520973    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-config" (OuterVolumeSpecName: "console-config") pod "bd1b8cbc-ed44-41ac-b737-99782bc568c0" (UID: "bd1b8cbc-ed44-41ac-b737-99782bc568c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:33.521216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.521104    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd1b8cbc-ed44-41ac-b737-99782bc568c0" (UID: "bd1b8cbc-ed44-41ac-b737-99782bc568c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:33.521216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.521171    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64ccbbd5f-pdhtp"
May 28 16:02:33.521315 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.521241    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd1b8cbc-ed44-41ac-b737-99782bc568c0" (UID: "bd1b8cbc-ed44-41ac-b737-99782bc568c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:33.521513 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.521464    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd1b8cbc-ed44-41ac-b737-99782bc568c0" (UID: "bd1b8cbc-ed44-41ac-b737-99782bc568c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:33.523667 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.523636    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd1b8cbc-ed44-41ac-b737-99782bc568c0" (UID: "bd1b8cbc-ed44-41ac-b737-99782bc568c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:02:33.523808 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.523786    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd1b8cbc-ed44-41ac-b737-99782bc568c0" (UID: "bd1b8cbc-ed44-41ac-b737-99782bc568c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:02:33.523808 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.523799    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1b8cbc-ed44-41ac-b737-99782bc568c0-kube-api-access-w4x25" (OuterVolumeSpecName: "kube-api-access-w4x25") pod "bd1b8cbc-ed44-41ac-b737-99782bc568c0" (UID: "bd1b8cbc-ed44-41ac-b737-99782bc568c0"). InnerVolumeSpecName "kube-api-access-w4x25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:02:33.539727 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.539705    2569 scope.go:117] "RemoveContainer" containerID="5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262"
May 28 16:02:33.540073 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:02:33.540055    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262\": container with ID starting with 5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262 not found: ID does not exist" containerID="5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262"
May 28 16:02:33.540121 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.540083    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262"} err="failed to get container status \"5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262\": rpc error: code = NotFound desc = could not find container \"5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262\": container with ID starting with 5df747abd14816edb303b98eeba26d5f92f6d95a2a32bb25ef9417ac7bd28262 not found: ID does not exist"
May 28 16:02:33.621693 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.621642    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4x25\" (UniqueName: \"kubernetes.io/projected/bd1b8cbc-ed44-41ac-b737-99782bc568c0-kube-api-access-w4x25\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:33.621693 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.621686    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-oauth-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:33.621693 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.621696    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-trusted-ca-bundle\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:33.621693 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.621705    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-oauth-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:33.621954 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.621716    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-service-ca\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:33.621954 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.621724    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:33.621954 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.621732    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd1b8cbc-ed44-41ac-b737-99782bc568c0-console-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:33.846407 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.846376    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64ccbbd5f-pdhtp"]
May 28 16:02:33.855867 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.855838    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64ccbbd5f-pdhtp"]
May 28 16:02:33.989785 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:33.989755    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1b8cbc-ed44-41ac-b737-99782bc568c0" path="/var/lib/kubelet/pods/bd1b8cbc-ed44-41ac-b737-99782bc568c0/volumes"
May 28 16:02:38.549304 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.549239    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5fb86b6659-4rxwz" podUID="a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" containerName="console" containerID="cri-o://7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10" gracePeriod=15
May 28 16:02:38.798853 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.798829    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb86b6659-4rxwz_a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39/console/0.log"
May 28 16:02:38.799010 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.798894    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:38.867384 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867269    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-config\") pod \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") "
May 28 16:02:38.867384 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867325    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-serving-cert\") pod \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") "
May 28 16:02:38.867384 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867371    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-service-ca\") pod \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") "
May 28 16:02:38.867661 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867398    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-trusted-ca-bundle\") pod \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") "
May 28 16:02:38.867661 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867439    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-oauth-config\") pod \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") "
May 28 16:02:38.867661 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867464    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4zbb\" (UniqueName: \"kubernetes.io/projected/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-kube-api-access-f4zbb\") pod \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") "
May 28 16:02:38.867661 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867499    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-oauth-serving-cert\") pod \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\" (UID: \"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39\") "
May 28 16:02:38.867843 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867746    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-service-ca" (OuterVolumeSpecName: "service-ca") pod "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" (UID: "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:38.867843 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867756    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-config" (OuterVolumeSpecName: "console-config") pod "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" (UID: "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:38.867950 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.867866    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" (UID: "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:38.868064 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.868043    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" (UID: "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:38.869599 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.869552    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" (UID: "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:02:38.869599 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.869569    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" (UID: "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:02:38.869736 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.869624    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-kube-api-access-f4zbb" (OuterVolumeSpecName: "kube-api-access-f4zbb") pod "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" (UID: "a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39"). InnerVolumeSpecName "kube-api-access-f4zbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:02:38.968645 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.968609    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:38.968645 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.968639    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:38.968645 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.968653    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-service-ca\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:38.968872 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.968666    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-trusted-ca-bundle\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:38.968872 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.968679    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-console-oauth-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:38.968872 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.968691    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4zbb\" (UniqueName: \"kubernetes.io/projected/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-kube-api-access-f4zbb\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:38.968872 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:38.968702    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39-oauth-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:39.540574 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.540547    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fb86b6659-4rxwz_a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39/console/0.log"
May 28 16:02:39.540753 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.540587    2569 generic.go:358] "Generic (PLEG): container finished" podID="a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" containerID="7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10" exitCode=2
May 28 16:02:39.540753 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.540616    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb86b6659-4rxwz" event={"ID":"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39","Type":"ContainerDied","Data":"7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10"}
May 28 16:02:39.540753 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.540655    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb86b6659-4rxwz"
May 28 16:02:39.540753 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.540662    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb86b6659-4rxwz" event={"ID":"a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39","Type":"ContainerDied","Data":"f518878d29a7da740a920d62766725bb868609fb871b94ec012a8ee01f5adbf8"}
May 28 16:02:39.540753 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.540675    2569 scope.go:117] "RemoveContainer" containerID="7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10"
May 28 16:02:39.553541 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.553342    2569 scope.go:117] "RemoveContainer" containerID="7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10"
May 28 16:02:39.553804 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:02:39.553727    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10\": container with ID starting with 7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10 not found: ID does not exist" containerID="7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10"
May 28 16:02:39.553804 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.553750    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10"} err="failed to get container status \"7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10\": rpc error: code = NotFound desc = could not find container \"7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10\": container with ID starting with 7d9912eca036c2b8972a5aa0c888164fc5118e5f9b035bb0a8d29beb69313d10 not found: ID does not exist"
May 28 16:02:39.568060 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.568038    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb86b6659-4rxwz"]
May 28 16:02:39.572680 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.572650    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fb86b6659-4rxwz"]
May 28 16:02:39.989848 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:39.989771    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" path="/var/lib/kubelet/pods/a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39/volumes"
May 28 16:02:45.941983 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:45.941949    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:45.945935 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:45.945910    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f79c88cb7-69cqn"
May 28 16:02:49.565690 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.565637    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-d65698885-8qbc7" podUID="2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" containerName="console" containerID="cri-o://57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f" gracePeriod=15
May 28 16:02:49.812182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.812159    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d65698885-8qbc7_2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c/console/0.log"
May 28 16:02:49.812309 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.812219    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:02:49.867668 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.867574    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-serving-cert\") pod \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") "
May 28 16:02:49.867668 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.867646    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-service-ca\") pod \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") "
May 28 16:02:49.867890 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.867675    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-config\") pod \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") "
May 28 16:02:49.867890 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.867713    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-oauth-serving-cert\") pod \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") "
May 28 16:02:49.867890 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.867742    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksnxl\" (UniqueName: \"kubernetes.io/projected/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-kube-api-access-ksnxl\") pod \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") "
May 28 16:02:49.867890 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.867773    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-oauth-config\") pod \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\" (UID: \"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c\") "
May 28 16:02:49.868144 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.868116    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" (UID: "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:49.868206 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.868167    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" (UID: "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:49.868206 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.868171    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-config" (OuterVolumeSpecName: "console-config") pod "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" (UID: "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:02:49.869858 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.869822    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-kube-api-access-ksnxl" (OuterVolumeSpecName: "kube-api-access-ksnxl") pod "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" (UID: "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c"). InnerVolumeSpecName "kube-api-access-ksnxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:02:49.869858 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.869842    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" (UID: "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:02:49.869994 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.869878    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" (UID: "2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:02:49.968919 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.968885    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:49.968919 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.968913    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-oauth-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:49.968919 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.968925    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksnxl\" (UniqueName: \"kubernetes.io/projected/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-kube-api-access-ksnxl\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:49.969147 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.968934    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-oauth-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:49.969147 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.968947    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-console-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:49.969147 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:49.968957    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c-service-ca\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:02:50.577542 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.577515    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d65698885-8qbc7_2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c/console/0.log"
May 28 16:02:50.578045 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.577555    2569 generic.go:358] "Generic (PLEG): container finished" podID="2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" containerID="57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f" exitCode=2
May 28 16:02:50.578045 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.577626    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65698885-8qbc7"
May 28 16:02:50.578045 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.577641    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65698885-8qbc7" event={"ID":"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c","Type":"ContainerDied","Data":"57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f"}
May 28 16:02:50.578045 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.577687    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65698885-8qbc7" event={"ID":"2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c","Type":"ContainerDied","Data":"f52507b0e3d1dfd11b878f33473cb1811a9c54ac48397cb6d6d1f7d0c71540d1"}
May 28 16:02:50.578045 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.577705    2569 scope.go:117] "RemoveContainer" containerID="57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f"
May 28 16:02:50.585855 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.585838    2569 scope.go:117] "RemoveContainer" containerID="57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f"
May 28 16:02:50.586121 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:02:50.586104    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f\": container with ID starting with 57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f not found: ID does not exist" containerID="57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f"
May 28 16:02:50.586167 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.586134    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f"} err="failed to get container status \"57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f\": rpc error: code = NotFound desc = could not find container \"57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f\": container with ID starting with 57d33a6865bca3b88a5b457259b23d1b148fbfca8caae3877f505c947f89eb2f not found: ID does not exist"
May 28 16:02:50.599874 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.599843    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d65698885-8qbc7"]
May 28 16:02:50.611597 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:50.611570    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d65698885-8qbc7"]
May 28 16:02:51.993830 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:51.993799    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" path="/var/lib/kubelet/pods/2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c/volumes"
May 28 16:02:53.587911 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:53.587880    2569 generic.go:358] "Generic (PLEG): container finished" podID="575a9c9c-d387-45cf-97dd-92edc864214e" containerID="1596f566a1de7a3c086f3ce1b7ae145fe0ded93c3aa07716010ebaea380f8cda" exitCode=0
May 28 16:02:53.588269 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:53.587959    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4" event={"ID":"575a9c9c-d387-45cf-97dd-92edc864214e","Type":"ContainerDied","Data":"1596f566a1de7a3c086f3ce1b7ae145fe0ded93c3aa07716010ebaea380f8cda"}
May 28 16:02:53.588309 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:53.588294    2569 scope.go:117] "RemoveContainer" containerID="1596f566a1de7a3c086f3ce1b7ae145fe0ded93c3aa07716010ebaea380f8cda"
May 28 16:02:54.591930 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:02:54.591896    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-lqvm4" event={"ID":"575a9c9c-d387-45cf-97dd-92edc864214e","Type":"ContainerStarted","Data":"daf0890dc62b204115a8180275c923c97ac9ca6f504b14261c2faf6325c19162"}
May 28 16:03:07.959910 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:07.959853    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:03:07.975867 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:07.975841    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:03:08.652676 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:08.652648    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:03:42.895230 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895191    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bf9594d7f-rxx4t"]
May 28 16:03:42.895820 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895703    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1b8cbc-ed44-41ac-b737-99782bc568c0" containerName="console"
May 28 16:03:42.895820 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895724    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1b8cbc-ed44-41ac-b737-99782bc568c0" containerName="console"
May 28 16:03:42.895820 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895741    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" containerName="console"
May 28 16:03:42.895820 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895749    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" containerName="console"
May 28 16:03:42.895820 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895772    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" containerName="console"
May 28 16:03:42.895820 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895781    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" containerName="console"
May 28 16:03:42.896118 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895860    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f41240e-fdd0-47fe-b17b-eb62b2ff8a6c" containerName="console"
May 28 16:03:42.896118 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895874    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="a74b4fa7-c86c-4d9d-9cf9-19aa940a6e39" containerName="console"
May 28 16:03:42.896118 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.895883    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd1b8cbc-ed44-41ac-b737-99782bc568c0" containerName="console"
May 28 16:03:42.899078 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.899055    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:42.910665 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:42.910638    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf9594d7f-rxx4t"]
May 28 16:03:43.031377 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.031310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-oauth-config\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.031552 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.031433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-config\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.031552 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.031473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-service-ca\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.031552 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.031509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-serving-cert\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.031552 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.031528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-trusted-ca-bundle\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.031552 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.031543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-oauth-serving-cert\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.031780 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.031614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c57jl\" (UniqueName: \"kubernetes.io/projected/c7b7408f-4f97-486a-93db-b55cd0b7bbea-kube-api-access-c57jl\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.132281 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.132240    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-oauth-config\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.132499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.132298    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-config\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.132499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.132325    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-service-ca\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.132499 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.132376    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-serving-cert\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.132665 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.132529    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-trusted-ca-bundle\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.132665 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.132568    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-oauth-serving-cert\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.132665 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.132596    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c57jl\" (UniqueName: \"kubernetes.io/projected/c7b7408f-4f97-486a-93db-b55cd0b7bbea-kube-api-access-c57jl\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.133127 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.133102    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-config\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.133250 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.133226    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-service-ca\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.133250 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.133239    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-oauth-serving-cert\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.133579 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.133561    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-trusted-ca-bundle\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.134932 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.134912    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-oauth-config\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.135020 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.134968    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-serving-cert\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.141155 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.141134    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c57jl\" (UniqueName: \"kubernetes.io/projected/c7b7408f-4f97-486a-93db-b55cd0b7bbea-kube-api-access-c57jl\") pod \"console-6bf9594d7f-rxx4t\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") " pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.209173 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.209070    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:43.353368 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.353324    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf9594d7f-rxx4t"]
May 28 16:03:43.356028 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:03:43.355999    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b7408f_4f97_486a_93db_b55cd0b7bbea.slice/crio-13e1ee34062f41969ec70af849b69e4b43c633fbd2d34c6a4082b6742431ae4d WatchSource:0}: Error finding container 13e1ee34062f41969ec70af849b69e4b43c633fbd2d34c6a4082b6742431ae4d: Status 404 returned error can't find the container with id 13e1ee34062f41969ec70af849b69e4b43c633fbd2d34c6a4082b6742431ae4d
May 28 16:03:43.740240 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.740205    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf9594d7f-rxx4t" event={"ID":"c7b7408f-4f97-486a-93db-b55cd0b7bbea","Type":"ContainerStarted","Data":"0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e"}
May 28 16:03:43.740240 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.740240    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf9594d7f-rxx4t" event={"ID":"c7b7408f-4f97-486a-93db-b55cd0b7bbea","Type":"ContainerStarted","Data":"13e1ee34062f41969ec70af849b69e4b43c633fbd2d34c6a4082b6742431ae4d"}
May 28 16:03:43.759520 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:43.759469    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6bf9594d7f-rxx4t" podStartSLOduration=1.759453568 podStartE2EDuration="1.759453568s" podCreationTimestamp="2026-05-28 16:03:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:03:43.75762103 +0000 UTC m=+222.377683840" watchObservedRunningTime="2026-05-28 16:03:43.759453568 +0000 UTC m=+222.379516364"
May 28 16:03:53.209230 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:53.209187    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:53.209678 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:53.209247    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:53.214299 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:53.214275    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:53.774150 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:53.774112    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:03:53.828810 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:03:53.828768    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc478cd74-cwgct"]
May 28 16:04:00.861757 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:00.861722    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vfxzx"]
May 28 16:04:00.866161 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:00.866141    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:00.868657 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:00.868635    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 16:04:00.871676 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:00.871654    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vfxzx"]
May 28 16:04:00.993031 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:00.992998    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e64005b2-452b-4617-9130-22fff0333b34-kubelet-config\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:00.993201 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:00.993077    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e64005b2-452b-4617-9130-22fff0333b34-dbus\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:00.993201 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:00.993101    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e64005b2-452b-4617-9130-22fff0333b34-original-pull-secret\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.093674 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.093620    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e64005b2-452b-4617-9130-22fff0333b34-dbus\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.093674 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.093678    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e64005b2-452b-4617-9130-22fff0333b34-original-pull-secret\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.093913 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.093745    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e64005b2-452b-4617-9130-22fff0333b34-kubelet-config\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.093913 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.093842    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e64005b2-452b-4617-9130-22fff0333b34-dbus\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.093913 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.093854    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e64005b2-452b-4617-9130-22fff0333b34-kubelet-config\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.096048 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.096022    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e64005b2-452b-4617-9130-22fff0333b34-original-pull-secret\") pod \"global-pull-secret-syncer-vfxzx\" (UID: \"e64005b2-452b-4617-9130-22fff0333b34\") " pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.176254 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.176163    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vfxzx"
May 28 16:04:01.308001 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.307970    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vfxzx"]
May 28 16:04:01.310237 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:04:01.310203    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64005b2_452b_4617_9130_22fff0333b34.slice/crio-adeb800ddbe7c2985f8b9d1ec11bcc69596714eec4eaee7f3a4a6574a85ca975 WatchSource:0}: Error finding container adeb800ddbe7c2985f8b9d1ec11bcc69596714eec4eaee7f3a4a6574a85ca975: Status 404 returned error can't find the container with id adeb800ddbe7c2985f8b9d1ec11bcc69596714eec4eaee7f3a4a6574a85ca975
May 28 16:04:01.795131 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:01.795088    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vfxzx" event={"ID":"e64005b2-452b-4617-9130-22fff0333b34","Type":"ContainerStarted","Data":"adeb800ddbe7c2985f8b9d1ec11bcc69596714eec4eaee7f3a4a6574a85ca975"}
May 28 16:04:05.808292 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:05.808255    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vfxzx" event={"ID":"e64005b2-452b-4617-9130-22fff0333b34","Type":"ContainerStarted","Data":"6733ebb05c9da65eb15550771a8f730772b78353a3e27257d297c88d0aef09d0"}
May 28 16:04:05.825988 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:05.825933    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vfxzx" podStartSLOduration=2.279119556 podStartE2EDuration="5.825918987s" podCreationTimestamp="2026-05-28 16:04:00 +0000 UTC" firstStartedPulling="2026-05-28 16:04:01.311841877 +0000 UTC m=+239.931904652" lastFinishedPulling="2026-05-28 16:04:04.858641305 +0000 UTC m=+243.478704083" observedRunningTime="2026-05-28 16:04:05.824437788 +0000 UTC m=+244.444500586" watchObservedRunningTime="2026-05-28 16:04:05.825918987 +0000 UTC m=+244.445981783"
May 28 16:04:18.850170 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:18.850054    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6cc478cd74-cwgct" podUID="9520598a-7941-4755-a8c9-0224317eafdc" containerName="console" containerID="cri-o://b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4" gracePeriod=15
May 28 16:04:19.090432 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.090403    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cc478cd74-cwgct_9520598a-7941-4755-a8c9-0224317eafdc/console/0.log"
May 28 16:04:19.090558 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.090465    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:04:19.153598 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153515    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-serving-cert\") pod \"9520598a-7941-4755-a8c9-0224317eafdc\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") "
May 28 16:04:19.153598 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153550    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-console-config\") pod \"9520598a-7941-4755-a8c9-0224317eafdc\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") "
May 28 16:04:19.153598 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153565    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-oauth-serving-cert\") pod \"9520598a-7941-4755-a8c9-0224317eafdc\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") "
May 28 16:04:19.153598 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153599    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flvkg\" (UniqueName: \"kubernetes.io/projected/9520598a-7941-4755-a8c9-0224317eafdc-kube-api-access-flvkg\") pod \"9520598a-7941-4755-a8c9-0224317eafdc\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") "
May 28 16:04:19.153898 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153621    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-trusted-ca-bundle\") pod \"9520598a-7941-4755-a8c9-0224317eafdc\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") "
May 28 16:04:19.153898 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153663    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-oauth-config\") pod \"9520598a-7941-4755-a8c9-0224317eafdc\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") "
May 28 16:04:19.153898 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153719    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-service-ca\") pod \"9520598a-7941-4755-a8c9-0224317eafdc\" (UID: \"9520598a-7941-4755-a8c9-0224317eafdc\") "
May 28 16:04:19.154047 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.153987    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-console-config" (OuterVolumeSpecName: "console-config") pod "9520598a-7941-4755-a8c9-0224317eafdc" (UID: "9520598a-7941-4755-a8c9-0224317eafdc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:04:19.154104 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.154041    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9520598a-7941-4755-a8c9-0224317eafdc" (UID: "9520598a-7941-4755-a8c9-0224317eafdc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:04:19.154104 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.154071    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9520598a-7941-4755-a8c9-0224317eafdc" (UID: "9520598a-7941-4755-a8c9-0224317eafdc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:04:19.154230 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.154206    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-service-ca" (OuterVolumeSpecName: "service-ca") pod "9520598a-7941-4755-a8c9-0224317eafdc" (UID: "9520598a-7941-4755-a8c9-0224317eafdc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:04:19.156007 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.155982    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9520598a-7941-4755-a8c9-0224317eafdc" (UID: "9520598a-7941-4755-a8c9-0224317eafdc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:04:19.156321 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.156298    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9520598a-7941-4755-a8c9-0224317eafdc" (UID: "9520598a-7941-4755-a8c9-0224317eafdc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:04:19.156404 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.156332    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9520598a-7941-4755-a8c9-0224317eafdc-kube-api-access-flvkg" (OuterVolumeSpecName: "kube-api-access-flvkg") pod "9520598a-7941-4755-a8c9-0224317eafdc" (UID: "9520598a-7941-4755-a8c9-0224317eafdc"). InnerVolumeSpecName "kube-api-access-flvkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:04:19.255216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.255180    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-service-ca\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:04:19.255216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.255209    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:04:19.255216 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.255219    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-console-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:04:19.255533 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.255229    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-oauth-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:04:19.255533 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.255239    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flvkg\" (UniqueName: \"kubernetes.io/projected/9520598a-7941-4755-a8c9-0224317eafdc-kube-api-access-flvkg\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:04:19.255533 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.255249    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9520598a-7941-4755-a8c9-0224317eafdc-trusted-ca-bundle\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:04:19.255533 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.255258    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9520598a-7941-4755-a8c9-0224317eafdc-console-oauth-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:04:19.855733 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.855705    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cc478cd74-cwgct_9520598a-7941-4755-a8c9-0224317eafdc/console/0.log"
May 28 16:04:19.856185 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.855745    2569 generic.go:358] "Generic (PLEG): container finished" podID="9520598a-7941-4755-a8c9-0224317eafdc" containerID="b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4" exitCode=2
May 28 16:04:19.856185 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.855822    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc478cd74-cwgct"
May 28 16:04:19.856185 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.855839    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc478cd74-cwgct" event={"ID":"9520598a-7941-4755-a8c9-0224317eafdc","Type":"ContainerDied","Data":"b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4"}
May 28 16:04:19.856185 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.855886    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc478cd74-cwgct" event={"ID":"9520598a-7941-4755-a8c9-0224317eafdc","Type":"ContainerDied","Data":"51894834b675acfbd7dde4ccaac8ffc5c98e942e5337b3ef513c5691cf0d345d"}
May 28 16:04:19.856185 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.855906    2569 scope.go:117] "RemoveContainer" containerID="b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4"
May 28 16:04:19.863886 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.863639    2569 scope.go:117] "RemoveContainer" containerID="b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4"
May 28 16:04:19.863989 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:04:19.863967    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4\": container with ID starting with b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4 not found: ID does not exist" containerID="b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4"
May 28 16:04:19.864053 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.864003    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4"} err="failed to get container status \"b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4\": rpc error: code = NotFound desc = could not find container \"b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4\": container with ID starting with b171249efb38d29d8b2bd49e2c9669ee13197b1e455b6ae7a94e83892dfa43e4 not found: ID does not exist"
May 28 16:04:19.879022 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.878990    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc478cd74-cwgct"]
May 28 16:04:19.882987 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.882965    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc478cd74-cwgct"]
May 28 16:04:19.989592 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:04:19.989558    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9520598a-7941-4755-a8c9-0224317eafdc" path="/var/lib/kubelet/pods/9520598a-7941-4755-a8c9-0224317eafdc/volumes"
May 28 16:05:01.853688 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:05:01.853656    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:05:01.854584 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:05:01.854556    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:05:01.858752 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:05:01.858727    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:05:01.859394 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:05:01.859377    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:07:17.903618 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:17.903536    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-54c9f98fd7-m9f88"]
May 28 16:07:17.904069 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:17.903933    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9520598a-7941-4755-a8c9-0224317eafdc" containerName="console"
May 28 16:07:17.904069 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:17.903956    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9520598a-7941-4755-a8c9-0224317eafdc" containerName="console"
May 28 16:07:17.904161 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:17.904119    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="9520598a-7941-4755-a8c9-0224317eafdc" containerName="console"
May 28 16:07:17.906166 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:17.906148    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:17.915602 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:17.915570    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9f98fd7-m9f88"]
May 28 16:07:18.007420 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.007389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-trusted-ca-bundle\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.007420 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.007423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f3e0b1e-6710-47b8-884c-12b23090c132-console-serving-cert\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.007622 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.007448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-oauth-serving-cert\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.007622 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.007555    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f3e0b1e-6710-47b8-884c-12b23090c132-console-oauth-config\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.007622 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.007584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-console-config\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.007714 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.007644    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-service-ca\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.007714 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.007677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpfl9\" (UniqueName: \"kubernetes.io/projected/9f3e0b1e-6710-47b8-884c-12b23090c132-kube-api-access-cpfl9\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.108512 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.108477    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-console-config\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.108656 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.108539    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-service-ca\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.108771 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.108744    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfl9\" (UniqueName: \"kubernetes.io/projected/9f3e0b1e-6710-47b8-884c-12b23090c132-kube-api-access-cpfl9\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.108827 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.108814    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-trusted-ca-bundle\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.108864 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.108852    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f3e0b1e-6710-47b8-884c-12b23090c132-console-serving-cert\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.108909 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.108887    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-oauth-serving-cert\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.108962 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.108952    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f3e0b1e-6710-47b8-884c-12b23090c132-console-oauth-config\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.109309 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.109286    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-console-config\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.109449 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.109322    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-service-ca\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.109648 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.109627    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-oauth-serving-cert\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.109725 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.109675    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f3e0b1e-6710-47b8-884c-12b23090c132-trusted-ca-bundle\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.111337 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.111316    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f3e0b1e-6710-47b8-884c-12b23090c132-console-oauth-config\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.111505 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.111484    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f3e0b1e-6710-47b8-884c-12b23090c132-console-serving-cert\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.118771 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.118749    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfl9\" (UniqueName: \"kubernetes.io/projected/9f3e0b1e-6710-47b8-884c-12b23090c132-kube-api-access-cpfl9\") pod \"console-54c9f98fd7-m9f88\" (UID: \"9f3e0b1e-6710-47b8-884c-12b23090c132\") " pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.217671 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.217580    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:18.349681 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.349586    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54c9f98fd7-m9f88"]
May 28 16:07:18.352524 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:07:18.352492    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3e0b1e_6710_47b8_884c_12b23090c132.slice/crio-70ceed703b40f31f6197e143155835c2093a4c4577eb8d2ca39441eca16175a9 WatchSource:0}: Error finding container 70ceed703b40f31f6197e143155835c2093a4c4577eb8d2ca39441eca16175a9: Status 404 returned error can't find the container with id 70ceed703b40f31f6197e143155835c2093a4c4577eb8d2ca39441eca16175a9
May 28 16:07:18.354246 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.354228    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:07:18.386136 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:18.386099    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9f98fd7-m9f88" event={"ID":"9f3e0b1e-6710-47b8-884c-12b23090c132","Type":"ContainerStarted","Data":"70ceed703b40f31f6197e143155835c2093a4c4577eb8d2ca39441eca16175a9"}
May 28 16:07:19.390484 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:19.390450    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54c9f98fd7-m9f88" event={"ID":"9f3e0b1e-6710-47b8-884c-12b23090c132","Type":"ContainerStarted","Data":"cfbe7a43897dda4e5ef8de2fff2200ccbc50fc11ada961f032f46e7493969c2b"}
May 28 16:07:19.409203 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:19.409156    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-54c9f98fd7-m9f88" podStartSLOduration=2.409142938 podStartE2EDuration="2.409142938s" podCreationTimestamp="2026-05-28 16:07:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:07:19.40861858 +0000 UTC m=+438.028681371" watchObservedRunningTime="2026-05-28 16:07:19.409142938 +0000 UTC m=+438.029205735"
May 28 16:07:28.218664 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:28.218630    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:28.219194 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:28.218677    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:28.223457 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:28.223432    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:28.424557 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:28.424530    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54c9f98fd7-m9f88"
May 28 16:07:28.470633 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:28.470537    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf9594d7f-rxx4t"]
May 28 16:07:53.492298 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.492259    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6bf9594d7f-rxx4t" podUID="c7b7408f-4f97-486a-93db-b55cd0b7bbea" containerName="console" containerID="cri-o://0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e" gracePeriod=15
May 28 16:07:53.735594 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.735568    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bf9594d7f-rxx4t_c7b7408f-4f97-486a-93db-b55cd0b7bbea/console/0.log"
May 28 16:07:53.735728 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.735634    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:07:53.819623 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.819585    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-serving-cert\") pod \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") "
May 28 16:07:53.819623 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.819633    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-config\") pod \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") "
May 28 16:07:53.819831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.819663    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-oauth-config\") pod \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") "
May 28 16:07:53.819831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.819734    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c57jl\" (UniqueName: \"kubernetes.io/projected/c7b7408f-4f97-486a-93db-b55cd0b7bbea-kube-api-access-c57jl\") pod \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") "
May 28 16:07:53.819831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.819761    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-service-ca\") pod \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") "
May 28 16:07:53.819831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.819797    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-oauth-serving-cert\") pod \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") "
May 28 16:07:53.819831 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.819816    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-trusted-ca-bundle\") pod \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\" (UID: \"c7b7408f-4f97-486a-93db-b55cd0b7bbea\") "
May 28 16:07:53.820078 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.820000    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-config" (OuterVolumeSpecName: "console-config") pod "c7b7408f-4f97-486a-93db-b55cd0b7bbea" (UID: "c7b7408f-4f97-486a-93db-b55cd0b7bbea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:07:53.820146 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.820098    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:07:53.820305 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.820195    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7b7408f-4f97-486a-93db-b55cd0b7bbea" (UID: "c7b7408f-4f97-486a-93db-b55cd0b7bbea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:07:53.820412 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.820396    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7b7408f-4f97-486a-93db-b55cd0b7bbea" (UID: "c7b7408f-4f97-486a-93db-b55cd0b7bbea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:07:53.820474 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.820427    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7b7408f-4f97-486a-93db-b55cd0b7bbea" (UID: "c7b7408f-4f97-486a-93db-b55cd0b7bbea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:07:53.822001 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.821974    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7b7408f-4f97-486a-93db-b55cd0b7bbea" (UID: "c7b7408f-4f97-486a-93db-b55cd0b7bbea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:07:53.822109 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.822013    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b7408f-4f97-486a-93db-b55cd0b7bbea-kube-api-access-c57jl" (OuterVolumeSpecName: "kube-api-access-c57jl") pod "c7b7408f-4f97-486a-93db-b55cd0b7bbea" (UID: "c7b7408f-4f97-486a-93db-b55cd0b7bbea"). InnerVolumeSpecName "kube-api-access-c57jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:07:53.822109 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.822069    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7b7408f-4f97-486a-93db-b55cd0b7bbea" (UID: "c7b7408f-4f97-486a-93db-b55cd0b7bbea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:07:53.920749 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.920704    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c57jl\" (UniqueName: \"kubernetes.io/projected/c7b7408f-4f97-486a-93db-b55cd0b7bbea-kube-api-access-c57jl\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:07:53.920749 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.920740    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-service-ca\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:07:53.920749 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.920753    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-oauth-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:07:53.920986 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.920765    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7b7408f-4f97-486a-93db-b55cd0b7bbea-trusted-ca-bundle\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:07:53.920986 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.920779    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-serving-cert\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:07:53.920986 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:53.920791    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7b7408f-4f97-486a-93db-b55cd0b7bbea-console-oauth-config\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:07:54.495454 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.495425    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bf9594d7f-rxx4t_c7b7408f-4f97-486a-93db-b55cd0b7bbea/console/0.log"
May 28 16:07:54.495853 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.495467    2569 generic.go:358] "Generic (PLEG): container finished" podID="c7b7408f-4f97-486a-93db-b55cd0b7bbea" containerID="0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e" exitCode=2
May 28 16:07:54.495853 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.495502    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf9594d7f-rxx4t" event={"ID":"c7b7408f-4f97-486a-93db-b55cd0b7bbea","Type":"ContainerDied","Data":"0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e"}
May 28 16:07:54.495853 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.495543    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf9594d7f-rxx4t" event={"ID":"c7b7408f-4f97-486a-93db-b55cd0b7bbea","Type":"ContainerDied","Data":"13e1ee34062f41969ec70af849b69e4b43c633fbd2d34c6a4082b6742431ae4d"}
May 28 16:07:54.495853 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.495559    2569 scope.go:117] "RemoveContainer" containerID="0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e"
May 28 16:07:54.495853 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.495566    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf9594d7f-rxx4t"
May 28 16:07:54.503514 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.503503    2569 scope.go:117] "RemoveContainer" containerID="0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e"
May 28 16:07:54.503748 ip-10-0-129-162 kubenswrapper[2569]: E0528 16:07:54.503730    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e\": container with ID starting with 0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e not found: ID does not exist" containerID="0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e"
May 28 16:07:54.503813 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.503755    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e"} err="failed to get container status \"0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e\": rpc error: code = NotFound desc = could not find container \"0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e\": container with ID starting with 0d3483a37cda85df36409543e5283224305500fd6adc6b922334c6bd08ecd72e not found: ID does not exist"
May 28 16:07:54.514773 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.514747    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bf9594d7f-rxx4t"]
May 28 16:07:54.518097 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:54.518076    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bf9594d7f-rxx4t"]
May 28 16:07:55.989390 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:07:55.989330    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b7408f-4f97-486a-93db-b55cd0b7bbea" path="/var/lib/kubelet/pods/c7b7408f-4f97-486a-93db-b55cd0b7bbea/volumes"
May 28 16:10:01.884641 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:10:01.884612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:10:01.885115 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:10:01.884614    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:10:01.889013 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:10:01.888991    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:10:01.889140 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:10:01.888991    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:12:11.212182 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.212149    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-ggv28"]
May 28 16:12:11.212628 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.212529    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b7408f-4f97-486a-93db-b55cd0b7bbea" containerName="console"
May 28 16:12:11.212628 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.212543    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b7408f-4f97-486a-93db-b55cd0b7bbea" containerName="console"
May 28 16:12:11.212628 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.212617    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="c7b7408f-4f97-486a-93db-b55cd0b7bbea" containerName="console"
May 28 16:12:11.214556 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.214538    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ggv28"
May 28 16:12:11.217205 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.217180    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 16:12:11.217205 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.217195    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-d2kwf\""
May 28 16:12:11.218379 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.218361    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 28 16:12:11.218493 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.218362    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 16:12:11.221772 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.221742    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ggv28"]
May 28 16:12:11.305744 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.305706    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddws\" (UniqueName: \"kubernetes.io/projected/4833296c-2dce-4516-a933-4ff7c209b46f-kube-api-access-wddws\") pod \"feast-test-apply-ggv28\" (UID: \"4833296c-2dce-4516-a933-4ff7c209b46f\") " pod="test-ns-feast/feast-test-apply-ggv28"
May 28 16:12:11.406290 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.406254    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wddws\" (UniqueName: \"kubernetes.io/projected/4833296c-2dce-4516-a933-4ff7c209b46f-kube-api-access-wddws\") pod \"feast-test-apply-ggv28\" (UID: \"4833296c-2dce-4516-a933-4ff7c209b46f\") " pod="test-ns-feast/feast-test-apply-ggv28"
May 28 16:12:11.414750 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.414720    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddws\" (UniqueName: \"kubernetes.io/projected/4833296c-2dce-4516-a933-4ff7c209b46f-kube-api-access-wddws\") pod \"feast-test-apply-ggv28\" (UID: \"4833296c-2dce-4516-a933-4ff7c209b46f\") " pod="test-ns-feast/feast-test-apply-ggv28"
May 28 16:12:11.533773 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.533744    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ggv28"
May 28 16:12:11.661809 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:11.661782    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ggv28"]
May 28 16:12:11.663947 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:12:11.663917    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4833296c_2dce_4516_a933_4ff7c209b46f.slice/crio-11d03a00ac8db5b53fefbdce3ba482a078bd457cb884570afd849875584834fd WatchSource:0}: Error finding container 11d03a00ac8db5b53fefbdce3ba482a078bd457cb884570afd849875584834fd: Status 404 returned error can't find the container with id 11d03a00ac8db5b53fefbdce3ba482a078bd457cb884570afd849875584834fd
May 28 16:12:12.257143 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:12.257101    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ggv28" event={"ID":"4833296c-2dce-4516-a933-4ff7c209b46f","Type":"ContainerStarted","Data":"11d03a00ac8db5b53fefbdce3ba482a078bd457cb884570afd849875584834fd"}
May 28 16:12:17.275800 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:17.275759    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ggv28" event={"ID":"4833296c-2dce-4516-a933-4ff7c209b46f","Type":"ContainerStarted","Data":"58786628c6a62c51ad731dedea08daf8634331e9448d64ce7ef1dbbfbc94bcb3"}
May 28 16:12:24.298265 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:24.298230    2569 generic.go:358] "Generic (PLEG): container finished" podID="4833296c-2dce-4516-a933-4ff7c209b46f" containerID="58786628c6a62c51ad731dedea08daf8634331e9448d64ce7ef1dbbfbc94bcb3" exitCode=0
May 28 16:12:24.298634 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:24.298278    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ggv28" event={"ID":"4833296c-2dce-4516-a933-4ff7c209b46f","Type":"ContainerDied","Data":"58786628c6a62c51ad731dedea08daf8634331e9448d64ce7ef1dbbfbc94bcb3"}
May 28 16:12:24.306333 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:24.306311    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:12:25.303031 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:25.302996    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ggv28" event={"ID":"4833296c-2dce-4516-a933-4ff7c209b46f","Type":"ContainerStarted","Data":"6c2bfef9f948ad6cc2aae5d12581d7c7be905199121fbd2e064fc86a14c581ab"}
May 28 16:12:25.319890 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:25.319837    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-ggv28" podStartSLOduration=9.125916263 podStartE2EDuration="14.31982189s" podCreationTimestamp="2026-05-28 16:12:11 +0000 UTC" firstStartedPulling="2026-05-28 16:12:11.665628387 +0000 UTC m=+730.285691162" lastFinishedPulling="2026-05-28 16:12:16.859534004 +0000 UTC m=+735.479596789" observedRunningTime="2026-05-28 16:12:25.318409316 +0000 UTC m=+743.938472110" watchObservedRunningTime="2026-05-28 16:12:25.31982189 +0000 UTC m=+743.939884687"
May 28 16:12:34.331924 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:34.331884    2569 generic.go:358] "Generic (PLEG): container finished" podID="4833296c-2dce-4516-a933-4ff7c209b46f" containerID="6c2bfef9f948ad6cc2aae5d12581d7c7be905199121fbd2e064fc86a14c581ab" exitCode=0
May 28 16:12:34.332362 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:34.331959    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ggv28" event={"ID":"4833296c-2dce-4516-a933-4ff7c209b46f","Type":"ContainerDied","Data":"6c2bfef9f948ad6cc2aae5d12581d7c7be905199121fbd2e064fc86a14c581ab"}
May 28 16:12:35.468607 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:35.468581    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ggv28"
May 28 16:12:35.509952 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:35.509917    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wddws\" (UniqueName: \"kubernetes.io/projected/4833296c-2dce-4516-a933-4ff7c209b46f-kube-api-access-wddws\") pod \"4833296c-2dce-4516-a933-4ff7c209b46f\" (UID: \"4833296c-2dce-4516-a933-4ff7c209b46f\") "
May 28 16:12:35.512044 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:35.512016    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4833296c-2dce-4516-a933-4ff7c209b46f-kube-api-access-wddws" (OuterVolumeSpecName: "kube-api-access-wddws") pod "4833296c-2dce-4516-a933-4ff7c209b46f" (UID: "4833296c-2dce-4516-a933-4ff7c209b46f"). InnerVolumeSpecName "kube-api-access-wddws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:12:35.611104 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:35.611019    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wddws\" (UniqueName: \"kubernetes.io/projected/4833296c-2dce-4516-a933-4ff7c209b46f-kube-api-access-wddws\") on node \"ip-10-0-129-162.ec2.internal\" DevicePath \"\""
May 28 16:12:36.339364 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:36.339314    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ggv28" event={"ID":"4833296c-2dce-4516-a933-4ff7c209b46f","Type":"ContainerDied","Data":"11d03a00ac8db5b53fefbdce3ba482a078bd457cb884570afd849875584834fd"}
May 28 16:12:36.339364 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:36.339337    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ggv28"
May 28 16:12:36.339364 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:36.339368    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11d03a00ac8db5b53fefbdce3ba482a078bd457cb884570afd849875584834fd"
May 28 16:12:36.509217 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:36.509187    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ggv28_4833296c-2dce-4516-a933-4ff7c209b46f/feast-0/0.log"
May 28 16:12:36.515656 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:12:36.515612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ggv28_4833296c-2dce-4516-a933-4ff7c209b46f/feast-1/0.log"
May 28 16:13:13.301115 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:13:13.301032    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-ggv28"]
May 28 16:13:13.311000 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:13:13.310973    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-ggv28"]
May 28 16:13:13.989272 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:13:13.989239    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4833296c-2dce-4516-a933-4ff7c209b46f" path="/var/lib/kubelet/pods/4833296c-2dce-4516-a933-4ff7c209b46f/volumes"
May 28 16:15:01.906688 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:15:01.906660    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:15:01.907215 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:15:01.907183    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:15:01.911180 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:15:01.911158    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:15:01.911890 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:15:01.911871    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:19:01.942850 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:19:01.942819    2569 scope.go:117] "RemoveContainer" containerID="6c2bfef9f948ad6cc2aae5d12581d7c7be905199121fbd2e064fc86a14c581ab"
May 28 16:19:01.950273 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:19:01.950252    2569 scope.go:117] "RemoveContainer" containerID="58786628c6a62c51ad731dedea08daf8634331e9448d64ce7ef1dbbfbc94bcb3"
May 28 16:20:01.928399 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:20:01.928364    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:20:01.929622 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:20:01.929601    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:20:01.932869 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:20:01.932852    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:20:01.934059 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:20:01.934036    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:25:01.950060 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:25:01.950012    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:25:01.952810 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:25:01.952786    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:25:01.954562 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:25:01.954541    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:25:01.957341 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:25:01.957323    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:29:08.359260 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:08.359227    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vfxzx_e64005b2-452b-4617-9130-22fff0333b34/global-pull-secret-syncer/0.log"
May 28 16:29:08.409507 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:08.409461    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8zhdh_bb9b4ec6-759c-46fa-a9c3-9f2fcd14bd59/konnectivity-agent/0.log"
May 28 16:29:08.501827 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:08.501796    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-162.ec2.internal_f924e8114472614b63d1d03a6fe2dc94/haproxy/0.log"
May 28 16:29:11.745977 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:11.745927    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/1.log"
May 28 16:29:11.821101 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:11.821014    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hvgpp_110ab087-4c08-4d4c-bbd5-a2af80b54ad7/cluster-monitoring-operator/0.log"
May 28 16:29:11.845628 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:11.845602    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-5tqgb_d3570778-39c2-4ec8-bb70-b37cbe9e0dc4/kube-state-metrics/0.log"
May 28 16:29:11.868601 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:11.868573    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-5tqgb_d3570778-39c2-4ec8-bb70-b37cbe9e0dc4/kube-rbac-proxy-main/0.log"
May 28 16:29:11.890992 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:11.890971    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-5tqgb_d3570778-39c2-4ec8-bb70-b37cbe9e0dc4/kube-rbac-proxy-self/0.log"
May 28 16:29:11.916988 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:11.916961    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f79c88cb7-69cqn_63f268b9-49fd-4699-95dc-ca7ef6bbd049/metrics-server/0.log"
May 28 16:29:11.942789 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:11.941544    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-8k7sh_db7a374c-429c-460d-bf74-a95192214731/monitoring-plugin/0.log"
May 28 16:29:12.134918 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.134841    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z49p6_91e9c563-eaa6-4c13-a14b-5799de06bccd/node-exporter/0.log"
May 28 16:29:12.154465 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.154438    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z49p6_91e9c563-eaa6-4c13-a14b-5799de06bccd/kube-rbac-proxy/0.log"
May 28 16:29:12.174723 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.174695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z49p6_91e9c563-eaa6-4c13-a14b-5799de06bccd/init-textfile/0.log"
May 28 16:29:12.200467 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.200439    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-xsn59_b46a6386-37de-4806-975d-e5e4333f2e99/kube-rbac-proxy-main/0.log"
May 28 16:29:12.219990 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.219967    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-xsn59_b46a6386-37de-4806-975d-e5e4333f2e99/kube-rbac-proxy-self/0.log"
May 28 16:29:12.244069 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.244041    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-xsn59_b46a6386-37de-4806-975d-e5e4333f2e99/openshift-state-metrics/0.log"
May 28 16:29:12.276775 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.276736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3e5ad29-70a6-4411-90e1-90c4b9b748af/prometheus/0.log"
May 28 16:29:12.298370 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.298324    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3e5ad29-70a6-4411-90e1-90c4b9b748af/config-reloader/0.log"
May 28 16:29:12.321343 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.321313    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3e5ad29-70a6-4411-90e1-90c4b9b748af/thanos-sidecar/0.log"
May 28 16:29:12.343773 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.343746    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3e5ad29-70a6-4411-90e1-90c4b9b748af/kube-rbac-proxy-web/0.log"
May 28 16:29:12.363729 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.363704    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3e5ad29-70a6-4411-90e1-90c4b9b748af/kube-rbac-proxy/0.log"
May 28 16:29:12.384256 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.384232    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3e5ad29-70a6-4411-90e1-90c4b9b748af/kube-rbac-proxy-thanos/0.log"
May 28 16:29:12.405109 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.405038    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b3e5ad29-70a6-4411-90e1-90c4b9b748af/init-config-reloader/0.log"
May 28 16:29:12.476226 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.476198    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-4458f_0f8d506a-4ad8-4746-b36f-4e02156f2cda/prometheus-operator-admission-webhook/0.log"
May 28 16:29:12.584065 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.584037    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-594884f89d-9gcfb_238569eb-ded3-4e16-8f17-7c176a4fd24f/thanos-query/0.log"
May 28 16:29:12.605366 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.605321    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-594884f89d-9gcfb_238569eb-ded3-4e16-8f17-7c176a4fd24f/kube-rbac-proxy-web/0.log"
May 28 16:29:12.626844 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.626811    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-594884f89d-9gcfb_238569eb-ded3-4e16-8f17-7c176a4fd24f/kube-rbac-proxy/0.log"
May 28 16:29:12.646189 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.646161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-594884f89d-9gcfb_238569eb-ded3-4e16-8f17-7c176a4fd24f/prom-label-proxy/0.log"
May 28 16:29:12.669666 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.669644    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-594884f89d-9gcfb_238569eb-ded3-4e16-8f17-7c176a4fd24f/kube-rbac-proxy-rules/0.log"
May 28 16:29:12.694482 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:12.694457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-594884f89d-9gcfb_238569eb-ded3-4e16-8f17-7c176a4fd24f/kube-rbac-proxy-metrics/0.log"
May 28 16:29:14.555003 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:14.554976    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54c9f98fd7-m9f88_9f3e0b1e-6710-47b8-884c-12b23090c132/console/0.log"
May 28 16:29:15.003719 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.003638    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"]
May 28 16:29:15.003997 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.003984    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4833296c-2dce-4516-a933-4ff7c209b46f" containerName="feast-0"
May 28 16:29:15.004040 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.003999    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4833296c-2dce-4516-a933-4ff7c209b46f" containerName="feast-0"
May 28 16:29:15.004040 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.004015    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4833296c-2dce-4516-a933-4ff7c209b46f" containerName="feast-1"
May 28 16:29:15.004040 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.004021    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4833296c-2dce-4516-a933-4ff7c209b46f" containerName="feast-1"
May 28 16:29:15.004128 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.004072    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="4833296c-2dce-4516-a933-4ff7c209b46f" containerName="feast-1"
May 28 16:29:15.008745 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.008717    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.012867 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.012840    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r7qnr\"/\"openshift-service-ca.crt\""
May 28 16:29:15.012867 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.012859    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r7qnr\"/\"kube-root-ca.crt\""
May 28 16:29:15.014096 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.014074    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r7qnr\"/\"default-dockercfg-j8rbg\""
May 28 16:29:15.015923 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.015900    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"]
May 28 16:29:15.082897 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.082861    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-lib-modules\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.083076 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.082910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-sys\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.083076 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.082934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2k97\" (UniqueName: \"kubernetes.io/projected/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-kube-api-access-z2k97\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.083076 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.082992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-podres\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.083076 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.083030    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-proc\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184483 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184441    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-proc\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184621 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184508    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-lib-modules\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184621 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184544    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-sys\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184621 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-proc\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184621 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184574    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2k97\" (UniqueName: \"kubernetes.io/projected/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-kube-api-access-z2k97\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184746 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184634    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-sys\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184746 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184646    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-podres\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184746 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184688    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-lib-modules\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.184746 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.184720    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-podres\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.192407 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.192381    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2k97\" (UniqueName: \"kubernetes.io/projected/9fc0fad1-17ce-4b0d-bbe1-f848a0206750-kube-api-access-z2k97\") pod \"perf-node-gather-daemonset-llvgz\" (UID: \"9fc0fad1-17ce-4b0d-bbe1-f848a0206750\") " pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.321151 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.321116    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:15.447381 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.447331    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"]
May 28 16:29:15.450724 ip-10-0-129-162 kubenswrapper[2569]: W0528 16:29:15.450679    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fc0fad1_17ce_4b0d_bbe1_f848a0206750.slice/crio-3836a64b4de77d2626bd94530508b3b0bae8df8763a2cb7462a4162e20275776 WatchSource:0}: Error finding container 3836a64b4de77d2626bd94530508b3b0bae8df8763a2cb7462a4162e20275776: Status 404 returned error can't find the container with id 3836a64b4de77d2626bd94530508b3b0bae8df8763a2cb7462a4162e20275776
May 28 16:29:15.452518 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.452501    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:29:15.624710 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.624637    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ffj8h_df192315-bb48-45c5-b0e5-65126b2e140a/dns/0.log"
May 28 16:29:15.649105 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.649074    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ffj8h_df192315-bb48-45c5-b0e5-65126b2e140a/kube-rbac-proxy/0.log"
May 28 16:29:15.706151 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:15.706124    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h9dbh_5ddf9f40-bd0e-4533-801f-1ebd1d67e9ce/dns-node-resolver/0.log"
May 28 16:29:16.107462 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:16.107432    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4qg6r_5947a6a7-d0ff-4a55-aae1-458c3de5fbdc/node-ca/0.log"
May 28 16:29:16.313564 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:16.313529    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz" event={"ID":"9fc0fad1-17ce-4b0d-bbe1-f848a0206750","Type":"ContainerStarted","Data":"be9aa14334be4eed3b4c8fd66fdeaf55cb0a6d1fa7251645799e6242eed56b77"}
May 28 16:29:16.313564 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:16.313565    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz" event={"ID":"9fc0fad1-17ce-4b0d-bbe1-f848a0206750","Type":"ContainerStarted","Data":"3836a64b4de77d2626bd94530508b3b0bae8df8763a2cb7462a4162e20275776"}
May 28 16:29:16.313758 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:16.313662    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:16.329225 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:16.329161    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz" podStartSLOduration=2.329145201 podStartE2EDuration="2.329145201s" podCreationTimestamp="2026-05-28 16:29:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:29:16.328036777 +0000 UTC m=+1754.948099574" watchObservedRunningTime="2026-05-28 16:29:16.329145201 +0000 UTC m=+1754.949207989"
May 28 16:29:16.788215 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:16.788186    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-646659fbd6-gztfn_d94218ef-2ca8-463d-94ff-4019d77e3273/router/0.log"
May 28 16:29:17.115315 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:17.115239    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmtj4_8c07099c-979a-4281-b39e-ce93481a20dd/serve-healthcheck-canary/0.log"
May 28 16:29:17.526481 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:17.526453    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dkpt5_6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3/kube-rbac-proxy/0.log"
May 28 16:29:17.545473 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:17.545442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dkpt5_6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3/exporter/0.log"
May 28 16:29:17.565137 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:17.565107    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dkpt5_6acfce26-3d6f-4ac3-9c95-aeb564d3e0b3/extractor/0.log"
May 28 16:29:21.440416 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:21.440390    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-j2zhl_ff9d2ef8-c6d4-451c-95fc-0158c8200e13/migrator/0.log"
May 28 16:29:21.458881 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:21.458858    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-j2zhl_ff9d2ef8-c6d4-451c-95fc-0158c8200e13/graceful-termination/0.log"
May 28 16:29:22.326496 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:22.326469    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r7qnr/perf-node-gather-daemonset-llvgz"
May 28 16:29:23.024965 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.024939    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5zqc_5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85/kube-multus-additional-cni-plugins/0.log"
May 28 16:29:23.045636 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.045611    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5zqc_5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85/egress-router-binary-copy/0.log"
May 28 16:29:23.065844 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.065819    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5zqc_5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85/cni-plugins/0.log"
May 28 16:29:23.088771 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.088742    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5zqc_5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85/bond-cni-plugin/0.log"
May 28 16:29:23.110149 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.110123    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5zqc_5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85/routeoverride-cni/0.log"
May 28 16:29:23.130690 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.130661    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5zqc_5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85/whereabouts-cni-bincopy/0.log"
May 28 16:29:23.151121 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.151093    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5zqc_5d68fa3a-13ae-4126-8e5a-b09b2d8e3e85/whereabouts-cni/0.log"
May 28 16:29:23.182092 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.182066    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-crxmj_1d07df59-b2b2-41cf-ad45-87f59accfcb1/kube-multus/0.log"
May 28 16:29:23.297875 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.297789    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kts5f_81550bb3-ca36-4a57-9717-e0f1aa3bf42b/network-metrics-daemon/0.log"
May 28 16:29:23.317912 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:23.317883    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kts5f_81550bb3-ca36-4a57-9717-e0f1aa3bf42b/kube-rbac-proxy/0.log"
May 28 16:29:24.172762 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.172733    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-controller/0.log"
May 28 16:29:24.196636 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.196610    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/0.log"
May 28 16:29:24.204437 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.204415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovn-acl-logging/1.log"
May 28 16:29:24.223986 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.223953    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/kube-rbac-proxy-node/0.log"
May 28 16:29:24.246610 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.246574    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/kube-rbac-proxy-ovn-metrics/0.log"
May 28 16:29:24.266939 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.266869    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/northd/0.log"
May 28 16:29:24.293293 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.293266    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/nbdb/0.log"
May 28 16:29:24.314930 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.314901    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/sbdb/0.log"
May 28 16:29:24.408183 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:24.408153    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5z2kh_de5e856f-d624-4277-b328-654d0c5f92f7/ovnkube-controller/0.log"
May 28 16:29:26.015404 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:26.015374    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zx25w_d00f2fd4-46f3-4b34-97a9-f7231291f9a0/network-check-target-container/0.log"
May 28 16:29:26.866935 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:26.866905    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8pln9_c9798092-6dc7-41c1-891a-4c5c71d35ad0/iptables-alerter/0.log"
May 28 16:29:27.458325 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:27.458294    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lf6b5_c9d111b1-ab4e-4450-af5b-a107d85fedb6/tuned/0.log"
May 28 16:29:29.893288 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:29.893256    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-lqvm4_575a9c9c-d387-45cf-97dd-92edc864214e/service-ca-operator/1.log"
May 28 16:29:29.894099 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:29.894081    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-lqvm4_575a9c9c-d387-45cf-97dd-92edc864214e/service-ca-operator/0.log"
May 28 16:29:30.170128 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:30.170046    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-ghwff_cfe3ad3f-ffcf-403b-99bb-67af7b03bb6b/service-ca-controller/0.log"
May 28 16:29:30.529742 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:30.529711    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-7ng8h_5a806bb5-7457-4709-a2e9-b99bfff01dd6/csi-driver/0.log"
May 28 16:29:30.551412 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:30.551386    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-7ng8h_5a806bb5-7457-4709-a2e9-b99bfff01dd6/csi-node-driver-registrar/0.log"
May 28 16:29:30.571599 ip-10-0-129-162 kubenswrapper[2569]: I0528 16:29:30.571561    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-7ng8h_5a806bb5-7457-4709-a2e9-b99bfff01dd6/csi-liveness-probe/0.log"