May 21 15:13:17.809742 ip-10-0-134-80 systemd[1]: Starting Kubernetes Kubelet...
May 21 15:13:18.269828 ip-10-0-134-80 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:13:18.269828 ip-10-0-134-80 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 15:13:18.269828 ip-10-0-134-80 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:13:18.269828 ip-10-0-134-80 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 15:13:18.269828 ip-10-0-134-80 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:13:18.272194 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.272098    2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 15:13:18.276579 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276552    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:13:18.276579 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276571    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:13:18.276579 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276575    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:13:18.276579 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276579    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:13:18.276579 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276582    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:13:18.276579 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276585    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:13:18.276579 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276588    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276591    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276595    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276598    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276600    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276603    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276605    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276608    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276610    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276613    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276615    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276618    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276620    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276624    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276629    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276632    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276636    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276640    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276643    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276646    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:13:18.276848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276649    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276651    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276654    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276657    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276660    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276663    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276677    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276680    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276683    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276685    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276688    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276690    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276693    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276696    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276701    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276706    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276709    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276712    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276715    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276718    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:13:18.277462 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276720    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276723    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276725    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276728    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276730    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276733    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276738    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276741    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276744    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276746    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276749    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276751    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276754    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276756    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276759    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276761    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276764    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276766    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276769    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:13:18.277945 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276771    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276774    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276777    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276781    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276783    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276786    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276789    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276793    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276796    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276799    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276801    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276803    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276806    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276810    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276813    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276816    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276818    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276821    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276823    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276826    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:13:18.278400 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.276828    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277221    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277227    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277229    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277232    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277235    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277238    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277240    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277245    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277249    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277251    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277254    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277257    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277261    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277263    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277266    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277268    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277271    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277273    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277277    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:13:18.278902 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277280    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277283    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277285    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277288    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277290    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277294    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277297    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277299    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277301    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277304    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277306    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277308    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277311    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277313    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277316    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277318    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277320    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277323    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277325    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277327    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:13:18.279382 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277330    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277332    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277335    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277338    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277341    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277343    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277346    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277348    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277351    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277353    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277356    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277359    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277361    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277363    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277366    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277368    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277370    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277373    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277376    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:13:18.279941 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277378    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277381    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277383    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277386    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277388    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277390    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277393    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277395    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277398    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277401    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277403    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277406    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277408    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277411    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277413    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277416    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277434    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277437    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277439    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277443    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:13:18.280397 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277446    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277448    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277451    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277454    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277456    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277459    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277461    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.277465    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277542    2563 flags.go:64] FLAG: --address="0.0.0.0"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277550    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277557    2563 flags.go:64] FLAG: --anonymous-auth="true"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277569    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277575    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277579    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277583    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277588    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277591    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277594    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277597    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277603    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277606    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277609    2563 flags.go:64] FLAG: --cgroup-root=""
May 21 15:13:18.280909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277612    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277615    2563 flags.go:64] FLAG: --client-ca-file=""
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277618    2563 flags.go:64] FLAG: --cloud-config=""
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277621    2563 flags.go:64] FLAG: --cloud-provider="external"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277624    2563 flags.go:64] FLAG: --cluster-dns="[]"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277629    2563 flags.go:64] FLAG: --cluster-domain=""
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277632    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277635    2563 flags.go:64] FLAG: --config-dir=""
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277638    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277642    2563 flags.go:64] FLAG: --container-log-max-files="5"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277645    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277649    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277652    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277655    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277658    2563 flags.go:64] FLAG: --contention-profiling="false"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277661    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277664    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277666    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277669    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277673    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277676    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277679    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277682    2563 flags.go:64] FLAG: --enable-load-reader="false"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277685    2563 flags.go:64] FLAG: --enable-server="true"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277688    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 15:13:18.281456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277692    2563 flags.go:64] FLAG: --event-burst="100"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277695    2563 flags.go:64] FLAG: --event-qps="50"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277698    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277701    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277706    2563 flags.go:64] FLAG: --eviction-hard=""
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277710    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277712    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277715    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277718    2563 flags.go:64] FLAG: --eviction-soft=""
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277721    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277724    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277729    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277732    2563 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277734    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277737    2563 flags.go:64] FLAG: --fail-swap-on="true"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277740    2563 flags.go:64] FLAG: --feature-gates=""
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277744    2563 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277747    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277750    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277753    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277755    2563 flags.go:64] FLAG: --healthz-port="10248"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277759    2563 flags.go:64] FLAG: --help="false"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277761    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-80.ec2.internal"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277764    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 15:13:18.282055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277767    2563 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277770    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277773    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277776    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277779    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277782    2563 flags.go:64] FLAG: --image-service-endpoint=""
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277784    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277787    2563 flags.go:64] FLAG: --kube-api-burst="100"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277791    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277795    2563 flags.go:64] FLAG: --kube-api-qps="50"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277797    2563 flags.go:64] FLAG: --kube-reserved=""
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277800    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277804    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277807    2563 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277810    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277812    2563 flags.go:64] FLAG: --lock-file=""
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277815    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277818    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277821    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277828    2563 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277831    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277833    2563 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277836    2563 flags.go:64] FLAG: --logging-format="text"
May 21 15:13:18.282649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277839    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277842    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277845    2563 flags.go:64] FLAG: --manifest-url=""
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277848    2563 flags.go:64] FLAG: --manifest-url-header=""
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277854    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277857    2563 flags.go:64] FLAG: --max-open-files="1000000"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277861    2563 flags.go:64] FLAG: --max-pods="110"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277865    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277867    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277870    2563 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277873    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277876    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277879    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277882    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277889    2563 flags.go:64] FLAG: --node-status-max-images="50"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277892    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277895    2563 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277899    2563 flags.go:64] FLAG: --pod-cidr=""
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277902    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277908    2563 flags.go:64] FLAG: --pod-manifest-path=""
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277910    2563 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277916    2563 flags.go:64] FLAG: --pods-per-core="0"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277919    2563 flags.go:64] FLAG: --port="10250"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277922    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 15:13:18.283203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277925    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c301dcaf1a68cc9"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277928    2563 flags.go:64] FLAG: --qos-reserved=""
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277931    2563 flags.go:64] FLAG: --read-only-port="10255"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277934    2563 flags.go:64] FLAG: --register-node="true"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277936    2563 flags.go:64] FLAG: --register-schedulable="true"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277940    2563 flags.go:64] FLAG: --register-with-taints=""
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277944    2563 flags.go:64] FLAG: --registry-burst="10"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277947    2563 flags.go:64] FLAG: --registry-qps="5"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277949    2563 flags.go:64] FLAG: --reserved-cpus=""
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277952    2563 flags.go:64] FLAG: --reserved-memory=""
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277956    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277960    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277962    2563 flags.go:64] FLAG: --rotate-certificates="false"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277965    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277968    2563 flags.go:64] FLAG: --runonce="false"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277971    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277974    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277977    2563 flags.go:64] FLAG: --seccomp-default="false"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277980    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277982    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277985    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277988    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277991    2563 flags.go:64] FLAG: --storage-driver-password="root"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277993    2563 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277996    2563 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.277999    2563 flags.go:64] FLAG: --storage-driver-user="root"
May 21 15:13:18.283860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278002    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278005    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278009    2563 flags.go:64] FLAG: --system-cgroups=""
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278012    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278017    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278020    2563 flags.go:64] FLAG: --tls-cert-file=""
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278023    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278027    2563 flags.go:64] FLAG: --tls-min-version=""
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278029    2563 flags.go:64] FLAG: --tls-private-key-file=""
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278032    2563 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278035    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278039    2563 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278042    2563 flags.go:64] FLAG: --v="2"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278046    2563 flags.go:64] FLAG: --version="false"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278050    2563 flags.go:64] FLAG: --vmodule=""
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278053    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278056    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278144    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278148    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278151    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278154    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278157    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278160    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:13:18.284490 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278163    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278165    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278168    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278171    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278173    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278175    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278178    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278180    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278182    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278185    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278188    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278190    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278194    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278197    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278199    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278201    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278204    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278206    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278209    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278211    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:13:18.285076 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278214    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278217    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278220    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278222    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278224    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278227    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278229    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278231    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278234    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278237    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278239    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278241    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278244    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278246    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278249    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278251    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278253    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278256    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278258    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:13:18.286450 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278261    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278263    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278266    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278269    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278272    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278276    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278278    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278281    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278283    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278286    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278288    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278290    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278293    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278297    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278299    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278302    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278306    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278309    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278312    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:13:18.286926 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278314    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278317    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278320    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278322    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278325    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278327    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278329    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278332    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278334    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278336    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278339    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278341    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278344    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278346    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278350    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278354    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278357    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278360    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278364    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278367    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:13:18.287401 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278369    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.278372    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.278901    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.285230    2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.285248    2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285298    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285303    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285307    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285310    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285313    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285316    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285319    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285321    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285324    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285327    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285330    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:13:18.287953 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285332    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285335    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285337    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285340    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285342    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285345    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285348    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285350    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285353    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285356    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285358    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285361    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285364    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285367    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285370    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285373    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285375    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285378    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285380    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285383    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:13:18.288343 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285386    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285388    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285391    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285393    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285396    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285399    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285401    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285404    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285407    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285409    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285412    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285414    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285417    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285435    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285438    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285440    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285443    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285445    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285448    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285451    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:13:18.288862 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285454    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285459    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285462    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285465    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285467    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285470    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285473    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285476    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285479    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285481    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285484    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285488    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285492    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285495    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285499    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285502    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285505    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285508    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285511    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:13:18.289362 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285514    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285516    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285519    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285522    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285524    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285527    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285529    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285531    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285534    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285537    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285539    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285541    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285544    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285547    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285549    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:13:18.289847 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285552    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.285557    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285652    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285656    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285659    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285662    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285665    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285668    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285670    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285673    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285676    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285679    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285682    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285685    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285687    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:13:18.290213 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285689    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285692    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285694    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285697    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285699    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285702    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285704    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285707    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285709    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285712    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285715    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285717    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285719    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285722    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285724    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285727    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285731    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285734    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285737    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285740    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:13:18.290617 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285743    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285746    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285748    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285751    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285755    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285758    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285761    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285764    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285767    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285770    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285772    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285775    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285777    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285780    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285783    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285785    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285788    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285791    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285794    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285797    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:13:18.291094 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285799    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285802    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285805    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285807    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285810    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285812    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285815    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285817    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285820    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285822    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285825    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285828    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285830    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285833    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285835    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285838    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285840    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285843    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285846    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285849    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:13:18.291602 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285851    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285854    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285856    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285858    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285861    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285863    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285866    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285868    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285871    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285873    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285876    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285878    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:18.285881    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.285886    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.286679    2563 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 15:13:18.292084 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.290088    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 15:13:18.292529 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.291819    2563 server.go:1019] "Starting client certificate rotation"
May 21 15:13:18.292529 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.291921    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 15:13:18.292529 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.291958    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 15:13:18.315206 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.315180    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 15:13:18.319143 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.319121    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 15:13:18.335198 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.335173    2563 log.go:25] "Validated CRI v1 runtime API"
May 21 15:13:18.341015 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.340996    2563 log.go:25] "Validated CRI v1 image API"
May 21 15:13:18.342604 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.342588    2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 15:13:18.347014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.346992    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 15:13:18.347719 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.347685    2563 fs.go:135] Filesystem UUIDs: map[091e0cb8-37c2-4ebd-99d6-ff366dc8cac0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d6fccb38-abc5-4aa1-b4d7-6e9133f42b6b:/dev/nvme0n1p4]
May 21 15:13:18.347810 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.347717    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 15:13:18.352160 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.352031    2563 manager.go:217] Machine: {Timestamp:2026-05-21 15:13:18.351518727 +0000 UTC m=+0.424834853 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099573 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20c88e3c1421773ee1c954b58b4d7d SystemUUID:ec20c88e-3c14-2177-3ee1-c954b58b4d7d BootID:e001ad74-eeb9-4869-90c3-504b6437be78 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:bb:50:3c:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:bb:50:3c:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:a1:7d:13:d3:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 15:13:18.352780 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.352766    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 15:13:18.352940 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.352922    2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 15:13:18.353897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.353867    2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 15:13:18.354066 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.353898    2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 15:13:18.354142 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.354082    2563 topology_manager.go:138] "Creating topology manager with none policy"
May 21 15:13:18.354142 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.354096    2563 container_manager_linux.go:306] "Creating device plugin manager"
May 21 15:13:18.354142 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.354106    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 15:13:18.354838 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.354826    2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 15:13:18.356414 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.356401    2563 state_mem.go:36] "Initialized new in-memory state store"
May 21 15:13:18.356574 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.356562    2563 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 15:13:18.358543 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.358531    2563 kubelet.go:491] "Attempting to sync node with API server"
May 21 15:13:18.358602 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.358551    2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 15:13:18.358602 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.358568    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 15:13:18.358602 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.358582    2563 kubelet.go:397] "Adding apiserver pod source"
May 21 15:13:18.358602 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.358594    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 15:13:18.359668 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.359654    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 15:13:18.359731 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.359676    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 15:13:18.362503 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.362487    2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 15:13:18.366003 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.365983    2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 15:13:18.366816 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366803    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 15:13:18.366897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366823    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 15:13:18.366897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366874    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 15:13:18.366990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366922    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 15:13:18.366990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366944    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 15:13:18.366990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366955    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 15:13:18.366990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366965    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 15:13:18.366990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366973    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 15:13:18.366990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366983    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 15:13:18.366990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.366992    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 15:13:18.367213 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.367014    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 15:13:18.367213 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.367128    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 15:13:18.368084 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.368071    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 15:13:18.368148 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.368087    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 15:13:18.368621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.368600    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kj6q5"
May 21 15:13:18.369661 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.369606    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 15:13:18.369991 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.369970    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 15:13:18.372267 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.372251    2563 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 15:13:18.372343 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.372297    2563 server.go:1295] "Started kubelet"
May 21 15:13:18.372435 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.372376    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 15:13:18.372522 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.372414    2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 15:13:18.372522 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.372506    2563 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 15:13:18.373375 ip-10-0-134-80 systemd[1]: Started Kubernetes Kubelet.
May 21 15:13:18.373968 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.373527    2563 server.go:317] "Adding debug handlers to kubelet server"
May 21 15:13:18.373968 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.373552    2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 15:13:18.376849 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.376831    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kj6q5"
May 21 15:13:18.378444 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.378391    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 15:13:18.378662 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.378636    2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 15:13:18.378823 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.378796    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 15:13:18.379023 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379009    2563 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 15:13:18.379023 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379023    2563 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 15:13:18.379140 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379067    2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 15:13:18.379209 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379186    2563 reconstruct.go:97] "Volume reconstruction finished"
May 21 15:13:18.379209 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379200    2563 reconciler.go:26] "Reconciler: start to sync state"
May 21 15:13:18.379630 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379614    2563 factory.go:55] Registering systemd factory
May 21 15:13:18.379630 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.378674    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-80.ec2.internal.18b19d6822b15fda  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-80.ec2.internal,UID:ip-10-0-134-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-80.ec2.internal,},FirstTimestamp:2026-05-21 15:13:18.372265946 +0000 UTC m=+0.445582075,LastTimestamp:2026-05-21 15:13:18.372265946 +0000 UTC m=+0.445582075,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-80.ec2.internal,}"
May 21 15:13:18.379767 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379658    2563 factory.go:223] Registration of the systemd container factory successfully
May 21 15:13:18.379858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379846    2563 factory.go:153] Registering CRI-O factory
May 21 15:13:18.379858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379858    2563 factory.go:223] Registration of the crio container factory successfully
May 21 15:13:18.379949 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379909    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 15:13:18.379949 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379929    2563 factory.go:103] Registering Raw factory
May 21 15:13:18.379949 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.379939    2563 manager.go:1196] Started watching for new ooms in manager
May 21 15:13:18.380485 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.380454    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:18.380571 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.380539    2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 15:13:18.380693 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.380679    2563 manager.go:319] Starting recovery of all containers
May 21 15:13:18.386333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.386182    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:13:18.388849 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.388823    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
May 21 15:13:18.393175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.393160    2563 manager.go:324] Recovery completed
May 21 15:13:18.399580 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.399564    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:13:18.401408 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.401392    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:13:18.401510 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.401438    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:13:18.401510 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.401453    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
May 21 15:13:18.402216 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.402198    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 15:13:18.402216 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.402215    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 15:13:18.402316 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.402233    2563 state_mem.go:36] "Initialized new in-memory state store"
May 21 15:13:18.404327 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.404315    2563 policy_none.go:49] "None policy: Start"
May 21 15:13:18.404370 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.404332    2563 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 15:13:18.404370 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.404343    2563 state_mem.go:35] "Initializing new in-memory state store"
May 21 15:13:18.443076 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.443051    2563 manager.go:341] "Starting Device Plugin manager"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.443093    2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.443106    2563 server.go:85] "Starting device plugin registration server"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.443455    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.443476    2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.443587    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.443660    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.443668    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.444949    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 15:13:18.455650 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.444985    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:18.517917 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.517877    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 15:13:18.519297 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.519284    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 15:13:18.519388 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.519305    2563 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 15:13:18.519388 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.519344    2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 15:13:18.519388 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.519355    2563 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 15:13:18.519543 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.519413    2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 15:13:18.526730 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.526677    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:13:18.543901 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.543882    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:13:18.544939 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.544921    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:13:18.545023 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.544953    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:13:18.545023 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.544962    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
May 21 15:13:18.545023 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.544988    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-80.ec2.internal"
May 21 15:13:18.553392 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.553378    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-80.ec2.internal"
May 21 15:13:18.553464 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.553400    2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-80.ec2.internal\": node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:18.572598 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.572575    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:18.619707 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.619649    2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"]
May 21 15:13:18.619779 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.619757    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:13:18.620700 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.620684    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:13:18.620756 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.620713    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:13:18.620756 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.620735    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
May 21 15:13:18.621961 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.621949    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:13:18.622167 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622152    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.622221 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622186    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:13:18.622672 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622639    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:13:18.622771 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622686    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:13:18.622771 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622698    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
May 21 15:13:18.622843 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622786    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:13:18.622843 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622814    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:13:18.622843 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.622825    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
May 21 15:13:18.623804 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.623791    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.623855 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.623816    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:13:18.624492 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.624476    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:13:18.624568 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.624504    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:13:18.624568 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.624515    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeHasSufficientPID"
May 21 15:13:18.645097 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.645076    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
May 21 15:13:18.649370 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.649354    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-80.ec2.internal\" not found" node="ip-10-0-134-80.ec2.internal"
May 21 15:13:18.673219 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.673198    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:18.680970 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.680947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6042397a9b9298ea910705e75aa9f94b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"6042397a9b9298ea910705e75aa9f94b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.681060 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.680988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6042397a9b9298ea910705e75aa9f94b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"6042397a9b9298ea910705e75aa9f94b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.681060 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.681015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b99ea0cca3367eddd43b660554c798c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"2b99ea0cca3367eddd43b660554c798c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.774171 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.774139    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:18.781571 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.781522    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b99ea0cca3367eddd43b660554c798c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"2b99ea0cca3367eddd43b660554c798c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.781571 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.781553    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6042397a9b9298ea910705e75aa9f94b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"6042397a9b9298ea910705e75aa9f94b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.781667 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.781578    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6042397a9b9298ea910705e75aa9f94b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"6042397a9b9298ea910705e75aa9f94b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.781667 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.781605    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6042397a9b9298ea910705e75aa9f94b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"6042397a9b9298ea910705e75aa9f94b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.781667 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.781619    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b99ea0cca3367eddd43b660554c798c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-80.ec2.internal\" (UID: \"2b99ea0cca3367eddd43b660554c798c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.781667 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.781628    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6042397a9b9298ea910705e75aa9f94b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal\" (UID: \"6042397a9b9298ea910705e75aa9f94b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.874907 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.874876    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:18.947389 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.947341    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.952104 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:18.952085    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
May 21 15:13:18.975135 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:18.975109    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:19.075773 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:19.075683    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:19.176186 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:19.176159    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:19.276700 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:19.276659    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:19.291092 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.291068    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 15:13:19.291228 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.291213    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 15:13:19.291265 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.291247    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 15:13:19.377730 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:19.377665    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:19.378773 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.378755    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 15:13:19.378925 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.378900    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 15:08:18 +0000 UTC" deadline="2027-11-25 01:29:09.948932444 +0000 UTC"
May 21 15:13:19.378956 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.378926    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13258h15m50.570008859s"
May 21 15:13:19.395292 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.395273    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 15:13:19.416007 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.415983    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnlgp"
May 21 15:13:19.423890 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.423870    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnlgp"
May 21 15:13:19.478471 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:19.478440    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-80.ec2.internal\" not found"
May 21 15:13:19.543262 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.543238    2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:13:19.545388 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:19.545345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6042397a9b9298ea910705e75aa9f94b.slice/crio-a8f4eb1032e7356936fa44040e7640f08c79bad70f39f45ed45aa8610b9f8c37 WatchSource:0}: Error finding container a8f4eb1032e7356936fa44040e7640f08c79bad70f39f45ed45aa8610b9f8c37: Status 404 returned error can't find the container with id a8f4eb1032e7356936fa44040e7640f08c79bad70f39f45ed45aa8610b9f8c37
May 21 15:13:19.545598 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:19.545577    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b99ea0cca3367eddd43b660554c798c.slice/crio-634f95b0a0af49290e32df28b3078c4c09351509280b77a38b635f38c6f23112 WatchSource:0}: Error finding container 634f95b0a0af49290e32df28b3078c4c09351509280b77a38b635f38c6f23112: Status 404 returned error can't find the container with id 634f95b0a0af49290e32df28b3078c4c09351509280b77a38b635f38c6f23112
May 21 15:13:19.549844 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.549822    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:13:19.580276 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.580259    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal"
May 21 15:13:19.593362 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.593343    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 15:13:19.594936 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.594924    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal"
May 21 15:13:19.603721 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.603706    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 15:13:19.908590 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:19.908541    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:13:20.150716 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.150683    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:13:20.359720 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.359635    2563 apiserver.go:52] "Watching apiserver"
May 21 15:13:20.364752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.364731    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:13:20.365441 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.365403    2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 15:13:20.367314 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.367288    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-4w244","kube-system/konnectivity-agent-jrmx5","kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls","openshift-cluster-node-tuning-operator/tuned-wgwdt","openshift-dns/node-resolver-vmq8h","openshift-multus/multus-8ft87","openshift-multus/network-metrics-daemon-xf7bw","openshift-network-diagnostics/network-check-target-tfs8h","openshift-image-registry/node-ca-68nzt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal","openshift-multus/multus-additional-cni-plugins-smww2","openshift-network-operator/iptables-alerter-vvf2n"]
May 21 15:13:20.369788 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.369760    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8ft87"
May 21 15:13:20.370976 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.370949    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.371076 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.371040    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.372272 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.372250    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 15:13:20.372705 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.372678    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qh82g\""
May 21 15:13:20.372892 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.372872    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 15:13:20.373339 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.373071    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 15:13:20.373570 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.373550    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 15:13:20.373740 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.373725    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 15:13:20.374004 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.373975    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 15:13:20.374194 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.374176    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 15:13:20.374920 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.374349    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 15:13:20.374920 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.374616    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.374920 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.374638    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jzt5z\""
May 21 15:13:20.374920 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.374745    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6gd4d\""
May 21 15:13:20.374920 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.374613    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 15:13:20.375828 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.375812    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.376017 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.375999    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.376779 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.376762    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 15:13:20.376885 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.376800    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b7wjb\""
May 21 15:13:20.377055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.377040    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 15:13:20.378033 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378014    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378382    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378449    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.378546    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378573    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378588    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378707    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378732    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378790    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378791    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378994    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8fwtv\""
May 21 15:13:20.379014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.378998    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k6l28\""
May 21 15:13:20.379900 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.379877    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:20.380001 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.379941    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:20.380001 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.379883    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.380942 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.380926    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.382030 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.381994    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 15:13:20.382152 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.382073    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.383347 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.383323    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 15:13:20.383625 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.383607    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 15:13:20.383757 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.383720    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bgst5\""
May 21 15:13:20.383837 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.383822    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 15:13:20.385457 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.384144    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 15:13:20.385457 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.384163    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8gchs\""
May 21 15:13:20.385457 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.384494    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 15:13:20.385457 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.384788    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 15:13:20.386080 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.385923    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2j948\""
May 21 15:13:20.386375 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.386360    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 15:13:20.387319 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa1679b9-82e5-444a-a890-1cda5c1baa85-hosts-file\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.387409 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-cni-bin\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387409 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-cni-multus\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387409 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-conf-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-registration-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.387587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-ovn\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.387587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa1679b9-82e5-444a-a890-1cda5c1baa85-tmp-dir\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.387587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-cni-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-cnibin\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-os-release\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-sys-fs\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-tuned\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bde814a-deda-4f36-9792-fdd6247c89c5-ovn-node-metrics-cert\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skhm\" (UniqueName: \"kubernetes.io/projected/aa1679b9-82e5-444a-a890-1cda5c1baa85-kube-api-access-9skhm\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-cni-binary-copy\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-kubernetes\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jc7d\" (UniqueName: \"kubernetes.io/projected/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-kube-api-access-5jc7d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrwx\" (UniqueName: \"kubernetes.io/projected/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-kube-api-access-lvrwx\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.387909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b074476-43a9-4d33-a0d7-7415b8398524-konnectivity-ca\") pod \"konnectivity-agent-jrmx5\" (UID: \"3b074476-43a9-4d33-a0d7-7415b8398524\") " pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysctl-conf\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-lib-modules\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.387974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-host\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-daemon-config\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-multus-certs\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-ovnkube-config\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysctl-d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-device-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-etc-selinux\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-log-socket\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-run\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-kubelet\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-var-lib-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-modprobe-d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-systemd\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-hostroot\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-slash\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-cni-netd\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b074476-43a9-4d33-a0d7-7415b8398524-agent-certs\") pod \"konnectivity-agent-jrmx5\" (UID: \"3b074476-43a9-4d33-a0d7-7415b8398524\") " pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q6kq\" (UniqueName: \"kubernetes.io/projected/57ac6b42-6423-40b8-8609-1ba404d0b21a-kube-api-access-8q6kq\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pqbv\" (UniqueName: \"kubernetes.io/projected/7bde814a-deda-4f36-9792-fdd6247c89c5-kube-api-access-2pqbv\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-tmp\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-socket-dir-parent\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.388695 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388733    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysconfig\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-var-lib-kubelet\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57ac6b42-6423-40b8-8609-1ba404d0b21a-host\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-netns\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-systemd-units\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-etc-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-node-log\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-ovnkube-script-lib\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.388974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-socket-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvvmp\" (UniqueName: \"kubernetes.io/projected/ea7de061-5a79-4ce7-ac08-fd4e271b0232-kube-api-access-mvvmp\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-kubelet\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-env-overrides\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvjl\" (UniqueName: \"kubernetes.io/projected/558c0f01-4351-454c-9ca8-0e6cf4bc0887-kube-api-access-9dvjl\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-etc-kubernetes\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-run-netns\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-cni-bin\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.389858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-sys\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.389858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57ac6b42-6423-40b8-8609-1ba404d0b21a-serviceca\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.389858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-system-cni-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.389858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-k8s-cni-cncf-io\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.389858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.389351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-systemd\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.425720 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.425689    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:08:19 +0000 UTC" deadline="2027-11-25 23:53:54.659519396 +0000 UTC"
May 21 15:13:20.425720 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.425719    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13280h40m34.233803798s"
May 21 15:13:20.480506 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.480465    2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 15:13:20.489580 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489554    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-device-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.489580 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489584    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-etc-selinux\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489608    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-log-socket\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489633    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-run\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-system-cni-dir\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0af8b152-1e09-41ec-a097-f55b4d6bc132-host-slash\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489689    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-device-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489711    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-kubelet\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489745    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-var-lib-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489759    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-run\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.489790 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489770    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-modprobe-d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489795    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-systemd\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489816    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-hostroot\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489838    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-slash\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489861    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-cni-netd\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489875    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-etc-selinux\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489885    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b074476-43a9-4d33-a0d7-7415b8398524-agent-certs\") pod \"konnectivity-agent-jrmx5\" (UID: \"3b074476-43a9-4d33-a0d7-7415b8398524\") " pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-log-socket\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489931    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8q6kq\" (UniqueName: \"kubernetes.io/projected/57ac6b42-6423-40b8-8609-1ba404d0b21a-kube-api-access-8q6kq\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489956    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pqbv\" (UniqueName: \"kubernetes.io/projected/7bde814a-deda-4f36-9792-fdd6247c89c5-kube-api-access-2pqbv\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489970    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-systemd\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.489980    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-tmp\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490036    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-kubelet\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490056    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-socket-dir-parent\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490079    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-var-lib-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.490189 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490089    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490121    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490150    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490169    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-modprobe-d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490174    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysconfig\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490196    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-var-lib-kubelet\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490220    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57ac6b42-6423-40b8-8609-1ba404d0b21a-host\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490239    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-hostroot\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490243    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-netns\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490287    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-systemd-units\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490332    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-etc-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490358    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-node-log\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490384    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-ovnkube-script-lib\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490409    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-socket-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490455    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvvmp\" (UniqueName: \"kubernetes.io/projected/ea7de061-5a79-4ce7-ac08-fd4e271b0232-kube-api-access-mvvmp\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490482    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-kubelet\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490508    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-env-overrides\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490534    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvjl\" (UniqueName: \"kubernetes.io/projected/558c0f01-4351-454c-9ca8-0e6cf4bc0887-kube-api-access-9dvjl\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490559    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-etc-kubernetes\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-etc-kubernetes\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490616    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-run-netns\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490666    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-slash\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490714    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-node-log\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490721    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-cni-netd\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490789    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-kubelet\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-socket-dir-parent\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490871    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-socket-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490290    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-netns\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490885    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-systemd-units\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490928    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-etc-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.490612    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-run-netns\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491194    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysconfig\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491204    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-var-lib-kubelet\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491213    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-cni-bin\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.491717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491224    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491252    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.491290    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.491397    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:20.991376771 +0000 UTC m=+3.064692919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491546    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57ac6b42-6423-40b8-8609-1ba404d0b21a-host\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491583    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-sys\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491613    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-host-cni-bin\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491623    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57ac6b42-6423-40b8-8609-1ba404d0b21a-serviceca\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491658    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-system-cni-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491669    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-sys\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491675    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-env-overrides\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491683    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-k8s-cni-cncf-io\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491720    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-systemd\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491734    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-system-cni-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491753    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa1679b9-82e5-444a-a890-1cda5c1baa85-hosts-file\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491782    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-k8s-cni-cncf-io\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491799    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-systemd\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491801    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-cni-bin\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.492532 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491837    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-cni-multus\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491865    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-conf-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491890    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa1679b9-82e5-444a-a890-1cda5c1baa85-hosts-file\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491894    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-registration-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491895    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-cni-multus\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491838    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-var-lib-cni-bin\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491927    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-ovn\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491936    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-registration-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491954    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa1679b9-82e5-444a-a890-1cda5c1baa85-tmp-dir\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491972    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-conf-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.491989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0af8b152-1e09-41ec-a097-f55b4d6bc132-iptables-alerter-script\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492008    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-ovn\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492027    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-cni-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492054    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-cnibin\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492079    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-os-release\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492088    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57ac6b42-6423-40b8-8609-1ba404d0b21a-serviceca\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492102    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492128    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-sys-fs\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.493369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492136    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-cni-dir\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492140    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-cnibin\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492152    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-tuned\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492160    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-os-release\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492169    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-ovnkube-script-lib\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-cni-binary-copy\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492183    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492192    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ea7de061-5a79-4ce7-ac08-fd4e271b0232-sys-fs\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492224    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492256    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa1679b9-82e5-444a-a890-1cda5c1baa85-tmp-dir\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492267    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bde814a-deda-4f36-9792-fdd6247c89c5-ovn-node-metrics-cert\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492292    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9skhm\" (UniqueName: \"kubernetes.io/projected/aa1679b9-82e5-444a-a890-1cda5c1baa85-kube-api-access-9skhm\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-cnibin\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492349    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-cni-binary-copy\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492375    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492402    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-kubernetes\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492447    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jc7d\" (UniqueName: \"kubernetes.io/projected/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-kube-api-access-5jc7d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492511    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrwx\" (UniqueName: \"kubernetes.io/projected/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-kube-api-access-lvrwx\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492532    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7bde814a-deda-4f36-9792-fdd6247c89c5-run-openvswitch\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492535    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b074476-43a9-4d33-a0d7-7415b8398524-konnectivity-ca\") pod \"konnectivity-agent-jrmx5\" (UID: \"3b074476-43a9-4d33-a0d7-7415b8398524\") " pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492581    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysctl-conf\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492617    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-lib-modules\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492641    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-host\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqxs\" (UniqueName: \"kubernetes.io/projected/1be1db88-9f20-4176-ab17-93c1063bebe4-kube-api-access-wzqxs\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492693    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-daemon-config\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492719    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-multus-certs\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492742    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-ovnkube-config\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492762    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysctl-d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-os-release\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ksc\" (UniqueName: \"kubernetes.io/projected/0af8b152-1e09-41ec-a097-f55b4d6bc132-kube-api-access-j7ksc\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.492966    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-kubernetes\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b074476-43a9-4d33-a0d7-7415b8398524-konnectivity-ca\") pod \"konnectivity-agent-jrmx5\" (UID: \"3b074476-43a9-4d33-a0d7-7415b8398524\") " pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493396    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-cni-binary-copy\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.494865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493496    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-multus-daemon-config\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.495633 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493523    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysctl-d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.495633 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-sysctl-conf\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.495633 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493637    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-host\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.495633 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493681    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-host-run-multus-certs\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.495633 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493720    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7bde814a-deda-4f36-9792-fdd6247c89c5-ovnkube-config\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.495633 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.493730    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-lib-modules\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.496652 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.496627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-tmp\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.497547 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.497525    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b074476-43a9-4d33-a0d7-7415b8398524-agent-certs\") pod \"konnectivity-agent-jrmx5\" (UID: \"3b074476-43a9-4d33-a0d7-7415b8398524\") " pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.498764 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.498223    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-etc-tuned\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.499103 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.499033    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:13:20.499193 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.499119    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:13:20.499252 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.499198    2563 projected.go:194] Error preparing data for projected volume kube-api-access-6khm7 for pod openshift-network-diagnostics/network-check-target-tfs8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:20.500208 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.499492    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7 podName:23d2847e-351d-4236-9f58-2a6275d20b0a nodeName:}" failed. No retries permitted until 2026-05-21 15:13:20.999410188 +0000 UTC m=+3.072726324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6khm7" (UniqueName: "kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7") pod "network-check-target-tfs8h" (UID: "23d2847e-351d-4236-9f58-2a6275d20b0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:20.500580 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.500562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bde814a-deda-4f36-9792-fdd6247c89c5-ovn-node-metrics-cert\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.502878 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.502852    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrwx\" (UniqueName: \"kubernetes.io/projected/8b3144a4-b437-4f9b-a5d6-1528c0b8d015-kube-api-access-lvrwx\") pod \"multus-8ft87\" (UID: \"8b3144a4-b437-4f9b-a5d6-1528c0b8d015\") " pod="openshift-multus/multus-8ft87"
May 21 15:13:20.506401 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.506378    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jc7d\" (UniqueName: \"kubernetes.io/projected/0b3bc0b0-c9ca-4016-9a7e-b31275bead13-kube-api-access-5jc7d\") pod \"tuned-wgwdt\" (UID: \"0b3bc0b0-c9ca-4016-9a7e-b31275bead13\") " pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.508097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.508073    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skhm\" (UniqueName: \"kubernetes.io/projected/aa1679b9-82e5-444a-a890-1cda5c1baa85-kube-api-access-9skhm\") pod \"node-resolver-vmq8h\" (UID: \"aa1679b9-82e5-444a-a890-1cda5c1baa85\") " pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.508097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.508094    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pqbv\" (UniqueName: \"kubernetes.io/projected/7bde814a-deda-4f36-9792-fdd6247c89c5-kube-api-access-2pqbv\") pod \"ovnkube-node-4w244\" (UID: \"7bde814a-deda-4f36-9792-fdd6247c89c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.508605 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.508556    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvjl\" (UniqueName: \"kubernetes.io/projected/558c0f01-4351-454c-9ca8-0e6cf4bc0887-kube-api-access-9dvjl\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:20.509036 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.508953    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvvmp\" (UniqueName: \"kubernetes.io/projected/ea7de061-5a79-4ce7-ac08-fd4e271b0232-kube-api-access-mvvmp\") pod \"aws-ebs-csi-driver-node-zc2ls\" (UID: \"ea7de061-5a79-4ce7-ac08-fd4e271b0232\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.511193 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.511176    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q6kq\" (UniqueName: \"kubernetes.io/projected/57ac6b42-6423-40b8-8609-1ba404d0b21a-kube-api-access-8q6kq\") pod \"node-ca-68nzt\" (UID: \"57ac6b42-6423-40b8-8609-1ba404d0b21a\") " pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.524640 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.524600    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"6042397a9b9298ea910705e75aa9f94b","Type":"ContainerStarted","Data":"a8f4eb1032e7356936fa44040e7640f08c79bad70f39f45ed45aa8610b9f8c37"}
May 21 15:13:20.525466 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.525448    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" event={"ID":"2b99ea0cca3367eddd43b660554c798c","Type":"ContainerStarted","Data":"634f95b0a0af49290e32df28b3078c4c09351509280b77a38b635f38c6f23112"}
May 21 15:13:20.593174 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593135    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-os-release\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593174 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593180    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ksc\" (UniqueName: \"kubernetes.io/projected/0af8b152-1e09-41ec-a097-f55b4d6bc132-kube-api-access-j7ksc\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593205    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-system-cni-dir\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593234    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0af8b152-1e09-41ec-a097-f55b4d6bc132-host-slash\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593265    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593297    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593363    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0af8b152-1e09-41ec-a097-f55b4d6bc132-iptables-alerter-script\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593393    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-cni-binary-copy\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593446    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-cnibin\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593474    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593513    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqxs\" (UniqueName: \"kubernetes.io/projected/1be1db88-9f20-4176-ab17-93c1063bebe4-kube-api-access-wzqxs\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593516    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0af8b152-1e09-41ec-a097-f55b4d6bc132-host-slash\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-os-release\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.593808    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-system-cni-dir\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.594325    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0af8b152-1e09-41ec-a097-f55b4d6bc132-iptables-alerter-script\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.594356    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-cni-binary-copy\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.594453    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-cnibin\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.593416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.594567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1be1db88-9f20-4176-ab17-93c1063bebe4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.595732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.594771    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.595732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.594972    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1be1db88-9f20-4176-ab17-93c1063bebe4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.603671 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.603628    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ksc\" (UniqueName: \"kubernetes.io/projected/0af8b152-1e09-41ec-a097-f55b4d6bc132-kube-api-access-j7ksc\") pod \"iptables-alerter-vvf2n\" (UID: \"0af8b152-1e09-41ec-a097-f55b4d6bc132\") " pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.603671 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.603661    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqxs\" (UniqueName: \"kubernetes.io/projected/1be1db88-9f20-4176-ab17-93c1063bebe4-kube-api-access-wzqxs\") pod \"multus-additional-cni-plugins-smww2\" (UID: \"1be1db88-9f20-4176-ab17-93c1063bebe4\") " pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.684762 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.684726    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8ft87"
May 21 15:13:20.692575 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.692549    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:20.699909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.699884    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls"
May 21 15:13:20.706166 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.706142    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgwdt"
May 21 15:13:20.713762 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.713732    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vmq8h"
May 21 15:13:20.716020 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.715992    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3144a4_b437_4f9b_a5d6_1528c0b8d015.slice/crio-beef01d2d95a2076b8c4ba724856a5b7d63ed04d25b275564e3ae2218e2f90b4 WatchSource:0}: Error finding container beef01d2d95a2076b8c4ba724856a5b7d63ed04d25b275564e3ae2218e2f90b4: Status 404 returned error can't find the container with id beef01d2d95a2076b8c4ba724856a5b7d63ed04d25b275564e3ae2218e2f90b4
May 21 15:13:20.717165 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.717142    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b074476_43a9_4d33_a0d7_7415b8398524.slice/crio-4a0c379c0936b261e5e8c174b7e371586b0df19043f34c1171ad5118175e768e WatchSource:0}: Error finding container 4a0c379c0936b261e5e8c174b7e371586b0df19043f34c1171ad5118175e768e: Status 404 returned error can't find the container with id 4a0c379c0936b261e5e8c174b7e371586b0df19043f34c1171ad5118175e768e
May 21 15:13:20.719611 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.719586    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7de061_5a79_4ce7_ac08_fd4e271b0232.slice/crio-c878ac754b20c91021437aadf60a17abe8650d290ad102bd3e716fe47e206b38 WatchSource:0}: Error finding container c878ac754b20c91021437aadf60a17abe8650d290ad102bd3e716fe47e206b38: Status 404 returned error can't find the container with id c878ac754b20c91021437aadf60a17abe8650d290ad102bd3e716fe47e206b38
May 21 15:13:20.719803 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.719751    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:20.723049 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.723023    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3bc0b0_c9ca_4016_9a7e_b31275bead13.slice/crio-7478658cfe2865be6d078ffcd910f5c317670be440e91833efd0cc578d3e4898 WatchSource:0}: Error finding container 7478658cfe2865be6d078ffcd910f5c317670be440e91833efd0cc578d3e4898: Status 404 returned error can't find the container with id 7478658cfe2865be6d078ffcd910f5c317670be440e91833efd0cc578d3e4898
May 21 15:13:20.727015 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.726997    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68nzt"
May 21 15:13:20.734491 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.734169    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-smww2"
May 21 15:13:20.737488 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.737411    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1679b9_82e5_444a_a890_1cda5c1baa85.slice/crio-6b6906290bce54c36c515f356309627c7229abe00f85847115dd41c133f653f4 WatchSource:0}: Error finding container 6b6906290bce54c36c515f356309627c7229abe00f85847115dd41c133f653f4: Status 404 returned error can't find the container with id 6b6906290bce54c36c515f356309627c7229abe00f85847115dd41c133f653f4
May 21 15:13:20.742977 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.742952    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ac6b42_6423_40b8_8609_1ba404d0b21a.slice/crio-92dbea8a9614b628a959ec476e44bf37125fc7dc78b28d8021930e4732f83421 WatchSource:0}: Error finding container 92dbea8a9614b628a959ec476e44bf37125fc7dc78b28d8021930e4732f83421: Status 404 returned error can't find the container with id 92dbea8a9614b628a959ec476e44bf37125fc7dc78b28d8021930e4732f83421
May 21 15:13:20.746439 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.745643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bde814a_deda_4f36_9792_fdd6247c89c5.slice/crio-d5deaf6cac03792f0ee0640e35b1fe0d11635d5732f92b5c41bd8b0d084a9c67 WatchSource:0}: Error finding container d5deaf6cac03792f0ee0640e35b1fe0d11635d5732f92b5c41bd8b0d084a9c67: Status 404 returned error can't find the container with id d5deaf6cac03792f0ee0640e35b1fe0d11635d5732f92b5c41bd8b0d084a9c67
May 21 15:13:20.747191 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.747003    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvf2n"
May 21 15:13:20.749529 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.749502    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be1db88_9f20_4176_ab17_93c1063bebe4.slice/crio-e02173e41dab3bfaae2f2f37f5d4a4d76a45dbe36c79fb4b7ae7314a38d67409 WatchSource:0}: Error finding container e02173e41dab3bfaae2f2f37f5d4a4d76a45dbe36c79fb4b7ae7314a38d67409: Status 404 returned error can't find the container with id e02173e41dab3bfaae2f2f37f5d4a4d76a45dbe36c79fb4b7ae7314a38d67409
May 21 15:13:20.754492 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:13:20.754465    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af8b152_1e09_41ec_a097_f55b4d6bc132.slice/crio-d91863a3739ffb874a5f25c1d2673e5edf1e2971cb982a9d84d9ea5749c9001f WatchSource:0}: Error finding container d91863a3739ffb874a5f25c1d2673e5edf1e2971cb982a9d84d9ea5749c9001f: Status 404 returned error can't find the container with id d91863a3739ffb874a5f25c1d2673e5edf1e2971cb982a9d84d9ea5749c9001f
May 21 15:13:20.997773 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:20.997539    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:20.997773 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.997689    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:20.997953 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:20.997785    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:21.997769858 +0000 UTC m=+4.071085984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:21.098658 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.098615    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:21.098832 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:21.098809    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:13:21.098832 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:21.098832    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:13:21.098940 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:21.098846    2563 projected.go:194] Error preparing data for projected volume kube-api-access-6khm7 for pod openshift-network-diagnostics/network-check-target-tfs8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:21.098940 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:21.098913    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7 podName:23d2847e-351d-4236-9f58-2a6275d20b0a nodeName:}" failed. No retries permitted until 2026-05-21 15:13:22.098890849 +0000 UTC m=+4.172206980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6khm7" (UniqueName: "kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7") pod "network-check-target-tfs8h" (UID: "23d2847e-351d-4236-9f58-2a6275d20b0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:21.426521 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.426475    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:08:19 +0000 UTC" deadline="2028-02-26 08:59:36.581880824 +0000 UTC"
May 21 15:13:21.426521 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.426517    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15497h46m15.155368087s"
May 21 15:13:21.520174 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.520132    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:21.520375 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:21.520231    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:21.528368 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.528327    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68nzt" event={"ID":"57ac6b42-6423-40b8-8609-1ba404d0b21a","Type":"ContainerStarted","Data":"92dbea8a9614b628a959ec476e44bf37125fc7dc78b28d8021930e4732f83421"}
May 21 15:13:21.529800 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.529772    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvf2n" event={"ID":"0af8b152-1e09-41ec-a097-f55b4d6bc132","Type":"ContainerStarted","Data":"d91863a3739ffb874a5f25c1d2673e5edf1e2971cb982a9d84d9ea5749c9001f"}
May 21 15:13:21.531187 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.531161    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmq8h" event={"ID":"aa1679b9-82e5-444a-a890-1cda5c1baa85","Type":"ContainerStarted","Data":"6b6906290bce54c36c515f356309627c7229abe00f85847115dd41c133f653f4"}
May 21 15:13:21.535052 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.535026    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgwdt" event={"ID":"0b3bc0b0-c9ca-4016-9a7e-b31275bead13","Type":"ContainerStarted","Data":"7478658cfe2865be6d078ffcd910f5c317670be440e91833efd0cc578d3e4898"}
May 21 15:13:21.537014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.536963    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls" event={"ID":"ea7de061-5a79-4ce7-ac08-fd4e271b0232","Type":"ContainerStarted","Data":"c878ac754b20c91021437aadf60a17abe8650d290ad102bd3e716fe47e206b38"}
May 21 15:13:21.538090 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.538067    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrmx5" event={"ID":"3b074476-43a9-4d33-a0d7-7415b8398524","Type":"ContainerStarted","Data":"4a0c379c0936b261e5e8c174b7e371586b0df19043f34c1171ad5118175e768e"}
May 21 15:13:21.539388 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.539339    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8ft87" event={"ID":"8b3144a4-b437-4f9b-a5d6-1528c0b8d015","Type":"ContainerStarted","Data":"beef01d2d95a2076b8c4ba724856a5b7d63ed04d25b275564e3ae2218e2f90b4"}
May 21 15:13:21.541117 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.541092    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" event={"ID":"2b99ea0cca3367eddd43b660554c798c","Type":"ContainerStarted","Data":"75a785dbc74daf47f01036e08c34138ea9f2ec3f76278d25767c026be4890dca"}
May 21 15:13:21.542992 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.542969    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerStarted","Data":"e02173e41dab3bfaae2f2f37f5d4a4d76a45dbe36c79fb4b7ae7314a38d67409"}
May 21 15:13:21.544242 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:21.544220    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"d5deaf6cac03792f0ee0640e35b1fe0d11635d5732f92b5c41bd8b0d084a9c67"}
May 21 15:13:22.006656 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:22.006619    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:22.006838 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:22.006781    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:22.006894 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:22.006849    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:24.006829614 +0000 UTC m=+6.080145744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:22.107835 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:22.107751    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:22.108048 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:22.107941    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:13:22.108048 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:22.107961    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:13:22.108048 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:22.107974    2563 projected.go:194] Error preparing data for projected volume kube-api-access-6khm7 for pod openshift-network-diagnostics/network-check-target-tfs8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:22.108048 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:22.108035    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7 podName:23d2847e-351d-4236-9f58-2a6275d20b0a nodeName:}" failed. No retries permitted until 2026-05-21 15:13:24.108014908 +0000 UTC m=+6.181331036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6khm7" (UniqueName: "kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7") pod "network-check-target-tfs8h" (UID: "23d2847e-351d-4236-9f58-2a6275d20b0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:22.522617 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:22.522045    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:22.522617 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:22.522184    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:22.558508 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:22.558467    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"6042397a9b9298ea910705e75aa9f94b","Type":"ContainerStarted","Data":"4158dd00dc62d1e018daeed80ee098362d284dcec6b424da2484d923d3416770"}
May 21 15:13:22.573858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:22.573793    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-80.ec2.internal" podStartSLOduration=3.5737739939999997 podStartE2EDuration="3.573773994s" podCreationTimestamp="2026-05-21 15:13:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:13:21.555334849 +0000 UTC m=+3.628650980" watchObservedRunningTime="2026-05-21 15:13:22.573773994 +0000 UTC m=+4.647090143"
May 21 15:13:23.520650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:23.519680    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:23.520650 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:23.519810    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:24.025466 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:24.025406    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:24.025948 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:24.025650    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:24.025948 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:24.025718    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:28.025698354 +0000 UTC m=+10.099014491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:24.126154 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:24.126108    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:24.126412 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:24.126288    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:13:24.126412 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:24.126306    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:13:24.126412 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:24.126319    2563 projected.go:194] Error preparing data for projected volume kube-api-access-6khm7 for pod openshift-network-diagnostics/network-check-target-tfs8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:24.126412 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:24.126385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7 podName:23d2847e-351d-4236-9f58-2a6275d20b0a nodeName:}" failed. No retries permitted until 2026-05-21 15:13:28.126366125 +0000 UTC m=+10.199682255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6khm7" (UniqueName: "kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7") pod "network-check-target-tfs8h" (UID: "23d2847e-351d-4236-9f58-2a6275d20b0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:24.523141 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:24.522608    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:24.523141 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:24.522768    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:24.568563 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:24.568524    2563 generic.go:358] "Generic (PLEG): container finished" podID="6042397a9b9298ea910705e75aa9f94b" containerID="4158dd00dc62d1e018daeed80ee098362d284dcec6b424da2484d923d3416770" exitCode=0
May 21 15:13:24.568738 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:24.568604    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"6042397a9b9298ea910705e75aa9f94b","Type":"ContainerDied","Data":"4158dd00dc62d1e018daeed80ee098362d284dcec6b424da2484d923d3416770"}
May 21 15:13:25.519580 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:25.519543    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:25.520044 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:25.519676    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:26.521460 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:26.520482    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:26.521460 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:26.520644    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:27.521367 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:27.520844    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:27.521367 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:27.520976    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:28.062740 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:28.062106    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:28.062740 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:28.062265    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:28.062740 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:28.062336    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:36.062316591 +0000 UTC m=+18.135632721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:28.163601 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:28.163508    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:28.163967 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:28.163943    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:13:28.163967 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:28.163970    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:13:28.164090 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:28.163981    2563 projected.go:194] Error preparing data for projected volume kube-api-access-6khm7 for pod openshift-network-diagnostics/network-check-target-tfs8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:28.164090 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:28.164041    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7 podName:23d2847e-351d-4236-9f58-2a6275d20b0a nodeName:}" failed. No retries permitted until 2026-05-21 15:13:36.164019925 +0000 UTC m=+18.237336056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6khm7" (UniqueName: "kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7") pod "network-check-target-tfs8h" (UID: "23d2847e-351d-4236-9f58-2a6275d20b0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:28.523562 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:28.523516    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:28.524065 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:28.523656    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:29.520831 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:29.520306    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:29.520831 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:29.520457    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:30.519978 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:30.519937    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:30.520444 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:30.520088    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:31.520470 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:31.520434    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:31.520873 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:31.520557    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:32.520007 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:32.519909    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:32.520164 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:32.520068    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:33.520594 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:33.520551    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:33.521031 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:33.520691    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:34.520197 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:34.520156    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:34.520375 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:34.520310    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:35.520303 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:35.520265    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:35.520775 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:35.520403    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:36.121970 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:36.121929    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:36.122166 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:36.122125    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:36.122224 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:36.122212    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:52.122189656 +0000 UTC m=+34.195505779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:36.223315 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:36.223279    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:36.223544 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:36.223460    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:13:36.223544 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:36.223482    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:13:36.223544 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:36.223497    2563 projected.go:194] Error preparing data for projected volume kube-api-access-6khm7 for pod openshift-network-diagnostics/network-check-target-tfs8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:36.223691 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:36.223570    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7 podName:23d2847e-351d-4236-9f58-2a6275d20b0a nodeName:}" failed. No retries permitted until 2026-05-21 15:13:52.223550431 +0000 UTC m=+34.296866567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6khm7" (UniqueName: "kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7") pod "network-check-target-tfs8h" (UID: "23d2847e-351d-4236-9f58-2a6275d20b0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:36.520720 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:36.520682    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:36.521165 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:36.520820    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:37.520204 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:37.520168    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:37.520378 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:37.520286    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:38.520881 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:38.520849    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:38.521310 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:38.520955    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:39.519755 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.519578    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:39.519885 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:39.519861    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:39.595769 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.595732    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8ft87" event={"ID":"8b3144a4-b437-4f9b-a5d6-1528c0b8d015","Type":"ContainerStarted","Data":"0e9394cd86c4bd224e0213817d4d19e4700b21d56f05cdc681b741aab5e9ba6d"}
May 21 15:13:39.597165 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.597138    2563 generic.go:358] "Generic (PLEG): container finished" podID="1be1db88-9f20-4176-ab17-93c1063bebe4" containerID="4248c1349de98a97bc8826df7f4e005376292dd44be00bb12f1b6bdbeb16d7c9" exitCode=0
May 21 15:13:39.597256 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.597222    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerDied","Data":"4248c1349de98a97bc8826df7f4e005376292dd44be00bb12f1b6bdbeb16d7c9"}
May 21 15:13:39.599078 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.599059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:13:39.599466 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.599415    2563 generic.go:358] "Generic (PLEG): container finished" podID="7bde814a-deda-4f36-9792-fdd6247c89c5" containerID="9438ba82a492718914e25245922588edb778f9ae8e5bad56c9ac2ed03953646c" exitCode=1
May 21 15:13:39.599578 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.599459    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"97f6e81975175c64302d681204d4405cd3417dee658893a5247478e8c545b5c0"}
May 21 15:13:39.599578 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.599490    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerDied","Data":"9438ba82a492718914e25245922588edb778f9ae8e5bad56c9ac2ed03953646c"}
May 21 15:13:39.599578 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.599503    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"399f454af57a7ed89705acaa6c40bed8c614aae72a18b71f75e00ec4a2db2fa1"}
May 21 15:13:39.600972 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.600946    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68nzt" event={"ID":"57ac6b42-6423-40b8-8609-1ba404d0b21a","Type":"ContainerStarted","Data":"c0c2a96d59f1c117c2f735a9d3ec42ac618960404fe7a3e10f81983972b6c666"}
May 21 15:13:39.602673 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.602643    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" event={"ID":"6042397a9b9298ea910705e75aa9f94b","Type":"ContainerStarted","Data":"433848b79ffe9b3ddea64d3c02033b4907855795a0f9df335ecfc94389a78be9"}
May 21 15:13:39.604066 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.604046    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vmq8h" event={"ID":"aa1679b9-82e5-444a-a890-1cda5c1baa85","Type":"ContainerStarted","Data":"7bd5100d3ad0b75dec3425e585dbb0ff51aca48fc734e6300d9dddfa660ebcfd"}
May 21 15:13:39.605502 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.605477    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgwdt" event={"ID":"0b3bc0b0-c9ca-4016-9a7e-b31275bead13","Type":"ContainerStarted","Data":"d30d332f0163d2a8d44710c9581e9aeee5a8a9b685f1fd37ab93a9d821b80f5f"}
May 21 15:13:39.609722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.609697    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls" event={"ID":"ea7de061-5a79-4ce7-ac08-fd4e271b0232","Type":"ContainerStarted","Data":"487c97862431601a2f85b69cd85db37b84840e43e37c09548686fd8fd8fd18a0"}
May 21 15:13:39.610932 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.610910    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrmx5" event={"ID":"3b074476-43a9-4d33-a0d7-7415b8398524","Type":"ContainerStarted","Data":"5afe37c057f5a48bb853c608cc28b60230c4a33726270481c5973af7f86df06f"}
May 21 15:13:39.617058 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.617024    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8ft87" podStartSLOduration=3.222902985 podStartE2EDuration="21.617013531s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.71862109 +0000 UTC m=+2.791937224" lastFinishedPulling="2026-05-21 15:13:39.112731642 +0000 UTC m=+21.186047770" observedRunningTime="2026-05-21 15:13:39.61573706 +0000 UTC m=+21.689053198" watchObservedRunningTime="2026-05-21 15:13:39.617013531 +0000 UTC m=+21.690329665"
May 21 15:13:39.627771 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.627751    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:39.629925 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.629891    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jrmx5" podStartSLOduration=7.976834926 podStartE2EDuration="21.629879501s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.720535736 +0000 UTC m=+2.793851856" lastFinishedPulling="2026-05-21 15:13:34.373580309 +0000 UTC m=+16.446896431" observedRunningTime="2026-05-21 15:13:39.629869801 +0000 UTC m=+21.703185936" watchObservedRunningTime="2026-05-21 15:13:39.629879501 +0000 UTC m=+21.703195618"
May 21 15:13:39.647304 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.647064    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-vmq8h" podStartSLOduration=3.292021846 podStartE2EDuration="21.647047034s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.740073611 +0000 UTC m=+2.813389737" lastFinishedPulling="2026-05-21 15:13:39.095098807 +0000 UTC m=+21.168414925" observedRunningTime="2026-05-21 15:13:39.646409721 +0000 UTC m=+21.719725855" watchObservedRunningTime="2026-05-21 15:13:39.647047034 +0000 UTC m=+21.720363169"
May 21 15:13:39.666503 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.665818    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-80.ec2.internal" podStartSLOduration=20.665799929 podStartE2EDuration="20.665799929s" podCreationTimestamp="2026-05-21 15:13:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:13:39.664457395 +0000 UTC m=+21.737773531" watchObservedRunningTime="2026-05-21 15:13:39.665799929 +0000 UTC m=+21.739116069"
May 21 15:13:39.682408 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.682360    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wgwdt" podStartSLOduration=3.319617554 podStartE2EDuration="21.682347955s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.732072672 +0000 UTC m=+2.805388789" lastFinishedPulling="2026-05-21 15:13:39.09480307 +0000 UTC m=+21.168119190" observedRunningTime="2026-05-21 15:13:39.682205428 +0000 UTC m=+21.755521562" watchObservedRunningTime="2026-05-21 15:13:39.682347955 +0000 UTC m=+21.755664089"
May 21 15:13:39.723187 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:39.723146    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-68nzt" podStartSLOduration=11.447942052 podStartE2EDuration="21.723132727s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.744884257 +0000 UTC m=+2.818200370" lastFinishedPulling="2026-05-21 15:13:31.020074912 +0000 UTC m=+13.093391045" observedRunningTime="2026-05-21 15:13:39.70044204 +0000 UTC m=+21.773758177" watchObservedRunningTime="2026-05-21 15:13:39.723132727 +0000 UTC m=+21.796448931"
May 21 15:13:40.506684 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.506660    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 15:13:40.513003 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.512968    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:40.513795 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.513768    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:40.520056 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.520027    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:40.520257 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:40.520175    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:40.614921 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.614885    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvf2n" event={"ID":"0af8b152-1e09-41ec-a097-f55b4d6bc132","Type":"ContainerStarted","Data":"aac05aa89e84e2598bce7f14a83b28f7bd31592d9f285a050c86ee310a2f4597"}
May 21 15:13:40.616866 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.616833    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls" event={"ID":"ea7de061-5a79-4ce7-ac08-fd4e271b0232","Type":"ContainerStarted","Data":"0acd395e8f4c6ed0ca42d8fa0f0e825750447dfe4f2484395ea194e50a90233d"}
May 21 15:13:40.619848 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.619828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:13:40.620299 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.620267    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"2bed3aafbb5a6905e1d92f6aad1e2ac59f795f7858f8f6b060da8b1c238eea46"}
May 21 15:13:40.620447 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.620300    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"3a76608d2e85204c880fa9a6b7003dded1d97868bf4d643ca3147c6b777867a0"}
May 21 15:13:40.620447 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.620313    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"e1d1a070fb7397b27bd12bbe022d20410d1def3ae09208f3b1bbee02b4f709a2"}
May 21 15:13:40.621458 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.621385    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jrmx5"
May 21 15:13:40.632975 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:40.632934    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vvf2n" podStartSLOduration=4.31801154 podStartE2EDuration="22.632920858s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.756018274 +0000 UTC m=+2.829334388" lastFinishedPulling="2026-05-21 15:13:39.070927593 +0000 UTC m=+21.144243706" observedRunningTime="2026-05-21 15:13:40.632570728 +0000 UTC m=+22.705886864" watchObservedRunningTime="2026-05-21 15:13:40.632920858 +0000 UTC m=+22.706237006"
May 21 15:13:41.455134 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:41.454842    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T15:13:40.506681138Z","UUID":"3d7e949c-fd66-462b-9a32-285cfbcb988d","Handler":null,"Name":"","Endpoint":""}
May 21 15:13:41.458210 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:41.458184    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 15:13:41.458358 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:41.458219    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 15:13:41.520657 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:41.520625    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:41.520889 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:41.520863    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:42.519955 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:42.519917    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:42.520464 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:42.520043    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:42.626749 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:42.626710    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls" event={"ID":"ea7de061-5a79-4ce7-ac08-fd4e271b0232","Type":"ContainerStarted","Data":"1fd3de807e73340a99f04229aa23aa312d7467736eba06b4a141d8fa46971535"}
May 21 15:13:42.629911 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:42.629878    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:13:42.631165 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:42.631139    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"d27f16aed788e3507cdd544ff8a7dfc562f6ffa4b826d73ede50bb46db275159"}
May 21 15:13:42.644385 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:42.644340    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zc2ls" podStartSLOduration=3.828240488 podStartE2EDuration="24.6443259s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.732104474 +0000 UTC m=+2.805420587" lastFinishedPulling="2026-05-21 15:13:41.548189877 +0000 UTC m=+23.621505999" observedRunningTime="2026-05-21 15:13:42.642813245 +0000 UTC m=+24.716129379" watchObservedRunningTime="2026-05-21 15:13:42.6443259 +0000 UTC m=+24.717642035"
May 21 15:13:43.520008 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:43.519970    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:43.520652 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:43.520086    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:44.520826 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.520543    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:44.521366 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:44.520954    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:44.635520 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.635481    2563 generic.go:358] "Generic (PLEG): container finished" podID="1be1db88-9f20-4176-ab17-93c1063bebe4" containerID="40b4be2ec71f9d4e2742c2f412256a756677f4397683a444945457ad1e87da20" exitCode=0
May 21 15:13:44.635693 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.635572    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerDied","Data":"40b4be2ec71f9d4e2742c2f412256a756677f4397683a444945457ad1e87da20"}
May 21 15:13:44.638781 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.638762    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:13:44.639107 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.639049    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"9e7a5e0828afc6c5a02db797519d38d1ba6338b7e3fd64ab1f63ae2eab3a17c2"}
May 21 15:13:44.639370 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.639353    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:44.639441 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.639376    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:44.639441 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.639386    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:44.639597 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.639577    2563 scope.go:117] "RemoveContainer" containerID="9438ba82a492718914e25245922588edb778f9ae8e5bad56c9ac2ed03953646c"
May 21 15:13:44.656936 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.656913    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:44.657012 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:44.656998    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:13:45.519625 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:45.519548    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:45.519778 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:45.519648    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:45.643116 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:45.643082    2563 generic.go:358] "Generic (PLEG): container finished" podID="1be1db88-9f20-4176-ab17-93c1063bebe4" containerID="0c252e128acf24af29ffc9ef2e9e5c41b42d9ad63e20a0a429739279a727ffbd" exitCode=0
May 21 15:13:45.643536 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:45.643168    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerDied","Data":"0c252e128acf24af29ffc9ef2e9e5c41b42d9ad63e20a0a429739279a727ffbd"}
May 21 15:13:45.646485 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:45.646468    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:13:45.646804 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:45.646785    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" event={"ID":"7bde814a-deda-4f36-9792-fdd6247c89c5","Type":"ContainerStarted","Data":"e09674ebedaa48106f3618bae321e14adeca74d245f586979e9838fed9281753"}
May 21 15:13:45.689989 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:45.689943    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4w244" podStartSLOduration=9.279976818 podStartE2EDuration="27.689927886s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.747564966 +0000 UTC m=+2.820881092" lastFinishedPulling="2026-05-21 15:13:39.157516046 +0000 UTC m=+21.230832160" observedRunningTime="2026-05-21 15:13:45.688621892 +0000 UTC m=+27.761938027" watchObservedRunningTime="2026-05-21 15:13:45.689927886 +0000 UTC m=+27.763244021"
May 21 15:13:46.380895 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:46.380718    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xf7bw"]
May 21 15:13:46.381035 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:46.381005    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:46.381132 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:46.381104    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:46.383621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:46.383599    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfs8h"]
May 21 15:13:46.383706 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:46.383695    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:46.383783 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:46.383767    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:46.650528 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:46.650493    2563 generic.go:358] "Generic (PLEG): container finished" podID="1be1db88-9f20-4176-ab17-93c1063bebe4" containerID="472d7cad46918d7e6da8efed984e90cf5f4d77fffc0796be92d36d9c3ed92e8f" exitCode=0
May 21 15:13:46.650896 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:46.650583    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerDied","Data":"472d7cad46918d7e6da8efed984e90cf5f4d77fffc0796be92d36d9c3ed92e8f"}
May 21 15:13:48.521281 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:48.521191    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:48.521944 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:48.521304    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:48.521944 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:48.521352    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:48.521944 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:48.521448    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:50.520475 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:50.520372    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:50.521008 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:50.520379    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:50.521008 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:50.520523    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:50.521008 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:50.520581    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:52.136394 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:52.136354    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:52.136951 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.136506    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:52.136951 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.136584    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:24.13655629 +0000 UTC m=+66.209872402 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:13:52.237118 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:52.237082    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:52.237277 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.237218    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:13:52.237277 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.237271    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:13:52.237355 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.237283    2563 projected.go:194] Error preparing data for projected volume kube-api-access-6khm7 for pod openshift-network-diagnostics/network-check-target-tfs8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:52.237355 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.237343    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7 podName:23d2847e-351d-4236-9f58-2a6275d20b0a nodeName:}" failed. No retries permitted until 2026-05-21 15:14:24.237328712 +0000 UTC m=+66.310644825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6khm7" (UniqueName: "kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7") pod "network-check-target-tfs8h" (UID: "23d2847e-351d-4236-9f58-2a6275d20b0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:13:52.520086 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:52.520057    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:52.520247 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.520163    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:13:52.520247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:52.520218    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:52.520323 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:52.520297    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfs8h" podUID="23d2847e-351d-4236-9f58-2a6275d20b0a"
May 21 15:13:53.216748 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.216565    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-80.ec2.internal" event="NodeReady"
May 21 15:13:53.217188 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.216848    2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 15:13:53.260613 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.260582    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h68r8"]
May 21 15:13:53.282825 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.282797    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g2bwf"]
May 21 15:13:53.282986 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.282967    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.285620 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.285599    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 15:13:53.285848 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.285834    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d98kf\""
May 21 15:13:53.286098 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.286082    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 15:13:53.297033 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.297015    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h68r8"]
May 21 15:13:53.297128 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.297037    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g2bwf"]
May 21 15:13:53.297128 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.297119    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:53.299808 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.299785    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 15:13:53.299908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.299816    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 15:13:53.299908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.299856    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 15:13:53.299908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.299885    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d4dlc\""
May 21 15:13:53.445536 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.445497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.445780 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.445761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85536ca0-0e61-473b-99ff-847a9463e9e1-tmp-dir\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.445902 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.445887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t442\" (UniqueName: \"kubernetes.io/projected/e212c79f-794d-4d09-a85e-ccd3320d58d6-kube-api-access-8t442\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:53.446012 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.445999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2vgz\" (UniqueName: \"kubernetes.io/projected/85536ca0-0e61-473b-99ff-847a9463e9e1-kube-api-access-r2vgz\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.446120 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.446108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85536ca0-0e61-473b-99ff-847a9463e9e1-config-volume\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.446244 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.446232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:53.547499 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.547392    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2vgz\" (UniqueName: \"kubernetes.io/projected/85536ca0-0e61-473b-99ff-847a9463e9e1-kube-api-access-r2vgz\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.547499 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.547462    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85536ca0-0e61-473b-99ff-847a9463e9e1-config-volume\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.547722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.547512    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:53.547722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.547573    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.547722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.547594    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85536ca0-0e61-473b-99ff-847a9463e9e1-tmp-dir\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.547722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.547619    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8t442\" (UniqueName: \"kubernetes.io/projected/e212c79f-794d-4d09-a85e-ccd3320d58d6-kube-api-access-8t442\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:53.547722 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:53.547711    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:13:53.547981 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:53.547713    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:13:53.547981 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:53.547793    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:54.04777498 +0000 UTC m=+36.121091105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:13:53.547981 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:53.547830    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:54.047811182 +0000 UTC m=+36.121127313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:13:53.547981 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.547934    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85536ca0-0e61-473b-99ff-847a9463e9e1-tmp-dir\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.548140 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.548119    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/85536ca0-0e61-473b-99ff-847a9463e9e1-config-volume\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.560693 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.560660    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2vgz\" (UniqueName: \"kubernetes.io/projected/85536ca0-0e61-473b-99ff-847a9463e9e1-kube-api-access-r2vgz\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:53.560833 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.560729    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t442\" (UniqueName: \"kubernetes.io/projected/e212c79f-794d-4d09-a85e-ccd3320d58d6-kube-api-access-8t442\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:53.667610 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.667576    2563 generic.go:358] "Generic (PLEG): container finished" podID="1be1db88-9f20-4176-ab17-93c1063bebe4" containerID="89128fd657e5968746be23c1a23a3549cd5121d4e2741321b835c5702dd9bac1" exitCode=0
May 21 15:13:53.667882 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:53.667629    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerDied","Data":"89128fd657e5968746be23c1a23a3549cd5121d4e2741321b835c5702dd9bac1"}
May 21 15:13:54.050959 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.050919    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:54.051152 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.050993    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:54.051152 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:54.051078    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:13:54.051152 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:54.051145    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:55.051129044 +0000 UTC m=+37.124445170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:13:54.051256 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:54.051084    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:13:54.051256 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:54.051208    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:55.051195018 +0000 UTC m=+37.124511147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:13:54.520513 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.520475    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:13:54.520944 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.520676    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:13:54.524684 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.524657    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 15:13:54.524684 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.524676    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqls8\""
May 21 15:13:54.524868 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.524689    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 15:13:54.524868 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.524721    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 15:13:54.524868 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.524677    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4qds\""
May 21 15:13:54.672517 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.672476    2563 generic.go:358] "Generic (PLEG): container finished" podID="1be1db88-9f20-4176-ab17-93c1063bebe4" containerID="fab3fb9c07459953d81aeb68ca52c645a8ce98250f9ad75d7f7fcc164697c4d5" exitCode=0
May 21 15:13:54.672681 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:54.672531    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerDied","Data":"fab3fb9c07459953d81aeb68ca52c645a8ce98250f9ad75d7f7fcc164697c4d5"}
May 21 15:13:55.058622 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:55.058541    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:55.058622 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:55.058601    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:55.058792 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:55.058711    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:13:55.058792 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:55.058785    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:57.058767593 +0000 UTC m=+39.132083705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:13:55.058870 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:55.058711    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:13:55.058870 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:55.058864    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:57.058852328 +0000 UTC m=+39.132168455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:13:55.676959 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:55.676925    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-smww2" event={"ID":"1be1db88-9f20-4176-ab17-93c1063bebe4","Type":"ContainerStarted","Data":"6b0fbef5f15bdcfea690e4484c5acbe11418fec791266107839dd59da8f25025"}
May 21 15:13:55.705003 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:55.704955    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-smww2" podStartSLOduration=5.905324691 podStartE2EDuration="37.704939009s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:13:20.751183457 +0000 UTC m=+2.824499573" lastFinishedPulling="2026-05-21 15:13:52.550797773 +0000 UTC m=+34.624113891" observedRunningTime="2026-05-21 15:13:55.703100334 +0000 UTC m=+37.776416469" watchObservedRunningTime="2026-05-21 15:13:55.704939009 +0000 UTC m=+37.778255141"
May 21 15:13:57.073825 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:57.073775    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:13:57.074212 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:13:57.073842    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:13:57.074212 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:57.073929    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:13:57.074212 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:57.073937    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:13:57.074212 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:57.073993    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:01.073977723 +0000 UTC m=+43.147293837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:13:57.074212 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:13:57.074006    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:01.074000306 +0000 UTC m=+43.147316419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:14:01.104591 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:01.104534    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:14:01.104591 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:01.104607    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:14:01.105139 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:01.104677    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:14:01.105139 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:01.104740    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:09.104725012 +0000 UTC m=+51.178041124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:14:01.105139 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:01.104680    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:14:01.105139 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:01.104772    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:09.104763291 +0000 UTC m=+51.178079404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:14:09.157936 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:09.157900    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:14:09.158466 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:09.157962    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:14:09.158466 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:09.158050    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:14:09.158466 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:09.158076    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:14:09.158466 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:09.158104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:25.158089592 +0000 UTC m=+67.231405705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:14:09.158466 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:09.158142    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:25.15812757 +0000 UTC m=+67.231443684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:14:16.661766 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:16.661734    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4w244"
May 21 15:14:24.163441 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.163388    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:14:24.166115 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.166094    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 15:14:24.174569 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:24.174545    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 15:14:24.174691 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:24.174615    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:28.174593146 +0000 UTC m=+130.247909272 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : secret "metrics-daemon-secret" not found
May 21 15:14:24.264101 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.264059    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:14:24.266980 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.266961    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 15:14:24.276634 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.276616    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 15:14:24.287690 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.287667    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6khm7\" (UniqueName: \"kubernetes.io/projected/23d2847e-351d-4236-9f58-2a6275d20b0a-kube-api-access-6khm7\") pod \"network-check-target-tfs8h\" (UID: \"23d2847e-351d-4236-9f58-2a6275d20b0a\") " pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:14:24.532910 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.532831    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4qds\""
May 21 15:14:24.541167 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.541147    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:14:24.737008 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:24.736980    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfs8h"]
May 21 15:14:24.741873 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:14:24.741844    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d2847e_351d_4236_9f58_2a6275d20b0a.slice/crio-076d97df88f7fef7cacee21ff9e4e2fbede1004a53b268b06273c66af6e3e9db WatchSource:0}: Error finding container 076d97df88f7fef7cacee21ff9e4e2fbede1004a53b268b06273c66af6e3e9db: Status 404 returned error can't find the container with id 076d97df88f7fef7cacee21ff9e4e2fbede1004a53b268b06273c66af6e3e9db
May 21 15:14:25.170481 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:25.170438    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:14:25.170961 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:25.170515    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:14:25.170961 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:25.170558    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:14:25.170961 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:25.170624    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:14:25.170961 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:25.170694    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:57.170675427 +0000 UTC m=+99.243991558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:14:25.170961 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:25.170726    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:57.170703865 +0000 UTC m=+99.244019993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:14:25.735521 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:25.735484    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfs8h" event={"ID":"23d2847e-351d-4236-9f58-2a6275d20b0a","Type":"ContainerStarted","Data":"076d97df88f7fef7cacee21ff9e4e2fbede1004a53b268b06273c66af6e3e9db"}
May 21 15:14:27.741395 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:27.741356    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfs8h" event={"ID":"23d2847e-351d-4236-9f58-2a6275d20b0a","Type":"ContainerStarted","Data":"ec0ca38f50f4e9c89b169ff314c5995f5b831a36a4c4749fb5492a8a739cc0b1"}
May 21 15:14:27.741791 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:27.741492    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:14:27.756557 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:27.756508    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tfs8h" podStartSLOduration=67.200273691 podStartE2EDuration="1m9.756494434s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:14:24.743548072 +0000 UTC m=+66.816864189" lastFinishedPulling="2026-05-21 15:14:27.299768817 +0000 UTC m=+69.373084932" observedRunningTime="2026-05-21 15:14:27.756063221 +0000 UTC m=+69.829379355" watchObservedRunningTime="2026-05-21 15:14:27.756494434 +0000 UTC m=+69.829810572"
May 21 15:14:57.189324 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:57.189263    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:14:57.189324 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:57.189344    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:14:57.189888 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:57.189472    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:14:57.189888 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:57.189461    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:14:57.189888 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:57.189534    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls podName:85536ca0-0e61-473b-99ff-847a9463e9e1 nodeName:}" failed. No retries permitted until 2026-05-21 15:16:01.189520175 +0000 UTC m=+163.262836287 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls") pod "dns-default-h68r8" (UID: "85536ca0-0e61-473b-99ff-847a9463e9e1") : secret "dns-default-metrics-tls" not found
May 21 15:14:57.189888 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:14:57.189560    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert podName:e212c79f-794d-4d09-a85e-ccd3320d58d6 nodeName:}" failed. No retries permitted until 2026-05-21 15:16:01.189540327 +0000 UTC m=+163.262856457 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert") pod "ingress-canary-g2bwf" (UID: "e212c79f-794d-4d09-a85e-ccd3320d58d6") : secret "canary-serving-cert" not found
May 21 15:14:58.746441 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:14:58.746401    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tfs8h"
May 21 15:15:18.106122 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.106078    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"]
May 21 15:15:18.108727 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.108706    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"]
May 21 15:15:18.108852 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.108816    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.112694 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.112668    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 15:15:18.112828 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.112709    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 15:15:18.112828 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.112677    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rwk9c\""
May 21 15:15:18.112828 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.112709    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 21 15:15:18.112945 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.112761    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 21 15:15:18.195225 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.195192    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-46p5l"]
May 21 15:15:18.196886 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.196870    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.199373 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.199333    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 21 15:15:18.199373 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.199355    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fw2ql\""
May 21 15:15:18.199579 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.199342    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 21 15:15:18.199579 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.199349    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 21 15:15:18.199691 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.199678    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 21 15:15:18.204364 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.204338    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 21 15:15:18.208905 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.208884    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-46p5l"]
May 21 15:15:18.230267 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.230216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74e36400-e696-4725-845f-21b2237d3286-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.230501 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.230279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.230501 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.230363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg89k\" (UniqueName: \"kubernetes.io/projected/74e36400-e696-4725-845f-21b2237d3286-kube-api-access-kg89k\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.304534 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.304500    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"]
May 21 15:15:18.306363 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.306344    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-548477549c-lrqbb"]
May 21 15:15:18.306519 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.306502    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"
May 21 15:15:18.308025 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.308010    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.309092 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.309060    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 21 15:15:18.309195 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.309126    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-p4nzl\""
May 21 15:15:18.309258 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.309203    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 21 15:15:18.310456 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.310414    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 15:15:18.310873 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.310850    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 15:15:18.311132 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.311106    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 15:15:18.311611 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.311590    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jhr97\""
May 21 15:15:18.317329 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.317310    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 15:15:18.320938 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.320914    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"]
May 21 15:15:18.327332 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.327310    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548477549c-lrqbb"]
May 21 15:15:18.331352 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.331333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b45993a1-6d5e-461b-818d-8c920f6fee99-serving-cert\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.331454 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.331415    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74e36400-e696-4725-845f-21b2237d3286-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.331518 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.331468    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.331518 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.331491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45993a1-6d5e-461b-818d-8c920f6fee99-trusted-ca\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.331518 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.331510    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kg89k\" (UniqueName: \"kubernetes.io/projected/74e36400-e696-4725-845f-21b2237d3286-kube-api-access-kg89k\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.331653 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.331545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b45993a1-6d5e-461b-818d-8c920f6fee99-config\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.331653 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.331587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4g9h\" (UniqueName: \"kubernetes.io/projected/b45993a1-6d5e-461b-818d-8c920f6fee99-kube-api-access-v4g9h\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.331653 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:18.331602    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:15:18.331785 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:18.331672    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls podName:74e36400-e696-4725-845f-21b2237d3286 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:18.831659481 +0000 UTC m=+120.904975594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lpvzq" (UID: "74e36400-e696-4725-845f-21b2237d3286") : secret "cluster-monitoring-operator-tls" not found
May 21 15:15:18.332062 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.332041    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74e36400-e696-4725-845f-21b2237d3286-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.347539 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.347512    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg89k\" (UniqueName: \"kubernetes.io/projected/74e36400-e696-4725-845f-21b2237d3286-kube-api-access-kg89k\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.432604 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.432779 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432616    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b45993a1-6d5e-461b-818d-8c920f6fee99-serving-cert\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.432779 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-trusted-ca\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.432897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432839    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45993a1-6d5e-461b-818d-8c920f6fee99-trusted-ca\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.432897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-image-registry-private-configuration\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.432897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-certificates\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.433020 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-bound-sa-token\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.433020 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c78kj\" (UniqueName: \"kubernetes.io/projected/db300487-56e5-4123-b42d-6138de72db25-kube-api-access-c78kj\") pod \"volume-data-source-validator-5cf8c89d64-bl95v\" (UID: \"db300487-56e5-4123-b42d-6138de72db25\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"
May 21 15:15:18.433020 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.432944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06469386-abb1-4f57-b8c3-7cd2182aec92-ca-trust-extracted\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.433112 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.433019    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b45993a1-6d5e-461b-818d-8c920f6fee99-config\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.433112 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.433095    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4g9h\" (UniqueName: \"kubernetes.io/projected/b45993a1-6d5e-461b-818d-8c920f6fee99-kube-api-access-v4g9h\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.433171 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.433124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkbd\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-kube-api-access-wqkbd\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.433171 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.433146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-installation-pull-secrets\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.435156 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.435139    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 21 15:15:18.435240 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.435141    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 21 15:15:18.439936 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.439915    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 21 15:15:18.440884 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.440869    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 21 15:15:18.444294 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.444276    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b45993a1-6d5e-461b-818d-8c920f6fee99-config\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.444741 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.444721    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b45993a1-6d5e-461b-818d-8c920f6fee99-trusted-ca\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.445981 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.445966    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b45993a1-6d5e-461b-818d-8c920f6fee99-serving-cert\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.451014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.450997    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 21 15:15:18.462393 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.462366    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4g9h\" (UniqueName: \"kubernetes.io/projected/b45993a1-6d5e-461b-818d-8c920f6fee99-kube-api-access-v4g9h\") pod \"console-operator-76dff48d59-46p5l\" (UID: \"b45993a1-6d5e-461b-818d-8c920f6fee99\") " pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.508371 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.508348    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fw2ql\""
May 21 15:15:18.516369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.516352    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:18.534459 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534416    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.534572 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534475    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-trusted-ca\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.534572 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534523    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-image-registry-private-configuration\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.534572 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534547    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-certificates\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.534680 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534647    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-bound-sa-token\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.534719 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534691    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c78kj\" (UniqueName: \"kubernetes.io/projected/db300487-56e5-4123-b42d-6138de72db25-kube-api-access-c78kj\") pod \"volume-data-source-validator-5cf8c89d64-bl95v\" (UID: \"db300487-56e5-4123-b42d-6138de72db25\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"
May 21 15:15:18.534771 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534721    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06469386-abb1-4f57-b8c3-7cd2182aec92-ca-trust-extracted\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.534820 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534773    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkbd\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-kube-api-access-wqkbd\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.534820 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.534804    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-installation-pull-secrets\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.535057 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.535037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06469386-abb1-4f57-b8c3-7cd2182aec92-ca-trust-extracted\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.535124 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.535110    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-certificates\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.537238 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.537216    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 15:15:18.537333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.537256    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 15:15:18.537333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.537277    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 15:15:18.542554 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.542530    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 21 15:15:18.542779 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.542760    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 15:15:18.542951 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.542935    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-bound-sa-token\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.543070 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.543054    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkbd\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-kube-api-access-wqkbd\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.545514 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:18.545495    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:15:18.545821 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:18.545784    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548477549c-lrqbb: secret "image-registry-tls" not found
May 21 15:15:18.545899 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:18.545870    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls podName:06469386-abb1-4f57-b8c3-7cd2182aec92 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:19.045838379 +0000 UTC m=+121.119154504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls") pod "image-registry-548477549c-lrqbb" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92") : secret "image-registry-tls" not found
May 21 15:15:18.546849 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.546715    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-trusted-ca\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.551121 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.551099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-image-registry-private-configuration\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.552146 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.552128    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-installation-pull-secrets\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:18.553021 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.553007    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 21 15:15:18.564284 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.564253    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c78kj\" (UniqueName: \"kubernetes.io/projected/db300487-56e5-4123-b42d-6138de72db25-kube-api-access-c78kj\") pod \"volume-data-source-validator-5cf8c89d64-bl95v\" (UID: \"db300487-56e5-4123-b42d-6138de72db25\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"
May 21 15:15:18.621144 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.621106    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-p4nzl\""
May 21 15:15:18.629411 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.629376    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"
May 21 15:15:18.643329 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.643300    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-46p5l"]
May 21 15:15:18.646172 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:15:18.646142    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45993a1_6d5e_461b_818d_8c920f6fee99.slice/crio-de1e36e7b45ea2b5c0771ad099bcf47864217ab0e9a0e6aa672ea972ceb1089f WatchSource:0}: Error finding container de1e36e7b45ea2b5c0771ad099bcf47864217ab0e9a0e6aa672ea972ceb1089f: Status 404 returned error can't find the container with id de1e36e7b45ea2b5c0771ad099bcf47864217ab0e9a0e6aa672ea972ceb1089f
May 21 15:15:18.764206 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.764175    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v"]
May 21 15:15:18.767794 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:15:18.767763    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb300487_56e5_4123_b42d_6138de72db25.slice/crio-5ca03afc6fc8796acf9e0d7e73f61b2120ae5695f253c03f47f33e33d1e4fe13 WatchSource:0}: Error finding container 5ca03afc6fc8796acf9e0d7e73f61b2120ae5695f253c03f47f33e33d1e4fe13: Status 404 returned error can't find the container with id 5ca03afc6fc8796acf9e0d7e73f61b2120ae5695f253c03f47f33e33d1e4fe13
May 21 15:15:18.836404 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.836370    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:18.836569 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:18.836495    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:15:18.836569 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:18.836549    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls podName:74e36400-e696-4725-845f-21b2237d3286 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:19.836535969 +0000 UTC m=+121.909852081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lpvzq" (UID: "74e36400-e696-4725-845f-21b2237d3286") : secret "cluster-monitoring-operator-tls" not found
May 21 15:15:18.843694 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.843653    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v" event={"ID":"db300487-56e5-4123-b42d-6138de72db25","Type":"ContainerStarted","Data":"5ca03afc6fc8796acf9e0d7e73f61b2120ae5695f253c03f47f33e33d1e4fe13"}
May 21 15:15:18.844595 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:18.844574    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" event={"ID":"b45993a1-6d5e-461b-818d-8c920f6fee99","Type":"ContainerStarted","Data":"de1e36e7b45ea2b5c0771ad099bcf47864217ab0e9a0e6aa672ea972ceb1089f"}
May 21 15:15:19.138637 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:19.138541    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:19.139032 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:19.138719    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:15:19.139032 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:19.138744    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548477549c-lrqbb: secret "image-registry-tls" not found
May 21 15:15:19.139032 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:19.138816    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls podName:06469386-abb1-4f57-b8c3-7cd2182aec92 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:20.138793344 +0000 UTC m=+122.212109465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls") pod "image-registry-548477549c-lrqbb" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92") : secret "image-registry-tls" not found
May 21 15:15:19.843573 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:19.843533    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:19.843754 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:19.843690    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:15:19.843805 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:19.843770    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls podName:74e36400-e696-4725-845f-21b2237d3286 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:21.843746185 +0000 UTC m=+123.917062315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lpvzq" (UID: "74e36400-e696-4725-845f-21b2237d3286") : secret "cluster-monitoring-operator-tls" not found
May 21 15:15:20.146159 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.146075    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:20.146632 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:20.146247    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:15:20.146632 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:20.146272    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548477549c-lrqbb: secret "image-registry-tls" not found
May 21 15:15:20.146632 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:20.146349    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls podName:06469386-abb1-4f57-b8c3-7cd2182aec92 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:22.146329067 +0000 UTC m=+124.219645180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls") pod "image-registry-548477549c-lrqbb" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92") : secret "image-registry-tls" not found
May 21 15:15:20.850999 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.850956    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" event={"ID":"b45993a1-6d5e-461b-818d-8c920f6fee99","Type":"ContainerStarted","Data":"8164ddbcffe2a9c0f4a5b7ff2ab4646186f6026ef31866f2503792841e651f3b"}
May 21 15:15:20.851198 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.851180    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:20.852159 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.852128    2563 patch_prober.go:28] interesting pod/console-operator-76dff48d59-46p5l container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.8:8443/readyz\": dial tcp 10.134.0.8:8443: connect: connection refused" start-of-body=
May 21 15:15:20.852278 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.852179    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" podUID="b45993a1-6d5e-461b-818d-8c920f6fee99" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.8:8443/readyz\": dial tcp 10.134.0.8:8443: connect: connection refused"
May 21 15:15:20.853177 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.853145    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v" event={"ID":"db300487-56e5-4123-b42d-6138de72db25","Type":"ContainerStarted","Data":"79a1b9f387e81158daa3b088440900e716c666fd2483a88bb9699bc915145a30"}
May 21 15:15:20.866410 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.866349    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" podStartSLOduration=0.739352726 podStartE2EDuration="2.86633288s" podCreationTimestamp="2026-05-21 15:15:18 +0000 UTC" firstStartedPulling="2026-05-21 15:15:18.648078952 +0000 UTC m=+120.721395066" lastFinishedPulling="2026-05-21 15:15:20.775059105 +0000 UTC m=+122.848375220" observedRunningTime="2026-05-21 15:15:20.866196626 +0000 UTC m=+122.939512765" watchObservedRunningTime="2026-05-21 15:15:20.86633288 +0000 UTC m=+122.939649041"
May 21 15:15:20.881835 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:20.881792    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-bl95v" podStartSLOduration=0.879190931 podStartE2EDuration="2.881775475s" podCreationTimestamp="2026-05-21 15:15:18 +0000 UTC" firstStartedPulling="2026-05-21 15:15:18.769677296 +0000 UTC m=+120.842993410" lastFinishedPulling="2026-05-21 15:15:20.772261805 +0000 UTC m=+122.845577954" observedRunningTime="2026-05-21 15:15:20.881252002 +0000 UTC m=+122.954568137" watchObservedRunningTime="2026-05-21 15:15:20.881775475 +0000 UTC m=+122.955091607"
May 21 15:15:21.856241 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:21.856214    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/0.log"
May 21 15:15:21.856653 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:21.856251    2563 generic.go:358] "Generic (PLEG): container finished" podID="b45993a1-6d5e-461b-818d-8c920f6fee99" containerID="8164ddbcffe2a9c0f4a5b7ff2ab4646186f6026ef31866f2503792841e651f3b" exitCode=255
May 21 15:15:21.856653 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:21.856285    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" event={"ID":"b45993a1-6d5e-461b-818d-8c920f6fee99","Type":"ContainerDied","Data":"8164ddbcffe2a9c0f4a5b7ff2ab4646186f6026ef31866f2503792841e651f3b"}
May 21 15:15:21.856653 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:21.856545    2563 scope.go:117] "RemoveContainer" containerID="8164ddbcffe2a9c0f4a5b7ff2ab4646186f6026ef31866f2503792841e651f3b"
May 21 15:15:21.858174 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:21.858153    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:21.858324 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:21.858308    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:15:21.858371 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:21.858363    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls podName:74e36400-e696-4725-845f-21b2237d3286 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:25.858346774 +0000 UTC m=+127.931662887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lpvzq" (UID: "74e36400-e696-4725-845f-21b2237d3286") : secret "cluster-monitoring-operator-tls" not found
May 21 15:15:22.160438 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:22.160384    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:22.160604 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:22.160536    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:15:22.160604 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:22.160557    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548477549c-lrqbb: secret "image-registry-tls" not found
May 21 15:15:22.160674 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:22.160614    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls podName:06469386-abb1-4f57-b8c3-7cd2182aec92 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:26.160598427 +0000 UTC m=+128.233914540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls") pod "image-registry-548477549c-lrqbb" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92") : secret "image-registry-tls" not found
May 21 15:15:22.859997 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:22.859970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:15:22.860359 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:22.860326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/0.log"
May 21 15:15:22.860414 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:22.860359    2563 generic.go:358] "Generic (PLEG): container finished" podID="b45993a1-6d5e-461b-818d-8c920f6fee99" containerID="f050d8f3a8ee78af8e3ea86302cda93457cdb5ba0ef7f8d6d9fe7b2996b290f6" exitCode=255
May 21 15:15:22.860414 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:22.860394    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" event={"ID":"b45993a1-6d5e-461b-818d-8c920f6fee99","Type":"ContainerDied","Data":"f050d8f3a8ee78af8e3ea86302cda93457cdb5ba0ef7f8d6d9fe7b2996b290f6"}
May 21 15:15:22.860501 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:22.860443    2563 scope.go:117] "RemoveContainer" containerID="8164ddbcffe2a9c0f4a5b7ff2ab4646186f6026ef31866f2503792841e651f3b"
May 21 15:15:22.860680 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:22.860665    2563 scope.go:117] "RemoveContainer" containerID="f050d8f3a8ee78af8e3ea86302cda93457cdb5ba0ef7f8d6d9fe7b2996b290f6"
May 21 15:15:22.860880 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:22.860863    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-46p5l_openshift-console-operator(b45993a1-6d5e-461b-818d-8c920f6fee99)\"" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" podUID="b45993a1-6d5e-461b-818d-8c920f6fee99"
May 21 15:15:23.317637 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.317605    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"]
May 21 15:15:23.320119 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.320103    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"
May 21 15:15:23.322816 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.322786    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 21 15:15:23.322942 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.322852    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5brck\""
May 21 15:15:23.323852 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.323834    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 21 15:15:23.336677 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.336655    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"]
May 21 15:15:23.469377 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.469329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwj6\" (UniqueName: \"kubernetes.io/projected/8a40ba7e-c689-46bb-9d26-16584531c815-kube-api-access-dlwj6\") pod \"migrator-b985f5d89-g2cxq\" (UID: \"8a40ba7e-c689-46bb-9d26-16584531c815\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"
May 21 15:15:23.570735 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.570654    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwj6\" (UniqueName: \"kubernetes.io/projected/8a40ba7e-c689-46bb-9d26-16584531c815-kube-api-access-dlwj6\") pod \"migrator-b985f5d89-g2cxq\" (UID: \"8a40ba7e-c689-46bb-9d26-16584531c815\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"
May 21 15:15:23.578905 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.578880    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwj6\" (UniqueName: \"kubernetes.io/projected/8a40ba7e-c689-46bb-9d26-16584531c815-kube-api-access-dlwj6\") pod \"migrator-b985f5d89-g2cxq\" (UID: \"8a40ba7e-c689-46bb-9d26-16584531c815\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"
May 21 15:15:23.628062 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.628035    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"
May 21 15:15:23.747540 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.747508    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq"]
May 21 15:15:23.750513 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:15:23.750479    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a40ba7e_c689_46bb_9d26_16584531c815.slice/crio-ed54943a1b15a9843df26a1d2aff4581fa1551811aca14ee21f71623a06c8131 WatchSource:0}: Error finding container ed54943a1b15a9843df26a1d2aff4581fa1551811aca14ee21f71623a06c8131: Status 404 returned error can't find the container with id ed54943a1b15a9843df26a1d2aff4581fa1551811aca14ee21f71623a06c8131
May 21 15:15:23.863370 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.863296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:15:23.863796 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.863693    2563 scope.go:117] "RemoveContainer" containerID="f050d8f3a8ee78af8e3ea86302cda93457cdb5ba0ef7f8d6d9fe7b2996b290f6"
May 21 15:15:23.863907 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:23.863884    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-46p5l_openshift-console-operator(b45993a1-6d5e-461b-818d-8c920f6fee99)\"" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" podUID="b45993a1-6d5e-461b-818d-8c920f6fee99"
May 21 15:15:23.864409 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:23.864385    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq" event={"ID":"8a40ba7e-c689-46bb-9d26-16584531c815","Type":"ContainerStarted","Data":"ed54943a1b15a9843df26a1d2aff4581fa1551811aca14ee21f71623a06c8131"}
May 21 15:15:25.416836 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.416812    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vmq8h_aa1679b9-82e5-444a-a890-1cda5c1baa85/dns-node-resolver/0.log"
May 21 15:15:25.728964 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.728879    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lzjbr"]
May 21 15:15:25.730864 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.730841    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.733336 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.733308    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 15:15:25.733336 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.733319    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-csk49\""
May 21 15:15:25.734275 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.734259    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 15:15:25.734342 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.734281    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 15:15:25.734342 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.734290    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 15:15:25.739348 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.739327    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lzjbr"]
May 21 15:15:25.871158 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.871113    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq" event={"ID":"8a40ba7e-c689-46bb-9d26-16584531c815","Type":"ContainerStarted","Data":"23ecfdf34b00165dd91c698279a817e3340607b91f2b5344e58d8a87cfa48030"}
May 21 15:15:25.871158 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.871157    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq" event={"ID":"8a40ba7e-c689-46bb-9d26-16584531c815","Type":"ContainerStarted","Data":"ad2487c0c305bc1a1a8c7cbe363936b1ecef2289a20f76a310ae6300a7762ff7"}
May 21 15:15:25.888657 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.888615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-signing-key\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.888807 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.888662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-signing-cabundle\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.888807 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.888736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7lz4\" (UniqueName: \"kubernetes.io/projected/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-kube-api-access-t7lz4\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.888923 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.888808    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:25.888923 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.888813    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-g2cxq" podStartSLOduration=1.5217710100000001 podStartE2EDuration="2.888801099s" podCreationTimestamp="2026-05-21 15:15:23 +0000 UTC" firstStartedPulling="2026-05-21 15:15:23.752315741 +0000 UTC m=+125.825631854" lastFinishedPulling="2026-05-21 15:15:25.119345827 +0000 UTC m=+127.192661943" observedRunningTime="2026-05-21 15:15:25.888657094 +0000 UTC m=+127.961973229" watchObservedRunningTime="2026-05-21 15:15:25.888801099 +0000 UTC m=+127.962117235"
May 21 15:15:25.888923 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:25.888919    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:15:25.889044 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:25.888976    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls podName:74e36400-e696-4725-845f-21b2237d3286 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:33.888962084 +0000 UTC m=+135.962278211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lpvzq" (UID: "74e36400-e696-4725-845f-21b2237d3286") : secret "cluster-monitoring-operator-tls" not found
May 21 15:15:25.989267 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.989189    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7lz4\" (UniqueName: \"kubernetes.io/projected/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-kube-api-access-t7lz4\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.989401 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.989309    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-signing-key\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.989401 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.989333    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-signing-cabundle\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.990131 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.990061    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-signing-cabundle\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.991892 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.991869    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-signing-key\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:25.997733 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:25.997711    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7lz4\" (UniqueName: \"kubernetes.io/projected/66380b39-9d72-4d92-ab94-a1cdfbc9c5c3-kube-api-access-t7lz4\") pod \"service-ca-67d667c7d-lzjbr\" (UID: \"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3\") " pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:26.018198 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:26.018181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68nzt_57ac6b42-6423-40b8-8609-1ba404d0b21a/node-ca/0.log"
May 21 15:15:26.039690 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:26.039657    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-lzjbr"
May 21 15:15:26.162503 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:26.162445    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-lzjbr"]
May 21 15:15:26.166936 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:15:26.166912    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66380b39_9d72_4d92_ab94_a1cdfbc9c5c3.slice/crio-62d8df4ea00c15e64a90fc5bc75dde7b1fd0b0223937f3b19336dabdfa57acd8 WatchSource:0}: Error finding container 62d8df4ea00c15e64a90fc5bc75dde7b1fd0b0223937f3b19336dabdfa57acd8: Status 404 returned error can't find the container with id 62d8df4ea00c15e64a90fc5bc75dde7b1fd0b0223937f3b19336dabdfa57acd8
May 21 15:15:26.191945 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:26.191914    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:26.192046 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:26.192020    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:15:26.192046 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:26.192030    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548477549c-lrqbb: secret "image-registry-tls" not found
May 21 15:15:26.192118 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:26.192085    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls podName:06469386-abb1-4f57-b8c3-7cd2182aec92 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:34.192069992 +0000 UTC m=+136.265386105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls") pod "image-registry-548477549c-lrqbb" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92") : secret "image-registry-tls" not found
May 21 15:15:26.875015 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:26.874979    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lzjbr" event={"ID":"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3","Type":"ContainerStarted","Data":"62d8df4ea00c15e64a90fc5bc75dde7b1fd0b0223937f3b19336dabdfa57acd8"}
May 21 15:15:28.207054 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:28.207004    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:15:28.207485 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:28.207169    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 15:15:28.207485 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:28.207261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs podName:558c0f01-4351-454c-9ca8-0e6cf4bc0887 nodeName:}" failed. No retries permitted until 2026-05-21 15:17:30.207244298 +0000 UTC m=+252.280560414 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs") pod "network-metrics-daemon-xf7bw" (UID: "558c0f01-4351-454c-9ca8-0e6cf4bc0887") : secret "metrics-daemon-secret" not found
May 21 15:15:28.517647 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:28.517573    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:28.518026 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:28.518012    2563 scope.go:117] "RemoveContainer" containerID="f050d8f3a8ee78af8e3ea86302cda93457cdb5ba0ef7f8d6d9fe7b2996b290f6"
May 21 15:15:28.518204 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:28.518188    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-46p5l_openshift-console-operator(b45993a1-6d5e-461b-818d-8c920f6fee99)\"" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" podUID="b45993a1-6d5e-461b-818d-8c920f6fee99"
May 21 15:15:28.881965 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:28.881881    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-lzjbr" event={"ID":"66380b39-9d72-4d92-ab94-a1cdfbc9c5c3","Type":"ContainerStarted","Data":"402eb874c43dbb1df1c536eb0b8a658a881db8288c4a58cab35f298fdb2007fc"}
May 21 15:15:28.897385 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:28.897324    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-lzjbr" podStartSLOduration=1.528538324 podStartE2EDuration="3.897306478s" podCreationTimestamp="2026-05-21 15:15:25 +0000 UTC" firstStartedPulling="2026-05-21 15:15:26.168768963 +0000 UTC m=+128.242085077" lastFinishedPulling="2026-05-21 15:15:28.537537104 +0000 UTC m=+130.610853231" observedRunningTime="2026-05-21 15:15:28.896704297 +0000 UTC m=+130.970020433" watchObservedRunningTime="2026-05-21 15:15:28.897306478 +0000 UTC m=+130.970622615"
May 21 15:15:30.851294 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:30.851257    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:30.851777 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:30.851749    2563 scope.go:117] "RemoveContainer" containerID="f050d8f3a8ee78af8e3ea86302cda93457cdb5ba0ef7f8d6d9fe7b2996b290f6"
May 21 15:15:30.851967 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:30.851945    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-46p5l_openshift-console-operator(b45993a1-6d5e-461b-818d-8c920f6fee99)\"" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" podUID="b45993a1-6d5e-461b-818d-8c920f6fee99"
May 21 15:15:33.955416 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:33.955363    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:33.955827 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:33.955525    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 15:15:33.955827 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:33.955604    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls podName:74e36400-e696-4725-845f-21b2237d3286 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:49.955587974 +0000 UTC m=+152.028904087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lpvzq" (UID: "74e36400-e696-4725-845f-21b2237d3286") : secret "cluster-monitoring-operator-tls" not found
May 21 15:15:34.257701 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.257616    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:34.260105 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.260084    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"image-registry-548477549c-lrqbb\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") " pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:34.525764 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.525682    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jhr97\""
May 21 15:15:34.533836 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.533815    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:34.659735 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.659703    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548477549c-lrqbb"]
May 21 15:15:34.662836 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:15:34.662801    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06469386_abb1_4f57_b8c3_7cd2182aec92.slice/crio-bdaaa03dab5c8560fbd5335e6aaa45c243a5216f710f9c671e5483098d4f3c41 WatchSource:0}: Error finding container bdaaa03dab5c8560fbd5335e6aaa45c243a5216f710f9c671e5483098d4f3c41: Status 404 returned error can't find the container with id bdaaa03dab5c8560fbd5335e6aaa45c243a5216f710f9c671e5483098d4f3c41
May 21 15:15:34.898965 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.898930    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548477549c-lrqbb" event={"ID":"06469386-abb1-4f57-b8c3-7cd2182aec92","Type":"ContainerStarted","Data":"bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273"}
May 21 15:15:34.898965 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.898966    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548477549c-lrqbb" event={"ID":"06469386-abb1-4f57-b8c3-7cd2182aec92","Type":"ContainerStarted","Data":"bdaaa03dab5c8560fbd5335e6aaa45c243a5216f710f9c671e5483098d4f3c41"}
May 21 15:15:34.899211 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.899049    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:15:34.939834 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:34.939783    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-548477549c-lrqbb" podStartSLOduration=16.939768722 podStartE2EDuration="16.939768722s" podCreationTimestamp="2026-05-21 15:15:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:15:34.938207847 +0000 UTC m=+137.011523982" watchObservedRunningTime="2026-05-21 15:15:34.939768722 +0000 UTC m=+137.013084857"
May 21 15:15:43.519841 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:43.519806    2563 scope.go:117] "RemoveContainer" containerID="f050d8f3a8ee78af8e3ea86302cda93457cdb5ba0ef7f8d6d9fe7b2996b290f6"
May 21 15:15:43.924477 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:43.924446    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:15:43.924676 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:43.924512    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-46p5l" event={"ID":"b45993a1-6d5e-461b-818d-8c920f6fee99","Type":"ContainerStarted","Data":"122f50f2a39b2b352de5e9b13347805f90f9a43d59164a4db2cb266e10588d00"}
May 21 15:15:43.925676 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:43.925651    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:43.930247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:43.930224    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-46p5l"
May 21 15:15:47.088576 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.088538    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fwq4m"]
May 21 15:15:47.090577 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.090561    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.094515 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.094477    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 15:15:47.095764 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.095587    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 15:15:47.095764 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.095606    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 15:15:47.095764 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.095707    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fv6sn\""
May 21 15:15:47.096016 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.095862    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 15:15:47.109692 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.109670    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwq4m"]
May 21 15:15:47.156445 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.156397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb2z4\" (UniqueName: \"kubernetes.io/projected/e89dbd7d-1825-493a-8760-d485dd3ad879-kube-api-access-tb2z4\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.156762 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.156731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e89dbd7d-1825-493a-8760-d485dd3ad879-data-volume\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.156907 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.156891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e89dbd7d-1825-493a-8760-d485dd3ad879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.157122 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.157107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e89dbd7d-1825-493a-8760-d485dd3ad879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.157287 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.157264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e89dbd7d-1825-493a-8760-d485dd3ad879-crio-socket\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.177279 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.177247    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548477549c-lrqbb"]
May 21 15:15:47.257792 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.257759    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e89dbd7d-1825-493a-8760-d485dd3ad879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.257792 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.257798    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e89dbd7d-1825-493a-8760-d485dd3ad879-crio-socket\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.258037 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.257851    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tb2z4\" (UniqueName: \"kubernetes.io/projected/e89dbd7d-1825-493a-8760-d485dd3ad879-kube-api-access-tb2z4\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.258037 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.257874    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e89dbd7d-1825-493a-8760-d485dd3ad879-data-volume\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.258037 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.257894    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e89dbd7d-1825-493a-8760-d485dd3ad879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.258037 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.258026    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e89dbd7d-1825-493a-8760-d485dd3ad879-crio-socket\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.258287 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.258271    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e89dbd7d-1825-493a-8760-d485dd3ad879-data-volume\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.258515 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.258489    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e89dbd7d-1825-493a-8760-d485dd3ad879-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.260355 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.260330    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e89dbd7d-1825-493a-8760-d485dd3ad879-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.279353 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.279322    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb2z4\" (UniqueName: \"kubernetes.io/projected/e89dbd7d-1825-493a-8760-d485dd3ad879-kube-api-access-tb2z4\") pod \"insights-runtime-extractor-fwq4m\" (UID: \"e89dbd7d-1825-493a-8760-d485dd3ad879\") " pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.400636 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.400604    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwq4m"
May 21 15:15:47.536809 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.536776    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwq4m"]
May 21 15:15:47.541120 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:15:47.541085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89dbd7d_1825_493a_8760_d485dd3ad879.slice/crio-032aa258aab5a5addb9567ce9ecb0101d1e4d04e396e709c23f4dddd6ea6c92f WatchSource:0}: Error finding container 032aa258aab5a5addb9567ce9ecb0101d1e4d04e396e709c23f4dddd6ea6c92f: Status 404 returned error can't find the container with id 032aa258aab5a5addb9567ce9ecb0101d1e4d04e396e709c23f4dddd6ea6c92f
May 21 15:15:47.936909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.936873    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwq4m" event={"ID":"e89dbd7d-1825-493a-8760-d485dd3ad879","Type":"ContainerStarted","Data":"ebdc6b5fdc66b231670bdcbeca76124bbe3e31c726686d90b962310d9882b5bb"}
May 21 15:15:47.936909 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:47.936907    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwq4m" event={"ID":"e89dbd7d-1825-493a-8760-d485dd3ad879","Type":"ContainerStarted","Data":"032aa258aab5a5addb9567ce9ecb0101d1e4d04e396e709c23f4dddd6ea6c92f"}
May 21 15:15:48.941414 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:48.941375    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwq4m" event={"ID":"e89dbd7d-1825-493a-8760-d485dd3ad879","Type":"ContainerStarted","Data":"d705c35cecff52e0dbd1b3f284ef3d0e55b2c1ef51fbaaaceb0cccad5caefda4"}
May 21 15:15:49.944955 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:49.944921    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwq4m" event={"ID":"e89dbd7d-1825-493a-8760-d485dd3ad879","Type":"ContainerStarted","Data":"dc87f783d219e0ef539b9f2a92a2797d2bb0159c4fd078eaa511033dc8d896ce"}
May 21 15:15:49.962345 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:49.962297    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fwq4m" podStartSLOduration=1.018747288 podStartE2EDuration="2.962283372s" podCreationTimestamp="2026-05-21 15:15:47 +0000 UTC" firstStartedPulling="2026-05-21 15:15:47.595095627 +0000 UTC m=+149.668411743" lastFinishedPulling="2026-05-21 15:15:49.538631706 +0000 UTC m=+151.611947827" observedRunningTime="2026-05-21 15:15:49.960509409 +0000 UTC m=+152.033825544" watchObservedRunningTime="2026-05-21 15:15:49.962283372 +0000 UTC m=+152.035599551"
May 21 15:15:49.979900 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:49.979876    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:49.982438 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:49.982403    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74e36400-e696-4725-845f-21b2237d3286-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lpvzq\" (UID: \"74e36400-e696-4725-845f-21b2237d3286\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:50.220574 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:50.220479    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rwk9c\""
May 21 15:15:50.228832 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:50.228806    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"
May 21 15:15:50.352867 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:50.352836    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq"]
May 21 15:15:50.356126 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:15:50.356085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e36400_e696_4725_845f_21b2237d3286.slice/crio-48a3eda90bc99252faac242b18c6032def3181f06fd8807c7eadf987e25e75b7 WatchSource:0}: Error finding container 48a3eda90bc99252faac242b18c6032def3181f06fd8807c7eadf987e25e75b7: Status 404 returned error can't find the container with id 48a3eda90bc99252faac242b18c6032def3181f06fd8807c7eadf987e25e75b7
May 21 15:15:50.949331 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:50.949290    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq" event={"ID":"74e36400-e696-4725-845f-21b2237d3286","Type":"ContainerStarted","Data":"48a3eda90bc99252faac242b18c6032def3181f06fd8807c7eadf987e25e75b7"}
May 21 15:15:52.960653 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:52.960617    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq" event={"ID":"74e36400-e696-4725-845f-21b2237d3286","Type":"ContainerStarted","Data":"a9e55f459ad87052902738d0253c42fe312ab3e3440e8016010e703a855e30bf"}
May 21 15:15:52.977961 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:52.977897    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lpvzq" podStartSLOduration=33.038341115 podStartE2EDuration="34.977878796s" podCreationTimestamp="2026-05-21 15:15:18 +0000 UTC" firstStartedPulling="2026-05-21 15:15:50.35809186 +0000 UTC m=+152.431407992" lastFinishedPulling="2026-05-21 15:15:52.297629557 +0000 UTC m=+154.370945673" observedRunningTime="2026-05-21 15:15:52.975825577 +0000 UTC m=+155.049141712" watchObservedRunningTime="2026-05-21 15:15:52.977878796 +0000 UTC m=+155.051194913"
May 21 15:15:56.292641 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:56.292592    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h68r8" podUID="85536ca0-0e61-473b-99ff-847a9463e9e1"
May 21 15:15:56.305752 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:56.305720    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-g2bwf" podUID="e212c79f-794d-4d09-a85e-ccd3320d58d6"
May 21 15:15:56.970350 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:56.970313    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h68r8"
May 21 15:15:57.182605 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:57.182570    2563 patch_prober.go:28] interesting pod/image-registry-548477549c-lrqbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 21 15:15:57.182780 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:15:57.182629    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-548477549c-lrqbb" podUID="06469386-abb1-4f57-b8c3-7cd2182aec92" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 15:15:57.534664 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:15:57.534615    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xf7bw" podUID="558c0f01-4351-454c-9ca8-0e6cf4bc0887"
May 21 15:16:01.273364 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.273307    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:16:01.273878 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.273375    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:16:01.275858 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.275834    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/85536ca0-0e61-473b-99ff-847a9463e9e1-metrics-tls\") pod \"dns-default-h68r8\" (UID: \"85536ca0-0e61-473b-99ff-847a9463e9e1\") " pod="openshift-dns/dns-default-h68r8"
May 21 15:16:01.276012 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.275989    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e212c79f-794d-4d09-a85e-ccd3320d58d6-cert\") pod \"ingress-canary-g2bwf\" (UID: \"e212c79f-794d-4d09-a85e-ccd3320d58d6\") " pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:16:01.473764 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.473729    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d98kf\""
May 21 15:16:01.481789 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.481765    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h68r8"
May 21 15:16:01.623555 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.623521    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h68r8"]
May 21 15:16:01.626970 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:01.626934    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85536ca0_0e61_473b_99ff_847a9463e9e1.slice/crio-f81832422c244a2a42dfa7d24ba8edffcc0a8e16050c3a12075f4cd81b6807e3 WatchSource:0}: Error finding container f81832422c244a2a42dfa7d24ba8edffcc0a8e16050c3a12075f4cd81b6807e3: Status 404 returned error can't find the container with id f81832422c244a2a42dfa7d24ba8edffcc0a8e16050c3a12075f4cd81b6807e3
May 21 15:16:01.983193 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:01.983152    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h68r8" event={"ID":"85536ca0-0e61-473b-99ff-847a9463e9e1","Type":"ContainerStarted","Data":"f81832422c244a2a42dfa7d24ba8edffcc0a8e16050c3a12075f4cd81b6807e3"}
May 21 15:16:02.987807 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:02.987778    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h68r8" event={"ID":"85536ca0-0e61-473b-99ff-847a9463e9e1","Type":"ContainerStarted","Data":"32006dcfb86dfbd42d711904bb39ab4d9759bb2b168049a953313f62f46265b0"}
May 21 15:16:03.974782 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.974744    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fbc6c5756-jbhzc"]
May 21 15:16:03.976716 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.976695    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:03.979188 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.979161    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 15:16:03.979312 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.979190    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 15:16:03.979312 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.979221    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 15:16:03.980399 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.980371    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 15:16:03.980399 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.980394    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 15:16:03.980555 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.980472    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tbb7l\""
May 21 15:16:03.980792 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.980777    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 15:16:03.980840 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.980779    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 15:16:03.986291 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.986274    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 15:16:03.987985 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.987969    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbc6c5756-jbhzc"]
May 21 15:16:03.992587 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.992566    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h68r8" event={"ID":"85536ca0-0e61-473b-99ff-847a9463e9e1","Type":"ContainerStarted","Data":"94f7ccdfbbb5b02ba8bcf517137ee174c5fc9fa8c33361f1eacc59ee4fe1bd99"}
May 21 15:16:03.992687 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:03.992672    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h68r8"
May 21 15:16:04.020123 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.020075    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-h68r8" podStartSLOduration=129.821020139 podStartE2EDuration="2m11.020063184s" podCreationTimestamp="2026-05-21 15:13:53 +0000 UTC" firstStartedPulling="2026-05-21 15:16:01.629367237 +0000 UTC m=+163.702683354" lastFinishedPulling="2026-05-21 15:16:02.828410283 +0000 UTC m=+164.901726399" observedRunningTime="2026-05-21 15:16:04.019817547 +0000 UTC m=+166.093133681" watchObservedRunningTime="2026-05-21 15:16:04.020063184 +0000 UTC m=+166.093379319"
May 21 15:16:04.096438 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.096371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-console-config\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.096620 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.096473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-service-ca\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.096620 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.096501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-oauth-config\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.096620 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.096573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-oauth-serving-cert\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.096760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.096635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdcb\" (UniqueName: \"kubernetes.io/projected/63a49619-720f-44f2-9a20-e8e9e38abce8-kube-api-access-lkdcb\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.096760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.096680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-trusted-ca-bundle\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.096849 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.096761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-serving-cert\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.197755 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.197719    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-serving-cert\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.197934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.197769    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-console-config\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.197934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.197814    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-service-ca\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.197934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.197832    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-oauth-config\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.197934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.197851    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-oauth-serving-cert\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.197934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.197881    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdcb\" (UniqueName: \"kubernetes.io/projected/63a49619-720f-44f2-9a20-e8e9e38abce8-kube-api-access-lkdcb\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.197934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.197922    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-trusted-ca-bundle\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.198867 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.198838    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-oauth-serving-cert\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.199004 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.198844    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-service-ca\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.199004 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.198884    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-trusted-ca-bundle\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.199114 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.199085    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-console-config\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.200571 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.200540    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-serving-cert\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.200676 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.200571    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-oauth-config\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.206071 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.206039    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdcb\" (UniqueName: \"kubernetes.io/projected/63a49619-720f-44f2-9a20-e8e9e38abce8-kube-api-access-lkdcb\") pod \"console-5fbc6c5756-jbhzc\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") " pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.288157 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.288066    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:04.411382 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.411348    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fbc6c5756-jbhzc"]
May 21 15:16:04.414540 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:04.414509    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a49619_720f_44f2_9a20_e8e9e38abce8.slice/crio-ae5d6ca0231401009732f656a36fcf4fb3324131d83895f16c9cd2d373f2fabb WatchSource:0}: Error finding container ae5d6ca0231401009732f656a36fcf4fb3324131d83895f16c9cd2d373f2fabb: Status 404 returned error can't find the container with id ae5d6ca0231401009732f656a36fcf4fb3324131d83895f16c9cd2d373f2fabb
May 21 15:16:04.996169 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:04.996129    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbc6c5756-jbhzc" event={"ID":"63a49619-720f-44f2-9a20-e8e9e38abce8","Type":"ContainerStarted","Data":"ae5d6ca0231401009732f656a36fcf4fb3324131d83895f16c9cd2d373f2fabb"}
May 21 15:16:07.182939 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.182904    2563 patch_prober.go:28] interesting pod/image-registry-548477549c-lrqbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 21 15:16:07.183398 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.182966    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-548477549c-lrqbb" podUID="06469386-abb1-4f57-b8c3-7cd2182aec92" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 15:16:07.206654 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.204009    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"]
May 21 15:16:07.210626 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.210600    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.214137 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.213757    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 21 15:16:07.214137 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.213839    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 15:16:07.214137 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.213991    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 21 15:16:07.214137 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.214092    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jg4ng\""
May 21 15:16:07.219955 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.218460    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"]
May 21 15:16:07.219955 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.219861    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"]
May 21 15:16:07.224994 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.224364    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.227446 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.227370    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tpl4h\""
May 21 15:16:07.227716 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.227692    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-24lgb"]
May 21 15:16:07.227826 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.227801    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 15:16:07.228027 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.228010    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 15:16:07.228250 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.228233    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 15:16:07.230058 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.230040    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.234882 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.233642    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 15:16:07.234882 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.233830    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8zxxj\""
May 21 15:16:07.234882 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.234064    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 15:16:07.234882 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.234248    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 15:16:07.236214 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.236194    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"]
May 21 15:16:07.330443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-wtmp\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.330443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-root\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.330443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-textfile\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.330443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330389    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7aaaa7c-3dc2-419c-8340-fea861bdea26-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-tls\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a84bad7-0fca-43df-8465-b0fa866d109c-metrics-client-ca\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpnrb\" (UniqueName: \"kubernetes.io/projected/f7aaaa7c-3dc2-419c-8340-fea861bdea26-kube-api-access-wpnrb\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-accelerators-collector-config\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n59x\" (UniqueName: \"kubernetes.io/projected/5a84bad7-0fca-43df-8465-b0fa866d109c-kube-api-access-2n59x\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33847839-0d7f-415b-b1e6-1eb795292430-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.330752 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.331097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7aaaa7c-3dc2-419c-8340-fea861bdea26-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.331097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7aaaa7c-3dc2-419c-8340-fea861bdea26-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.331097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-sys\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.331097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.331097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/33847839-0d7f-415b-b1e6-1eb795292430-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.331097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.331097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.330929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbl2t\" (UniqueName: \"kubernetes.io/projected/33847839-0d7f-415b-b1e6-1eb795292430-kube-api-access-bbl2t\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.432198 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432168    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33847839-0d7f-415b-b1e6-1eb795292430-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.432313 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432213    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.432313 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432255    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7aaaa7c-3dc2-419c-8340-fea861bdea26-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.432313 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432283    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7aaaa7c-3dc2-419c-8340-fea861bdea26-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.432486 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432347    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-sys\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.432486 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432388    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432681    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/33847839-0d7f-415b-b1e6-1eb795292430-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432724    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432774    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbl2t\" (UniqueName: \"kubernetes.io/projected/33847839-0d7f-415b-b1e6-1eb795292430-kube-api-access-bbl2t\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432834    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-wtmp\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432875    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-root\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432899    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-textfile\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432924    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432970    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7aaaa7c-3dc2-419c-8340-fea861bdea26-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.432997    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-tls\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433022    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a84bad7-0fca-43df-8465-b0fa866d109c-metrics-client-ca\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433053    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpnrb\" (UniqueName: \"kubernetes.io/projected/f7aaaa7c-3dc2-419c-8340-fea861bdea26-kube-api-access-wpnrb\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433079    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-accelerators-collector-config\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433111    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n59x\" (UniqueName: \"kubernetes.io/projected/5a84bad7-0fca-43df-8465-b0fa866d109c-kube-api-access-2n59x\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433168    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433330    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33847839-0d7f-415b-b1e6-1eb795292430-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.433356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-root\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.434454 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433611    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/33847839-0d7f-415b-b1e6-1eb795292430-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.434454 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433868    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-textfile\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.434454 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a84bad7-0fca-43df-8465-b0fa866d109c-metrics-client-ca\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.434454 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.433965    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-sys\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.434454 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.434134    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-accelerators-collector-config\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.434454 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.434338    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-wtmp\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.434765 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.434617    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7aaaa7c-3dc2-419c-8340-fea861bdea26-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.435243 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.435196    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7aaaa7c-3dc2-419c-8340-fea861bdea26-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.436270 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.436237    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.436789 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.436760    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a84bad7-0fca-43df-8465-b0fa866d109c-node-exporter-tls\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.437216 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.437189    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.437517 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.437499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33847839-0d7f-415b-b1e6-1eb795292430-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.437866 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.437848    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7aaaa7c-3dc2-419c-8340-fea861bdea26-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.440915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.440888    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbl2t\" (UniqueName: \"kubernetes.io/projected/33847839-0d7f-415b-b1e6-1eb795292430-kube-api-access-bbl2t\") pod \"kube-state-metrics-54fd6bc5c4-f9tfx\" (UID: \"33847839-0d7f-415b-b1e6-1eb795292430\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.441111 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.441093    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpnrb\" (UniqueName: \"kubernetes.io/projected/f7aaaa7c-3dc2-419c-8340-fea861bdea26-kube-api-access-wpnrb\") pod \"openshift-state-metrics-9c959559f-ccl6m\" (UID: \"f7aaaa7c-3dc2-419c-8340-fea861bdea26\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.441171 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.441154    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n59x\" (UniqueName: \"kubernetes.io/projected/5a84bad7-0fca-43df-8465-b0fa866d109c-kube-api-access-2n59x\") pod \"node-exporter-24lgb\" (UID: \"5a84bad7-0fca-43df-8465-b0fa866d109c\") " pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.530633 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.530595    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"
May 21 15:16:07.540955 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.540927    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"
May 21 15:16:07.548746 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.548717    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-24lgb"
May 21 15:16:07.559284 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:07.559231    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a84bad7_0fca_43df_8465_b0fa866d109c.slice/crio-88361e3ec71aca25257c0aeca819d663bb416728938aa513fd1621280cde05f0 WatchSource:0}: Error finding container 88361e3ec71aca25257c0aeca819d663bb416728938aa513fd1621280cde05f0: Status 404 returned error can't find the container with id 88361e3ec71aca25257c0aeca819d663bb416728938aa513fd1621280cde05f0
May 21 15:16:07.682042 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.681989    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m"]
May 21 15:16:07.685248 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:07.685223    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7aaaa7c_3dc2_419c_8340_fea861bdea26.slice/crio-636574e5f7aa1cbcc092245c478c3d1f6c11d2bc33d3683823d3dcb8d281daa9 WatchSource:0}: Error finding container 636574e5f7aa1cbcc092245c478c3d1f6c11d2bc33d3683823d3dcb8d281daa9: Status 404 returned error can't find the container with id 636574e5f7aa1cbcc092245c478c3d1f6c11d2bc33d3683823d3dcb8d281daa9
May 21 15:16:07.696204 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:07.696178    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx"]
May 21 15:16:07.699227 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:07.699204    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33847839_0d7f_415b_b1e6_1eb795292430.slice/crio-da4e94807e9bc12fa7e43fd98e09cd0d6a88c7536e836c2d26f89ce052283ad4 WatchSource:0}: Error finding container da4e94807e9bc12fa7e43fd98e09cd0d6a88c7536e836c2d26f89ce052283ad4: Status 404 returned error can't find the container with id da4e94807e9bc12fa7e43fd98e09cd0d6a88c7536e836c2d26f89ce052283ad4
May 21 15:16:08.005638 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.005562    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24lgb" event={"ID":"5a84bad7-0fca-43df-8465-b0fa866d109c","Type":"ContainerStarted","Data":"88361e3ec71aca25257c0aeca819d663bb416728938aa513fd1621280cde05f0"}
May 21 15:16:08.006619 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.006586    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx" event={"ID":"33847839-0d7f-415b-b1e6-1eb795292430","Type":"ContainerStarted","Data":"da4e94807e9bc12fa7e43fd98e09cd0d6a88c7536e836c2d26f89ce052283ad4"}
May 21 15:16:08.007854 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.007815    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbc6c5756-jbhzc" event={"ID":"63a49619-720f-44f2-9a20-e8e9e38abce8","Type":"ContainerStarted","Data":"d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e"}
May 21 15:16:08.009414 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.009389    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m" event={"ID":"f7aaaa7c-3dc2-419c-8340-fea861bdea26","Type":"ContainerStarted","Data":"7e843745cbe10ec9a39dac37f2a278827ae4a406a4fdc6bd6f2a0b8ee262b328"}
May 21 15:16:08.009545 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.009436    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m" event={"ID":"f7aaaa7c-3dc2-419c-8340-fea861bdea26","Type":"ContainerStarted","Data":"bd572311daddb67559fd3dbb164fcf60b3ef97a47dc163db999f2d306f2a58fe"}
May 21 15:16:08.009545 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.009452    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m" event={"ID":"f7aaaa7c-3dc2-419c-8340-fea861bdea26","Type":"ContainerStarted","Data":"636574e5f7aa1cbcc092245c478c3d1f6c11d2bc33d3683823d3dcb8d281daa9"}
May 21 15:16:08.025546 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.025502    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5fbc6c5756-jbhzc" podStartSLOduration=2.027284186 podStartE2EDuration="5.025488103s" podCreationTimestamp="2026-05-21 15:16:03 +0000 UTC" firstStartedPulling="2026-05-21 15:16:04.416534618 +0000 UTC m=+166.489850745" lastFinishedPulling="2026-05-21 15:16:07.414738532 +0000 UTC m=+169.488054662" observedRunningTime="2026-05-21 15:16:08.024278665 +0000 UTC m=+170.097594801" watchObservedRunningTime="2026-05-21 15:16:08.025488103 +0000 UTC m=+170.098804238"
May 21 15:16:08.529082 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:08.529052    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:16:09.520493 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:09.520378    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:16:09.523193 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:09.523161    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d4dlc\""
May 21 15:16:09.531920 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:09.531316    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g2bwf"
May 21 15:16:09.663093 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:09.663060    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g2bwf"]
May 21 15:16:09.666472 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:09.666444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode212c79f_794d_4d09_a85e_ccd3320d58d6.slice/crio-54a17c7ceea4e766ba637d7f3fa3be68ee2172d63d5976e0aa0df69a4fc358a7 WatchSource:0}: Error finding container 54a17c7ceea4e766ba637d7f3fa3be68ee2172d63d5976e0aa0df69a4fc358a7: Status 404 returned error can't find the container with id 54a17c7ceea4e766ba637d7f3fa3be68ee2172d63d5976e0aa0df69a4fc358a7
May 21 15:16:10.017036 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.016996    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m" event={"ID":"f7aaaa7c-3dc2-419c-8340-fea861bdea26","Type":"ContainerStarted","Data":"68ebb8ee647702d388158b70e6a9bfdd2da8b4eb12049fdf9c973ccd15134749"}
May 21 15:16:10.018087 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.018056    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g2bwf" event={"ID":"e212c79f-794d-4d09-a85e-ccd3320d58d6","Type":"ContainerStarted","Data":"54a17c7ceea4e766ba637d7f3fa3be68ee2172d63d5976e0aa0df69a4fc358a7"}
May 21 15:16:10.019474 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.019446    2563 generic.go:358] "Generic (PLEG): container finished" podID="5a84bad7-0fca-43df-8465-b0fa866d109c" containerID="7c7853953c57ace074832c39edea69fd3ea01f654b8cee67aa4cc4b44cb6f6b8" exitCode=0
May 21 15:16:10.019585 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.019534    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24lgb" event={"ID":"5a84bad7-0fca-43df-8465-b0fa866d109c","Type":"ContainerDied","Data":"7c7853953c57ace074832c39edea69fd3ea01f654b8cee67aa4cc4b44cb6f6b8"}
May 21 15:16:10.021616 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.021594    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx" event={"ID":"33847839-0d7f-415b-b1e6-1eb795292430","Type":"ContainerStarted","Data":"b221fc9a71e3f12ec558fa5e9df49002a90c55323115871c832aead07f33535c"}
May 21 15:16:10.021726 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.021624    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx" event={"ID":"33847839-0d7f-415b-b1e6-1eb795292430","Type":"ContainerStarted","Data":"049f0c0d3f77e7f62ea3bb28e5f5fc04913c1e0fa5a6b553c6821c3707b2f3c1"}
May 21 15:16:10.021726 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.021638    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx" event={"ID":"33847839-0d7f-415b-b1e6-1eb795292430","Type":"ContainerStarted","Data":"7346428ca7e8a029814ed3ff4a054b5a186835ca84d29d4d6de766bce70d70e8"}
May 21 15:16:10.035014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.034965    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ccl6m" podStartSLOduration=1.559070564 podStartE2EDuration="3.034947457s" podCreationTimestamp="2026-05-21 15:16:07 +0000 UTC" firstStartedPulling="2026-05-21 15:16:07.799261543 +0000 UTC m=+169.872577655" lastFinishedPulling="2026-05-21 15:16:09.275138429 +0000 UTC m=+171.348454548" observedRunningTime="2026-05-21 15:16:10.033579 +0000 UTC m=+172.106895134" watchObservedRunningTime="2026-05-21 15:16:10.034947457 +0000 UTC m=+172.108263593"
May 21 15:16:10.070064 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:10.070005    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f9tfx" podStartSLOduration=1.493522915 podStartE2EDuration="3.069983792s" podCreationTimestamp="2026-05-21 15:16:07 +0000 UTC" firstStartedPulling="2026-05-21 15:16:07.700990842 +0000 UTC m=+169.774306955" lastFinishedPulling="2026-05-21 15:16:09.277451717 +0000 UTC m=+171.350767832" observedRunningTime="2026-05-21 15:16:10.068781348 +0000 UTC m=+172.142097485" watchObservedRunningTime="2026-05-21 15:16:10.069983792 +0000 UTC m=+172.143299930"
May 21 15:16:11.028625 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.028586    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24lgb" event={"ID":"5a84bad7-0fca-43df-8465-b0fa866d109c","Type":"ContainerStarted","Data":"b5721cdc9e49d52cd29fd21360a0633d1fa0320fab0e7356c8873d8808514a3b"}
May 21 15:16:11.028625 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.028630    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-24lgb" event={"ID":"5a84bad7-0fca-43df-8465-b0fa866d109c","Type":"ContainerStarted","Data":"9c7dc223143c05e85d57e44bf59ae7111b7048f701e9f2e61fc0d0030b874c7d"}
May 21 15:16:11.051830 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.051779    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-24lgb" podStartSLOduration=2.3378626860000002 podStartE2EDuration="4.051765502s" podCreationTimestamp="2026-05-21 15:16:07 +0000 UTC" firstStartedPulling="2026-05-21 15:16:07.561309807 +0000 UTC m=+169.634625923" lastFinishedPulling="2026-05-21 15:16:09.275212621 +0000 UTC m=+171.348528739" observedRunningTime="2026-05-21 15:16:11.050135522 +0000 UTC m=+173.123451657" watchObservedRunningTime="2026-05-21 15:16:11.051765502 +0000 UTC m=+173.125081637"
May 21 15:16:11.294732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.294651    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79968bc455-lvvpg"]
May 21 15:16:11.297229 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.297202    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.299923 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.299892    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fkw6k\""
May 21 15:16:11.300075 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.299957    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 21 15:16:11.300075 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.299961    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 21 15:16:11.300075 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.299907    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 21 15:16:11.300245 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.300112    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 21 15:16:11.300245 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.300223    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 21 15:16:11.300343 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.300256    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6eq3foifemjs6\""
May 21 15:16:11.310697 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.310669    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79968bc455-lvvpg"]
May 21 15:16:11.367072 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.367072 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.367306 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.367306 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-tls\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.367306 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.367306 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-grpc-tls\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.367508 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9zwz\" (UniqueName: \"kubernetes.io/projected/4087cde5-9ae5-4358-a41d-5bc18f401312-kube-api-access-d9zwz\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.367508 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.367348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4087cde5-9ae5-4358-a41d-5bc18f401312-metrics-client-ca\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468111 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468068    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468281 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468140    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-tls\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468281 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468170    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468281 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468194    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-grpc-tls\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468281 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468236    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zwz\" (UniqueName: \"kubernetes.io/projected/4087cde5-9ae5-4358-a41d-5bc18f401312-kube-api-access-d9zwz\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468281 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468272    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4087cde5-9ae5-4358-a41d-5bc18f401312-metrics-client-ca\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468579 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468320    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.468579 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.468342    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.469288 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.469256    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4087cde5-9ae5-4358-a41d-5bc18f401312-metrics-client-ca\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.471034 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.471009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.471296 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.471269    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.471392 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.471369    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-tls\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.471452 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.471382    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.471672 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.471650    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.471727 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.471712    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4087cde5-9ae5-4358-a41d-5bc18f401312-secret-grpc-tls\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.475642 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.475620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9zwz\" (UniqueName: \"kubernetes.io/projected/4087cde5-9ae5-4358-a41d-5bc18f401312-kube-api-access-d9zwz\") pod \"thanos-querier-79968bc455-lvvpg\" (UID: \"4087cde5-9ae5-4358-a41d-5bc18f401312\") " pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.519668 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.519638    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"]
May 21 15:16:11.522649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.522628    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.525178 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.525151    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 15:16:11.525286 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.525156    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 21 15:16:11.525349 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.525315    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eol13n9d15chn\""
May 21 15:16:11.525625 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.525605    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 21 15:16:11.525711 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.525635    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 21 15:16:11.525711 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.525659    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2j5xz\""
May 21 15:16:11.536339 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.536319    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"]
May 21 15:16:11.569466 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.569380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-secret-metrics-server-tls\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.569572 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.569500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d216cc3f-47ea-4e36-a52b-25ada4fbed04-metrics-server-audit-profiles\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.569572 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.569521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d216cc3f-47ea-4e36-a52b-25ada4fbed04-audit-log\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.569634 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.569582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d216cc3f-47ea-4e36-a52b-25ada4fbed04-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.569634 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.569629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtdzp\" (UniqueName: \"kubernetes.io/projected/d216cc3f-47ea-4e36-a52b-25ada4fbed04-kube-api-access-wtdzp\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.569701 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.569658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-client-ca-bundle\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.569730 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.569710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-secret-metrics-server-client-certs\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.608459 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.608407    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:11.670624 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.670595    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-client-ca-bundle\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.670734 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.670641    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-secret-metrics-server-client-certs\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.670734 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.670675    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-secret-metrics-server-tls\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.670816 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.670775    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d216cc3f-47ea-4e36-a52b-25ada4fbed04-metrics-server-audit-profiles\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.670816 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.670803    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d216cc3f-47ea-4e36-a52b-25ada4fbed04-audit-log\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.670915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.670829    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d216cc3f-47ea-4e36-a52b-25ada4fbed04-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.670915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.670871    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtdzp\" (UniqueName: \"kubernetes.io/projected/d216cc3f-47ea-4e36-a52b-25ada4fbed04-kube-api-access-wtdzp\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.671761 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.671208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d216cc3f-47ea-4e36-a52b-25ada4fbed04-audit-log\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.671761 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.671698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d216cc3f-47ea-4e36-a52b-25ada4fbed04-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.671965 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.671918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d216cc3f-47ea-4e36-a52b-25ada4fbed04-metrics-server-audit-profiles\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.673124 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.673103    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-client-ca-bundle\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.673402 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.673382    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-secret-metrics-server-client-certs\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.673689 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.673670    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d216cc3f-47ea-4e36-a52b-25ada4fbed04-secret-metrics-server-tls\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.679513 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.679478    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtdzp\" (UniqueName: \"kubernetes.io/projected/d216cc3f-47ea-4e36-a52b-25ada4fbed04-kube-api-access-wtdzp\") pod \"metrics-server-6f8cf7b444-qz4xk\" (UID: \"d216cc3f-47ea-4e36-a52b-25ada4fbed04\") " pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.736539 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.736503    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79968bc455-lvvpg"]
May 21 15:16:11.739925 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:11.739890    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4087cde5_9ae5_4358_a41d_5bc18f401312.slice/crio-cc9d2e9ec5e350d38dcd2d3a65024f8d6951921718905dfe0e5441959223b5b0 WatchSource:0}: Error finding container cc9d2e9ec5e350d38dcd2d3a65024f8d6951921718905dfe0e5441959223b5b0: Status 404 returned error can't find the container with id cc9d2e9ec5e350d38dcd2d3a65024f8d6951921718905dfe0e5441959223b5b0
May 21 15:16:11.832990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.832905    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:11.973497 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:11.973390    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"]
May 21 15:16:11.976386 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:11.976354    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd216cc3f_47ea_4e36_a52b_25ada4fbed04.slice/crio-e69a4cb946a1ad2d6690122e44c0a6fb3d652a311c928cba649aca9000512a8f WatchSource:0}: Error finding container e69a4cb946a1ad2d6690122e44c0a6fb3d652a311c928cba649aca9000512a8f: Status 404 returned error can't find the container with id e69a4cb946a1ad2d6690122e44c0a6fb3d652a311c928cba649aca9000512a8f
May 21 15:16:12.031947 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.031908    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk" event={"ID":"d216cc3f-47ea-4e36-a52b-25ada4fbed04","Type":"ContainerStarted","Data":"e69a4cb946a1ad2d6690122e44c0a6fb3d652a311c928cba649aca9000512a8f"}
May 21 15:16:12.033136 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.033100    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" event={"ID":"4087cde5-9ae5-4358-a41d-5bc18f401312","Type":"ContainerStarted","Data":"cc9d2e9ec5e350d38dcd2d3a65024f8d6951921718905dfe0e5441959223b5b0"}
May 21 15:16:12.034548 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.034521    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g2bwf" event={"ID":"e212c79f-794d-4d09-a85e-ccd3320d58d6","Type":"ContainerStarted","Data":"7bf0136276894f5452c53562c0737ec7536198cc63a4d10a228c9290820e17d7"}
May 21 15:16:12.049003 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.048955    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g2bwf" podStartSLOduration=137.509955752 podStartE2EDuration="2m19.04894191s" podCreationTimestamp="2026-05-21 15:13:53 +0000 UTC" firstStartedPulling="2026-05-21 15:16:09.669011147 +0000 UTC m=+171.742327273" lastFinishedPulling="2026-05-21 15:16:11.207997318 +0000 UTC m=+173.281313431" observedRunningTime="2026-05-21 15:16:12.047872576 +0000 UTC m=+174.121188711" watchObservedRunningTime="2026-05-21 15:16:12.04894191 +0000 UTC m=+174.122258106"
May 21 15:16:12.196574 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.196512    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-548477549c-lrqbb" podUID="06469386-abb1-4f57-b8c3-7cd2182aec92" containerName="registry" containerID="cri-o://bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273" gracePeriod=30
May 21 15:16:12.466275 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.466244    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:16:12.585465 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585404    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-bound-sa-token\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.585632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585487    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.585632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585526    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06469386-abb1-4f57-b8c3-7cd2182aec92-ca-trust-extracted\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.585632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585560    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-trusted-ca\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.585632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585582    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqkbd\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-kube-api-access-wqkbd\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.585632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585612    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-image-registry-private-configuration\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.585864 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585650    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-certificates\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.585864 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.585699    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-installation-pull-secrets\") pod \"06469386-abb1-4f57-b8c3-7cd2182aec92\" (UID: \"06469386-abb1-4f57-b8c3-7cd2182aec92\") "
May 21 15:16:12.586144 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.586111    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:16:12.587374 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.586791    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:16:12.589066 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.589039    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:16:12.589737 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.589699    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:16:12.590073 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.590019    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:16:12.590073 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.590036    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-kube-api-access-wqkbd" (OuterVolumeSpecName: "kube-api-access-wqkbd") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "kube-api-access-wqkbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:16:12.590073 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.590046    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:16:12.597299 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.597271    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06469386-abb1-4f57-b8c3-7cd2182aec92-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "06469386-abb1-4f57-b8c3-7cd2182aec92" (UID: "06469386-abb1-4f57-b8c3-7cd2182aec92"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:16:12.686927 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.686883    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-certificates\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:12.686927 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.686926    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-installation-pull-secrets\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:12.687162 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.686944    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-bound-sa-token\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:12.687162 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.686959    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-registry-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:12.687162 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.686973    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06469386-abb1-4f57-b8c3-7cd2182aec92-ca-trust-extracted\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:12.687162 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.686987    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06469386-abb1-4f57-b8c3-7cd2182aec92-trusted-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:12.687162 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.687001    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqkbd\" (UniqueName: \"kubernetes.io/projected/06469386-abb1-4f57-b8c3-7cd2182aec92-kube-api-access-wqkbd\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:12.687162 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:12.687015    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06469386-abb1-4f57-b8c3-7cd2182aec92-image-registry-private-configuration\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:13.039167 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.039128    2563 generic.go:358] "Generic (PLEG): container finished" podID="06469386-abb1-4f57-b8c3-7cd2182aec92" containerID="bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273" exitCode=0
May 21 15:16:13.039630 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.039486    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548477549c-lrqbb" event={"ID":"06469386-abb1-4f57-b8c3-7cd2182aec92","Type":"ContainerDied","Data":"bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273"}
May 21 15:16:13.039630 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.039551    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548477549c-lrqbb" event={"ID":"06469386-abb1-4f57-b8c3-7cd2182aec92","Type":"ContainerDied","Data":"bdaaa03dab5c8560fbd5335e6aaa45c243a5216f710f9c671e5483098d4f3c41"}
May 21 15:16:13.039630 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.039567    2563 scope.go:117] "RemoveContainer" containerID="bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273"
May 21 15:16:13.039630 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.039523    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548477549c-lrqbb"
May 21 15:16:13.050277 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.050246    2563 scope.go:117] "RemoveContainer" containerID="bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273"
May 21 15:16:13.051369 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:16:13.051255    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273\": container with ID starting with bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273 not found: ID does not exist" containerID="bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273"
May 21 15:16:13.051369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.051320    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273"} err="failed to get container status \"bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273\": rpc error: code = NotFound desc = could not find container \"bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273\": container with ID starting with bae2999c0f21999c79ba44e877783d98a35bf1f2de72e14695583610d2fa2273 not found: ID does not exist"
May 21 15:16:13.070441 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.070378    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548477549c-lrqbb"]
May 21 15:16:13.073966 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.073940    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-548477549c-lrqbb"]
May 21 15:16:13.220184 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.220140    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc46ffc95-mr84k"]
May 21 15:16:13.220513 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.220495    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06469386-abb1-4f57-b8c3-7cd2182aec92" containerName="registry"
May 21 15:16:13.220592 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.220517    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="06469386-abb1-4f57-b8c3-7cd2182aec92" containerName="registry"
May 21 15:16:13.220649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.220600    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="06469386-abb1-4f57-b8c3-7cd2182aec92" containerName="registry"
May 21 15:16:13.222871 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.222847    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.234357 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.234331    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc46ffc95-mr84k"]
May 21 15:16:13.291615 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.291531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-oauth-config\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.291615 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.291584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-serving-cert\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.291809 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.291636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-oauth-serving-cert\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.291809 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.291655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-trusted-ca-bundle\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.291809 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.291681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-service-ca\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.291809 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.291707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-console-config\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.291809 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.291750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbkbm\" (UniqueName: \"kubernetes.io/projected/69badf86-2949-448e-b0a6-77045b38f545-kube-api-access-zbkbm\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.393274 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.393235    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-oauth-config\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.393490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.393287    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-serving-cert\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.393490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.393327    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-oauth-serving-cert\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.393490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.393356    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-trusted-ca-bundle\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.393490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.393381    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-service-ca\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.393490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.393404    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-console-config\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.393742 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.393506    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbkbm\" (UniqueName: \"kubernetes.io/projected/69badf86-2949-448e-b0a6-77045b38f545-kube-api-access-zbkbm\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.394722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.394681    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-oauth-serving-cert\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.394845 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.394733    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-console-config\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.394934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.394912    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-service-ca\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.395213 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.395187    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-trusted-ca-bundle\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.398965 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.396888    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-serving-cert\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.402615 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.402589    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-oauth-config\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.404603 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.404577    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbkbm\" (UniqueName: \"kubernetes.io/projected/69badf86-2949-448e-b0a6-77045b38f545-kube-api-access-zbkbm\") pod \"console-7bc46ffc95-mr84k\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") " pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.533392 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.533337    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:13.565129 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.565040    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:16:13.569603 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.569568    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.572075 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.572048    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 15:16:13.572483 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.572459    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 15:16:13.572598 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.572551    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 15:16:13.572806 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.572789    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 15:16:13.573451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.573219    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 15:16:13.573451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.573243    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 15:16:13.573451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.573287    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 15:16:13.573451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.573299    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7k87v\""
May 21 15:16:13.573451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.573309    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ol0evratli0k\""
May 21 15:16:13.573451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.573445    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 15:16:13.574046 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.574022    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 15:16:13.574351 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.574334    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 15:16:13.574527 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.574508    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 15:16:13.576348 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.576316    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 15:16:13.583248 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.583228    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:16:13.696501 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.696501 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.696760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.696760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config-out\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.696760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.696760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.696760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmf2z\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-kube-api-access-nmf2z\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.696965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697014 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.697006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-web-config\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697323 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.697028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697323 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.697053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697323 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.697086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697323 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.697131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.697323 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.697173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.797851 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.797799    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798044 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.797887    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798044 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.797928    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798044 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.797956    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798044 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.797987    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798044 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798021    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config-out\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798044 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798045    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798073    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798120    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798159    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798182    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798230    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798259    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmf2z\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-kube-api-access-nmf2z\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798299    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798329    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-web-config\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798759 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798356    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798759 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798388    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798759 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798465    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798816    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.798953 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.798892    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.800433 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.800386    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.801703 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.801355    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config-out\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.802929 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.802352    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.802929 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.802409    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.802929 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.802578    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-web-config\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.802929 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.802635    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.803940 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.803598    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.803940 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.803622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.804069 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.804018    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.804069 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.804041    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.804252 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.804214    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.804535 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.804499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.805483 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.805465    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.805705 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.805686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.806408 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.806385    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.810302 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.810268    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmf2z\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-kube-api-access-nmf2z\") pod \"prometheus-k8s-0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.882153 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.882056    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:13.998513 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:13.998485    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h68r8"
May 21 15:16:14.206177 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:14.206149    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc46ffc95-mr84k"]
May 21 15:16:14.209537 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:14.209507    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69badf86_2949_448e_b0a6_77045b38f545.slice/crio-34aad509fd6fdc673afff448c8be22c105cacf0e672886f882bbb9ba7897681c WatchSource:0}: Error finding container 34aad509fd6fdc673afff448c8be22c105cacf0e672886f882bbb9ba7897681c: Status 404 returned error can't find the container with id 34aad509fd6fdc673afff448c8be22c105cacf0e672886f882bbb9ba7897681c
May 21 15:16:14.233996 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:14.233959    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:16:14.242035 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:16:14.241995    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f41d91_b12d_44c6_8a83_fcb8ff727ab0.slice/crio-69079dfb68eddfa9a23b27b83108b5112ddf1ff09cd40322aef5dcfd6dfce9e9 WatchSource:0}: Error finding container 69079dfb68eddfa9a23b27b83108b5112ddf1ff09cd40322aef5dcfd6dfce9e9: Status 404 returned error can't find the container with id 69079dfb68eddfa9a23b27b83108b5112ddf1ff09cd40322aef5dcfd6dfce9e9
May 21 15:16:14.289414 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:14.289388    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:14.289521 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:14.289473    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:14.294890 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:14.294868    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:14.529803 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:14.529759    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06469386-abb1-4f57-b8c3-7cd2182aec92" path="/var/lib/kubelet/pods/06469386-abb1-4f57-b8c3-7cd2182aec92/volumes"
May 21 15:16:15.049813 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.049776    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc46ffc95-mr84k" event={"ID":"69badf86-2949-448e-b0a6-77045b38f545","Type":"ContainerStarted","Data":"9937f9473dd2272d82527fee66c0c464f04d570f97739c9d0d0c19fda7ad54c9"}
May 21 15:16:15.049813 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.049820    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc46ffc95-mr84k" event={"ID":"69badf86-2949-448e-b0a6-77045b38f545","Type":"ContainerStarted","Data":"34aad509fd6fdc673afff448c8be22c105cacf0e672886f882bbb9ba7897681c"}
May 21 15:16:15.050971 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.050941    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerStarted","Data":"69079dfb68eddfa9a23b27b83108b5112ddf1ff09cd40322aef5dcfd6dfce9e9"}
May 21 15:16:15.052674 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.052642    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" event={"ID":"4087cde5-9ae5-4358-a41d-5bc18f401312","Type":"ContainerStarted","Data":"e4742a1faf581b62ece06955a1329dea5c563f3fd3599bf27e55decb93d9f1d1"}
May 21 15:16:15.052824 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.052679    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" event={"ID":"4087cde5-9ae5-4358-a41d-5bc18f401312","Type":"ContainerStarted","Data":"57e27b92623032b684c4023a7b3a4573a50bb2762bd0e07e00d6116777bc6624"}
May 21 15:16:15.052824 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.052695    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" event={"ID":"4087cde5-9ae5-4358-a41d-5bc18f401312","Type":"ContainerStarted","Data":"f5c1f168a1e75d96324f816fa23a32cb0bc85e7744c6ccea5796c2d1d13f517f"}
May 21 15:16:15.053962 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.053936    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk" event={"ID":"d216cc3f-47ea-4e36-a52b-25ada4fbed04","Type":"ContainerStarted","Data":"d38bed4033bfcfa66b09fb41af50612ab89a547c2b97927468d3e089d6f68e5d"}
May 21 15:16:15.057814 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.057788    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:15.067366 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.067301    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bc46ffc95-mr84k" podStartSLOduration=2.067287597 podStartE2EDuration="2.067287597s" podCreationTimestamp="2026-05-21 15:16:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:16:15.066894904 +0000 UTC m=+177.140211040" watchObservedRunningTime="2026-05-21 15:16:15.067287597 +0000 UTC m=+177.140603732"
May 21 15:16:15.082857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:15.082810    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk" podStartSLOduration=2.042700555 podStartE2EDuration="4.082795118s" podCreationTimestamp="2026-05-21 15:16:11 +0000 UTC" firstStartedPulling="2026-05-21 15:16:11.978500177 +0000 UTC m=+174.051816291" lastFinishedPulling="2026-05-21 15:16:14.018594725 +0000 UTC m=+176.091910854" observedRunningTime="2026-05-21 15:16:15.081351391 +0000 UTC m=+177.154667526" watchObservedRunningTime="2026-05-21 15:16:15.082795118 +0000 UTC m=+177.156111311"
May 21 15:16:16.058339 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:16.058243    2563 generic.go:358] "Generic (PLEG): container finished" podID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062" exitCode=0
May 21 15:16:16.058806 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:16.058336    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"}
May 21 15:16:16.061108 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:16.061080    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" event={"ID":"4087cde5-9ae5-4358-a41d-5bc18f401312","Type":"ContainerStarted","Data":"e869527de6ecfa00708ffa6af9c135de24cb12244826f6dc038d752a70221f02"}
May 21 15:16:16.061229 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:16.061113    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" event={"ID":"4087cde5-9ae5-4358-a41d-5bc18f401312","Type":"ContainerStarted","Data":"72dbb7c24c4bbd4bc00f1ce276a8e5a571fb2e1c58618dff037b3fb98ccf51a0"}
May 21 15:16:16.061229 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:16.061125    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" event={"ID":"4087cde5-9ae5-4358-a41d-5bc18f401312","Type":"ContainerStarted","Data":"723ae178146b9f72cf436ef434650cc6bc6bc9c09cbb9cce4c4d94bc5beefd46"}
May 21 15:16:16.116573 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:16.116518    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg" podStartSLOduration=1.528222098 podStartE2EDuration="5.116502944s" podCreationTimestamp="2026-05-21 15:16:11 +0000 UTC" firstStartedPulling="2026-05-21 15:16:11.741796273 +0000 UTC m=+173.815112389" lastFinishedPulling="2026-05-21 15:16:15.330077107 +0000 UTC m=+177.403393235" observedRunningTime="2026-05-21 15:16:16.114184386 +0000 UTC m=+178.187500522" watchObservedRunningTime="2026-05-21 15:16:16.116502944 +0000 UTC m=+178.189819078"
May 21 15:16:17.064937 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:17.064900    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:19.076015 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:19.075987    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerStarted","Data":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"}
May 21 15:16:19.076015 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:19.076021    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerStarted","Data":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"}
May 21 15:16:19.076369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:19.076030    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerStarted","Data":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"}
May 21 15:16:19.076369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:19.076040    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerStarted","Data":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"}
May 21 15:16:19.076369 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:19.076048    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerStarted","Data":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"}
May 21 15:16:20.082216 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:20.082178    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerStarted","Data":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"}
May 21 15:16:20.112066 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:20.112017    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.672098 podStartE2EDuration="7.111998872s" podCreationTimestamp="2026-05-21 15:16:13 +0000 UTC" firstStartedPulling="2026-05-21 15:16:14.246292733 +0000 UTC m=+176.319608860" lastFinishedPulling="2026-05-21 15:16:18.686193618 +0000 UTC m=+180.759509732" observedRunningTime="2026-05-21 15:16:20.10996119 +0000 UTC m=+182.183277328" watchObservedRunningTime="2026-05-21 15:16:20.111998872 +0000 UTC m=+182.185315010"
May 21 15:16:23.075671 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:23.075641    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79968bc455-lvvpg"
May 21 15:16:23.534328 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:23.534290    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:23.534328 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:23.534335    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:23.539307 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:23.539274    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:23.882990 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:23.882908    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:16:24.003890 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:16:24.003859    2563 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-0: configmap "prometheus-k8s-rulefiles-0" not found
May 21 15:16:24.004070 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:16:24.003937    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0 podName:66f41d91-b12d-44c6-8a83-fcb8ff727ab0 nodeName:}" failed. No retries permitted until 2026-05-21 15:16:24.503914701 +0000 UTC m=+186.577230833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-0" (UniqueName: "kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0") pod "prometheus-k8s-0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0") : configmap "prometheus-k8s-rulefiles-0" not found
May 21 15:16:24.102537 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:24.102506    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:16:24.178844 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:24.178813    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbc6c5756-jbhzc"]
May 21 15:16:31.833982 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:31.833927    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:31.834531 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:31.834002    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:33.711473 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:33.711442    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g2bwf_e212c79f-794d-4d09-a85e-ccd3320d58d6/serve-healthcheck-canary/0.log"
May 21 15:16:49.200038 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.200000    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5fbc6c5756-jbhzc" podUID="63a49619-720f-44f2-9a20-e8e9e38abce8" containerName="console" containerID="cri-o://d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e" gracePeriod=15
May 21 15:16:49.501644 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.501621    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fbc6c5756-jbhzc_63a49619-720f-44f2-9a20-e8e9e38abce8/console/0.log"
May 21 15:16:49.501792 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.501684    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:49.637720 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.637675    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-console-config\") pod \"63a49619-720f-44f2-9a20-e8e9e38abce8\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") "
May 21 15:16:49.637915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.637740    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-serving-cert\") pod \"63a49619-720f-44f2-9a20-e8e9e38abce8\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") "
May 21 15:16:49.637915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.637770    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-oauth-config\") pod \"63a49619-720f-44f2-9a20-e8e9e38abce8\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") "
May 21 15:16:49.637915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.637794    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-oauth-serving-cert\") pod \"63a49619-720f-44f2-9a20-e8e9e38abce8\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") "
May 21 15:16:49.637915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.637863    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-service-ca\") pod \"63a49619-720f-44f2-9a20-e8e9e38abce8\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") "
May 21 15:16:49.637915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.637886    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkdcb\" (UniqueName: \"kubernetes.io/projected/63a49619-720f-44f2-9a20-e8e9e38abce8-kube-api-access-lkdcb\") pod \"63a49619-720f-44f2-9a20-e8e9e38abce8\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") "
May 21 15:16:49.638161 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.637934    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-trusted-ca-bundle\") pod \"63a49619-720f-44f2-9a20-e8e9e38abce8\" (UID: \"63a49619-720f-44f2-9a20-e8e9e38abce8\") "
May 21 15:16:49.638212 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.638178    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-console-config" (OuterVolumeSpecName: "console-config") pod "63a49619-720f-44f2-9a20-e8e9e38abce8" (UID: "63a49619-720f-44f2-9a20-e8e9e38abce8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:16:49.638451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.638368    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-service-ca" (OuterVolumeSpecName: "service-ca") pod "63a49619-720f-44f2-9a20-e8e9e38abce8" (UID: "63a49619-720f-44f2-9a20-e8e9e38abce8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:16:49.638451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.638378    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "63a49619-720f-44f2-9a20-e8e9e38abce8" (UID: "63a49619-720f-44f2-9a20-e8e9e38abce8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:16:49.638607 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.638469    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "63a49619-720f-44f2-9a20-e8e9e38abce8" (UID: "63a49619-720f-44f2-9a20-e8e9e38abce8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:16:49.640176 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.640149    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "63a49619-720f-44f2-9a20-e8e9e38abce8" (UID: "63a49619-720f-44f2-9a20-e8e9e38abce8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:16:49.640560 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.640539    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "63a49619-720f-44f2-9a20-e8e9e38abce8" (UID: "63a49619-720f-44f2-9a20-e8e9e38abce8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:16:49.640618 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.640572    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a49619-720f-44f2-9a20-e8e9e38abce8-kube-api-access-lkdcb" (OuterVolumeSpecName: "kube-api-access-lkdcb") pod "63a49619-720f-44f2-9a20-e8e9e38abce8" (UID: "63a49619-720f-44f2-9a20-e8e9e38abce8"). InnerVolumeSpecName "kube-api-access-lkdcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:16:49.738732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.738646    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-trusted-ca-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:49.738732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.738678    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-console-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:49.738732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.738688    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:49.738732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.738696    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63a49619-720f-44f2-9a20-e8e9e38abce8-console-oauth-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:49.738732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.738705    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-oauth-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:49.738732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.738714    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63a49619-720f-44f2-9a20-e8e9e38abce8-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:49.738732 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:49.738722    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkdcb\" (UniqueName: \"kubernetes.io/projected/63a49619-720f-44f2-9a20-e8e9e38abce8-kube-api-access-lkdcb\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:16:50.179026 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.179000    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5fbc6c5756-jbhzc_63a49619-720f-44f2-9a20-e8e9e38abce8/console/0.log"
May 21 15:16:50.179172 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.179041    2563 generic.go:358] "Generic (PLEG): container finished" podID="63a49619-720f-44f2-9a20-e8e9e38abce8" containerID="d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e" exitCode=2
May 21 15:16:50.179172 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.179073    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbc6c5756-jbhzc" event={"ID":"63a49619-720f-44f2-9a20-e8e9e38abce8","Type":"ContainerDied","Data":"d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e"}
May 21 15:16:50.179172 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.179104    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fbc6c5756-jbhzc"
May 21 15:16:50.179172 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.179115    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fbc6c5756-jbhzc" event={"ID":"63a49619-720f-44f2-9a20-e8e9e38abce8","Type":"ContainerDied","Data":"ae5d6ca0231401009732f656a36fcf4fb3324131d83895f16c9cd2d373f2fabb"}
May 21 15:16:50.179172 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.179136    2563 scope.go:117] "RemoveContainer" containerID="d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e"
May 21 15:16:50.190934 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.190911    2563 scope.go:117] "RemoveContainer" containerID="d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e"
May 21 15:16:50.191190 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:16:50.191169    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e\": container with ID starting with d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e not found: ID does not exist" containerID="d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e"
May 21 15:16:50.191243 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.191199    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e"} err="failed to get container status \"d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e\": rpc error: code = NotFound desc = could not find container \"d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e\": container with ID starting with d670c5314fe022517eccb1410169fc30dde4a60e1823c9225074460184e9006e not found: ID does not exist"
May 21 15:16:50.203261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.203237    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fbc6c5756-jbhzc"]
May 21 15:16:50.207146 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.207115    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fbc6c5756-jbhzc"]
May 21 15:16:50.524062 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:50.523979    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a49619-720f-44f2-9a20-e8e9e38abce8" path="/var/lib/kubelet/pods/63a49619-720f-44f2-9a20-e8e9e38abce8/volumes"
May 21 15:16:51.838813 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:51.838782    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:16:51.842747 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:16:51.842721    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f8cf7b444-qz4xk"
May 21 15:17:13.882470 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:13.882411    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:13.902522 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:13.902494    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:14.268560 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:14.268535    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:30.297351 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:30.297270    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:17:30.299733 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:30.299713    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/558c0f01-4351-454c-9ca8-0e6cf4bc0887-metrics-certs\") pod \"network-metrics-daemon-xf7bw\" (UID: \"558c0f01-4351-454c-9ca8-0e6cf4bc0887\") " pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:17:30.432331 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:30.432298    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqls8\""
May 21 15:17:30.440365 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:30.440343    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xf7bw"
May 21 15:17:30.566717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:30.566647    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xf7bw"]
May 21 15:17:30.569325 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:17:30.569298    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558c0f01_4351_454c_9ca8_0e6cf4bc0887.slice/crio-d3979cb7da02c568c44a1f8f9f42df02a4f2255013994cfd091bc8ff44f5662a WatchSource:0}: Error finding container d3979cb7da02c568c44a1f8f9f42df02a4f2255013994cfd091bc8ff44f5662a: Status 404 returned error can't find the container with id d3979cb7da02c568c44a1f8f9f42df02a4f2255013994cfd091bc8ff44f5662a
May 21 15:17:31.299374 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.299339    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xf7bw" event={"ID":"558c0f01-4351-454c-9ca8-0e6cf4bc0887","Type":"ContainerStarted","Data":"d3979cb7da02c568c44a1f8f9f42df02a4f2255013994cfd091bc8ff44f5662a"}
May 21 15:17:31.912408 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.912368    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:17:31.913166 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.913131    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="prometheus" containerID="cri-o://19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c" gracePeriod=600
May 21 15:17:31.913857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.913381    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy" containerID="cri-o://ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed" gracePeriod=600
May 21 15:17:31.913857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.913561    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-web" containerID="cri-o://0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35" gracePeriod=600
May 21 15:17:31.913857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.913607    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2" gracePeriod=600
May 21 15:17:31.913857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.913671    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="config-reloader" containerID="cri-o://c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e" gracePeriod=600
May 21 15:17:31.913857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:31.913728    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="thanos-sidecar" containerID="cri-o://f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc" gracePeriod=600
May 21 15:17:32.162602 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.162545    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.215937 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.215908    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-serving-certs-ca-bundle\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216123 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.215962    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config-out\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216123 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.215997    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-thanos-prometheus-http-client-file\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216123 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216026    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216123 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216047    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-web-config\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216123 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216075    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-tls-assets\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216123 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216099    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmf2z\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-kube-api-access-nmf2z\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216144    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-grpc-tls\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216182    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-tls\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216218    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-db\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216249    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216282    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-metrics-client-certs\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216316    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-trusted-ca-bundle\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216344    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216346    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216370    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216412    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-metrics-client-ca\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216902 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216481    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-kubelet-serving-ca-bundle\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216902 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216510    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-kube-rbac-proxy\") pod \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\" (UID: \"66f41d91-b12d-44c6-8a83-fcb8ff727ab0\") "
May 21 15:17:32.216902 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216791    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.216902 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.216863    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:17:32.219394 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.219350    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:17:32.220486 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.220452    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:17:32.220614 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.220531    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.220614 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.220549    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.220910 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.220698    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.220979 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.220934    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:17:32.221314 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.221288    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:17:32.221729 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.221703    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.221949 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.221918    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.222029 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.221984    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config" (OuterVolumeSpecName: "config") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.222088 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.222052    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config-out" (OuterVolumeSpecName: "config-out") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:17:32.222531 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.222507    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:17:32.222531 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.222513    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.223155 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.223129    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-kube-api-access-nmf2z" (OuterVolumeSpecName: "kube-api-access-nmf2z") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "kube-api-access-nmf2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:17:32.223470 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.223413    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.231906 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.231883    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-web-config" (OuterVolumeSpecName: "web-config") pod "66f41d91-b12d-44c6-8a83-fcb8ff727ab0" (UID: "66f41d91-b12d-44c6-8a83-fcb8ff727ab0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:17:32.304896 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304863    2563 generic.go:358] "Generic (PLEG): container finished" podID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2" exitCode=0
May 21 15:17:32.304896 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304893    2563 generic.go:358] "Generic (PLEG): container finished" podID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed" exitCode=0
May 21 15:17:32.304896 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304902    2563 generic.go:358] "Generic (PLEG): container finished" podID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35" exitCode=0
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304908    2563 generic.go:358] "Generic (PLEG): container finished" podID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc" exitCode=0
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304915    2563 generic.go:358] "Generic (PLEG): container finished" podID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e" exitCode=0
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304920    2563 generic.go:358] "Generic (PLEG): container finished" podID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c" exitCode=0
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304945    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"}
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304970    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304980    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"}
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.304992    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"}
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.305003    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"}
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.305012    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"}
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.305020    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"}
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.305030    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66f41d91-b12d-44c6-8a83-fcb8ff727ab0","Type":"ContainerDied","Data":"69079dfb68eddfa9a23b27b83108b5112ddf1ff09cd40322aef5dcfd6dfce9e9"}
May 21 15:17:32.305400 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.305053    2563 scope.go:117] "RemoveContainer" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.306686 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.306664    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xf7bw" event={"ID":"558c0f01-4351-454c-9ca8-0e6cf4bc0887","Type":"ContainerStarted","Data":"a545b869be7399fa712c43785414134e371a36d990364f3e51705bbbbf1321d2"}
May 21 15:17:32.306764 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.306695    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xf7bw" event={"ID":"558c0f01-4351-454c-9ca8-0e6cf4bc0887","Type":"ContainerStarted","Data":"7c0c8e051acd769c9ba7aa361af0289f74799d89aa56f6ddd1ec2e95aa313ba9"}
May 21 15:17:32.313379 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.313362    2563 scope.go:117] "RemoveContainer" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.317680 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317658    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-grpc-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317758 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317688    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317758 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317703    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-db\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317758 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317721    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317758 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317737    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-metrics-client-certs\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317758 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317755    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317772    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317787    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317803    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-metrics-client-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317817    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317830    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-secret-kube-rbac-proxy\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317842    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config-out\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317855    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317868    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317882    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-web-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317894    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-tls-assets\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.317908 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.317907    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmf2z\" (UniqueName: \"kubernetes.io/projected/66f41d91-b12d-44c6-8a83-fcb8ff727ab0-kube-api-access-nmf2z\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:17:32.320343 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.320326    2563 scope.go:117] "RemoveContainer" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.324590 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.324548    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xf7bw" podStartSLOduration=253.382392632 podStartE2EDuration="4m14.324532469s" podCreationTimestamp="2026-05-21 15:13:18 +0000 UTC" firstStartedPulling="2026-05-21 15:17:30.571145259 +0000 UTC m=+252.644461387" lastFinishedPulling="2026-05-21 15:17:31.513285107 +0000 UTC m=+253.586601224" observedRunningTime="2026-05-21 15:17:32.323899658 +0000 UTC m=+254.397215939" watchObservedRunningTime="2026-05-21 15:17:32.324532469 +0000 UTC m=+254.397848605"
May 21 15:17:32.327559 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.327542    2563 scope.go:117] "RemoveContainer" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.334031 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.334012    2563 scope.go:117] "RemoveContainer" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.340931 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.340907    2563 scope.go:117] "RemoveContainer" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.342182 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.342160    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:17:32.348370 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.348334    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:17:32.348591 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.348573    2563 scope.go:117] "RemoveContainer" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.355251 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.355234    2563 scope.go:117] "RemoveContainer" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.355554 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:17:32.355537    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": container with ID starting with cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2 not found: ID does not exist" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.355604 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.355563    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"} err="failed to get container status \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": rpc error: code = NotFound desc = could not find container \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": container with ID starting with cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2 not found: ID does not exist"
May 21 15:17:32.355604 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.355583    2563 scope.go:117] "RemoveContainer" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.355826 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:17:32.355809    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": container with ID starting with ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed not found: ID does not exist" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.355871 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.355831    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"} err="failed to get container status \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": rpc error: code = NotFound desc = could not find container \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": container with ID starting with ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed not found: ID does not exist"
May 21 15:17:32.355871 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.355850    2563 scope.go:117] "RemoveContainer" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.356074 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:17:32.356054    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": container with ID starting with 0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35 not found: ID does not exist" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.356113 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356080    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"} err="failed to get container status \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": rpc error: code = NotFound desc = could not find container \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": container with ID starting with 0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35 not found: ID does not exist"
May 21 15:17:32.356113 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356093    2563 scope.go:117] "RemoveContainer" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.356294 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:17:32.356279    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": container with ID starting with f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc not found: ID does not exist" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.356340 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356297    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"} err="failed to get container status \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": rpc error: code = NotFound desc = could not find container \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": container with ID starting with f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc not found: ID does not exist"
May 21 15:17:32.356340 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356309    2563 scope.go:117] "RemoveContainer" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.356564 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:17:32.356547    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": container with ID starting with c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e not found: ID does not exist" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.356625 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356567    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"} err="failed to get container status \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": rpc error: code = NotFound desc = could not find container \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": container with ID starting with c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e not found: ID does not exist"
May 21 15:17:32.356625 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356579    2563 scope.go:117] "RemoveContainer" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.356889 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:17:32.356871    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": container with ID starting with 19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c not found: ID does not exist" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.356936 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356894    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"} err="failed to get container status \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": rpc error: code = NotFound desc = could not find container \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": container with ID starting with 19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c not found: ID does not exist"
May 21 15:17:32.356936 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.356910    2563 scope.go:117] "RemoveContainer" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.357155 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:17:32.357138    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": container with ID starting with a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062 not found: ID does not exist" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.357202 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357159    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"} err="failed to get container status \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": rpc error: code = NotFound desc = could not find container \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": container with ID starting with a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062 not found: ID does not exist"
May 21 15:17:32.357202 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357171    2563 scope.go:117] "RemoveContainer" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.357415 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357386    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"} err="failed to get container status \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": rpc error: code = NotFound desc = could not find container \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": container with ID starting with cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2 not found: ID does not exist"
May 21 15:17:32.357415 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357406    2563 scope.go:117] "RemoveContainer" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.357653 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357637    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"} err="failed to get container status \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": rpc error: code = NotFound desc = could not find container \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": container with ID starting with ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed not found: ID does not exist"
May 21 15:17:32.357694 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357654    2563 scope.go:117] "RemoveContainer" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.357880 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357862    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"} err="failed to get container status \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": rpc error: code = NotFound desc = could not find container \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": container with ID starting with 0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35 not found: ID does not exist"
May 21 15:17:32.357919 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.357881    2563 scope.go:117] "RemoveContainer" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.358091 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358076    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"} err="failed to get container status \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": rpc error: code = NotFound desc = could not find container \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": container with ID starting with f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc not found: ID does not exist"
May 21 15:17:32.358132 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358091    2563 scope.go:117] "RemoveContainer" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.358298 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358276    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"} err="failed to get container status \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": rpc error: code = NotFound desc = could not find container \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": container with ID starting with c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e not found: ID does not exist"
May 21 15:17:32.358345 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358300    2563 scope.go:117] "RemoveContainer" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.358555 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358527    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"} err="failed to get container status \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": rpc error: code = NotFound desc = could not find container \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": container with ID starting with 19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c not found: ID does not exist"
May 21 15:17:32.358607 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358557    2563 scope.go:117] "RemoveContainer" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.358806 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358789    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"} err="failed to get container status \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": rpc error: code = NotFound desc = could not find container \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": container with ID starting with a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062 not found: ID does not exist"
May 21 15:17:32.358853 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.358809    2563 scope.go:117] "RemoveContainer" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.359030 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359012    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"} err="failed to get container status \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": rpc error: code = NotFound desc = could not find container \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": container with ID starting with cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2 not found: ID does not exist"
May 21 15:17:32.359073 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359032    2563 scope.go:117] "RemoveContainer" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.359229 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359214    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"} err="failed to get container status \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": rpc error: code = NotFound desc = could not find container \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": container with ID starting with ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed not found: ID does not exist"
May 21 15:17:32.359265 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359230    2563 scope.go:117] "RemoveContainer" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.359440 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359408    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"} err="failed to get container status \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": rpc error: code = NotFound desc = could not find container \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": container with ID starting with 0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35 not found: ID does not exist"
May 21 15:17:32.359485 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359440    2563 scope.go:117] "RemoveContainer" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.359634 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359617    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"} err="failed to get container status \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": rpc error: code = NotFound desc = could not find container \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": container with ID starting with f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc not found: ID does not exist"
May 21 15:17:32.359676 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359635    2563 scope.go:117] "RemoveContainer" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.359831 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359815    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"} err="failed to get container status \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": rpc error: code = NotFound desc = could not find container \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": container with ID starting with c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e not found: ID does not exist"
May 21 15:17:32.359877 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.359831    2563 scope.go:117] "RemoveContainer" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.360025 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360010    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"} err="failed to get container status \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": rpc error: code = NotFound desc = could not find container \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": container with ID starting with 19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c not found: ID does not exist"
May 21 15:17:32.360067 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360025    2563 scope.go:117] "RemoveContainer" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.360227 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360209    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"} err="failed to get container status \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": rpc error: code = NotFound desc = could not find container \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": container with ID starting with a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062 not found: ID does not exist"
May 21 15:17:32.360283 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360228    2563 scope.go:117] "RemoveContainer" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.360451 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360412    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"} err="failed to get container status \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": rpc error: code = NotFound desc = could not find container \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": container with ID starting with cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2 not found: ID does not exist"
May 21 15:17:32.360506 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360452    2563 scope.go:117] "RemoveContainer" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.360680 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360656    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"} err="failed to get container status \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": rpc error: code = NotFound desc = could not find container \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": container with ID starting with ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed not found: ID does not exist"
May 21 15:17:32.360680 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360678    2563 scope.go:117] "RemoveContainer" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.360919 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360898    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"} err="failed to get container status \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": rpc error: code = NotFound desc = could not find container \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": container with ID starting with 0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35 not found: ID does not exist"
May 21 15:17:32.360982 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.360921    2563 scope.go:117] "RemoveContainer" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.361137 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361115    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"} err="failed to get container status \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": rpc error: code = NotFound desc = could not find container \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": container with ID starting with f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc not found: ID does not exist"
May 21 15:17:32.361182 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361137    2563 scope.go:117] "RemoveContainer" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.361340 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361322    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"} err="failed to get container status \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": rpc error: code = NotFound desc = could not find container \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": container with ID starting with c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e not found: ID does not exist"
May 21 15:17:32.361387 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361341    2563 scope.go:117] "RemoveContainer" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.361559 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361542    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"} err="failed to get container status \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": rpc error: code = NotFound desc = could not find container \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": container with ID starting with 19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c not found: ID does not exist"
May 21 15:17:32.361600 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361559    2563 scope.go:117] "RemoveContainer" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.361744 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361728    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"} err="failed to get container status \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": rpc error: code = NotFound desc = could not find container \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": container with ID starting with a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062 not found: ID does not exist"
May 21 15:17:32.361782 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361744    2563 scope.go:117] "RemoveContainer" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.361926 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361908    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"} err="failed to get container status \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": rpc error: code = NotFound desc = could not find container \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": container with ID starting with cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2 not found: ID does not exist"
May 21 15:17:32.361968 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.361926    2563 scope.go:117] "RemoveContainer" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.362110 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362094    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"} err="failed to get container status \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": rpc error: code = NotFound desc = could not find container \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": container with ID starting with ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed not found: ID does not exist"
May 21 15:17:32.362152 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362112    2563 scope.go:117] "RemoveContainer" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.362314 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362292    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"} err="failed to get container status \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": rpc error: code = NotFound desc = could not find container \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": container with ID starting with 0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35 not found: ID does not exist"
May 21 15:17:32.362396 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362316    2563 scope.go:117] "RemoveContainer" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.362675 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362639    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"} err="failed to get container status \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": rpc error: code = NotFound desc = could not find container \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": container with ID starting with f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc not found: ID does not exist"
May 21 15:17:32.362675 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362673    2563 scope.go:117] "RemoveContainer" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.362984 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362950    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"} err="failed to get container status \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": rpc error: code = NotFound desc = could not find container \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": container with ID starting with c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e not found: ID does not exist"
May 21 15:17:32.362984 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.362974    2563 scope.go:117] "RemoveContainer" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.363209 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363190    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"} err="failed to get container status \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": rpc error: code = NotFound desc = could not find container \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": container with ID starting with 19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c not found: ID does not exist"
May 21 15:17:32.363257 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363210    2563 scope.go:117] "RemoveContainer" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.363457 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363440    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"} err="failed to get container status \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": rpc error: code = NotFound desc = could not find container \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": container with ID starting with a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062 not found: ID does not exist"
May 21 15:17:32.363514 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363459    2563 scope.go:117] "RemoveContainer" containerID="cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"
May 21 15:17:32.363681 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363653    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2"} err="failed to get container status \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": rpc error: code = NotFound desc = could not find container \"cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2\": container with ID starting with cda1d2b98a1878c6d768c8863bc78399c1551281c67fcef47c61c2bff98178a2 not found: ID does not exist"
May 21 15:17:32.363722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363691    2563 scope.go:117] "RemoveContainer" containerID="ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"
May 21 15:17:32.363882 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed"} err="failed to get container status \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": rpc error: code = NotFound desc = could not find container \"ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed\": container with ID starting with ca8f4e90d4056ac358f4705c6115a2ab774c1fa58ab26c3204d23cb0ddb2d6ed not found: ID does not exist"
May 21 15:17:32.363935 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.363882    2563 scope.go:117] "RemoveContainer" containerID="0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"
May 21 15:17:32.364073 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364058    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35"} err="failed to get container status \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": rpc error: code = NotFound desc = could not find container \"0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35\": container with ID starting with 0c705dbc4192ea2398469fd67bf3e7132fae4f3743174ddf0fb3f7ae573b9c35 not found: ID does not exist"
May 21 15:17:32.364116 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364074    2563 scope.go:117] "RemoveContainer" containerID="f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"
May 21 15:17:32.364260 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364241    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc"} err="failed to get container status \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": rpc error: code = NotFound desc = could not find container \"f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc\": container with ID starting with f7f166c2b915ebb732e87a36bd6268b781db85a9dd91b58ae617b128785f36fc not found: ID does not exist"
May 21 15:17:32.364320 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364262    2563 scope.go:117] "RemoveContainer" containerID="c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"
May 21 15:17:32.364469 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364442    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e"} err="failed to get container status \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": rpc error: code = NotFound desc = could not find container \"c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e\": container with ID starting with c202876fedd4a27565c3d1e1cea64075f657551cc9ec6133670a435ce4c14b5e not found: ID does not exist"
May 21 15:17:32.364529 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364471    2563 scope.go:117] "RemoveContainer" containerID="19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"
May 21 15:17:32.364689 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364673    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c"} err="failed to get container status \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": rpc error: code = NotFound desc = could not find container \"19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c\": container with ID starting with 19c066e85899a0f911065609ade645f5d3fe42ae7ae06af8f55f930c3caa266c not found: ID does not exist"
May 21 15:17:32.364741 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364690    2563 scope.go:117] "RemoveContainer" containerID="a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"
May 21 15:17:32.364890 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.364875    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062"} err="failed to get container status \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": rpc error: code = NotFound desc = could not find container \"a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062\": container with ID starting with a9d59e0387d12b7aafc5636ee1463d9ccd7baf5deb104193d84d5ba8d6013062 not found: ID does not exist"
May 21 15:17:32.371048 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371027    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:17:32.371341 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371328    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a49619-720f-44f2-9a20-e8e9e38abce8" containerName="console"
May 21 15:17:32.371386 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371342    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a49619-720f-44f2-9a20-e8e9e38abce8" containerName="console"
May 21 15:17:32.371386 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371351    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="thanos-sidecar"
May 21 15:17:32.371386 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371356    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="thanos-sidecar"
May 21 15:17:32.371386 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371368    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="init-config-reloader"
May 21 15:17:32.371386 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371374    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="init-config-reloader"
May 21 15:17:32.371386 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371380    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="config-reloader"
May 21 15:17:32.371386 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371385    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="config-reloader"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371393    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371399    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371404    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-thanos"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371409    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-thanos"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371439    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="prometheus"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371444    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="prometheus"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371453    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-web"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371458    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-web"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371496    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="63a49619-720f-44f2-9a20-e8e9e38abce8" containerName="console"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371504    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="thanos-sidecar"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371510    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371517    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-web"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371524    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="kube-rbac-proxy-thanos"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371530    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="prometheus"
May 21 15:17:32.371621 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.371536    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" containerName="config-reloader"
May 21 15:17:32.374847 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.374831    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.377555 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377518    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 15:17:32.377555 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377533    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 15:17:32.377750 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377585    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 15:17:32.377853 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377833    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 15:17:32.377853 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377839    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 15:17:32.378007 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377870    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7k87v\""
May 21 15:17:32.378007 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377879    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 15:17:32.378007 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.377932    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 15:17:32.378191 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.378175    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 15:17:32.378277 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.378224    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 15:17:32.378375 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.378359    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ol0evratli0k\""
May 21 15:17:32.378545 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.378526    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 15:17:32.380247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.380230    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 15:17:32.382733 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.382714    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 15:17:32.389552 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.389532    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:17:32.520356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-web-config\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmm4\" (UniqueName: \"kubernetes.io/projected/6184558d-2291-4a11-9d1b-48d2c3537f96-kube-api-access-cjmm4\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520850 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520850 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520850 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520850 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6184558d-2291-4a11-9d1b-48d2c3537f96-config-out\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520850 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.520850 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-config\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.521047 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6184558d-2291-4a11-9d1b-48d2c3537f96-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.521047 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.521047 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.520950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.525562 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.525531    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f41d91-b12d-44c6-8a83-fcb8ff727ab0" path="/var/lib/kubelet/pods/66f41d91-b12d-44c6-8a83-fcb8ff727ab0/volumes"
May 21 15:17:32.621824 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.621786    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.621824 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.621822    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.622087 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.621850    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.622087 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.621986    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.622087 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622025    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.622087 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622052    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.622087 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622081    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622110    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622135    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622167    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-web-config\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622191    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmm4\" (UniqueName: \"kubernetes.io/projected/6184558d-2291-4a11-9d1b-48d2c3537f96-kube-api-access-cjmm4\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622267    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622293    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622333    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622363    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6184558d-2291-4a11-9d1b-48d2c3537f96-config-out\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622399    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622452    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-config\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622480    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6184558d-2291-4a11-9d1b-48d2c3537f96-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622480    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622693    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622777    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.623247 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.622918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.625324 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.625296    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.625469 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.625451    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.626688 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.625581    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.626688 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.625589    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.626688 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.625676    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6184558d-2291-4a11-9d1b-48d2c3537f96-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.626688 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.626342    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.626688 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.626620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6184558d-2291-4a11-9d1b-48d2c3537f96-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.627002 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.626900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.627675 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.627657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-config\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.627846 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.627829    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6184558d-2291-4a11-9d1b-48d2c3537f96-config-out\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.628155 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.628127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.628294 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.628273    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.628336 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.628280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6184558d-2291-4a11-9d1b-48d2c3537f96-web-config\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.634649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.634629    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmm4\" (UniqueName: \"kubernetes.io/projected/6184558d-2291-4a11-9d1b-48d2c3537f96-kube-api-access-cjmm4\") pod \"prometheus-k8s-0\" (UID: \"6184558d-2291-4a11-9d1b-48d2c3537f96\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.685316 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.685283    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:32.820496 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:32.820471    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 15:17:32.822638 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:17:32.822609    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6184558d_2291_4a11_9d1b_48d2c3537f96.slice/crio-34bcc6ce721a5b0e14b161f325bd75060d40c3ee18c99f621340c6ac837af148 WatchSource:0}: Error finding container 34bcc6ce721a5b0e14b161f325bd75060d40c3ee18c99f621340c6ac837af148: Status 404 returned error can't find the container with id 34bcc6ce721a5b0e14b161f325bd75060d40c3ee18c99f621340c6ac837af148
May 21 15:17:33.313062 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:33.313028    2563 generic.go:358] "Generic (PLEG): container finished" podID="6184558d-2291-4a11-9d1b-48d2c3537f96" containerID="7412b90f7b20c1fe2ebe40e13f7dc9adc1056840e4c05a643d35dca0c40cdbf9" exitCode=0
May 21 15:17:33.313515 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:33.313116    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerDied","Data":"7412b90f7b20c1fe2ebe40e13f7dc9adc1056840e4c05a643d35dca0c40cdbf9"}
May 21 15:17:33.313515 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:33.313149    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerStarted","Data":"34bcc6ce721a5b0e14b161f325bd75060d40c3ee18c99f621340c6ac837af148"}
May 21 15:17:34.320507 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:34.320467    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerStarted","Data":"408dbb0d1ca5e33e63f923f69c7d055470bd856d801e41c08c1d3f60bcc47e92"}
May 21 15:17:34.320507 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:34.320507    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerStarted","Data":"0a58e95551fdc191f63ed3ca4af44a53b9adceaf2282e1daf07c4e63c05360f4"}
May 21 15:17:34.320989 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:34.320520    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerStarted","Data":"a8192421da5cfcceeecc9f029f670dca193e99843920e8399a2721a434af96a0"}
May 21 15:17:34.320989 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:34.320532    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerStarted","Data":"2e277942140920c387f4b76c8a2afeef4ba2679622a57ff20951817340e8eb7e"}
May 21 15:17:34.320989 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:34.320542    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerStarted","Data":"c4ad5c71cb2c84b7fc1ed164d9a0f51cb58ea027105dc17ab529cf42413e9bb1"}
May 21 15:17:34.320989 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:34.320552    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6184558d-2291-4a11-9d1b-48d2c3537f96","Type":"ContainerStarted","Data":"38cc5b412036b612a476a2f53e78de3d914f514e08aee3d8eb5ad367ca809f9c"}
May 21 15:17:34.348176 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:34.348125    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.348106655 podStartE2EDuration="2.348106655s" podCreationTimestamp="2026-05-21 15:17:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:17:34.346555537 +0000 UTC m=+256.419871671" watchObservedRunningTime="2026-05-21 15:17:34.348106655 +0000 UTC m=+256.421422790"
May 21 15:17:37.685659 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:37.685621    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:17:46.164175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:17:46.164135    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc46ffc95-mr84k"]
May 21 15:18:11.184210 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.184146    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7bc46ffc95-mr84k" podUID="69badf86-2949-448e-b0a6-77045b38f545" containerName="console" containerID="cri-o://9937f9473dd2272d82527fee66c0c464f04d570f97739c9d0d0c19fda7ad54c9" gracePeriod=15
May 21 15:18:11.433815 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.433794    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bc46ffc95-mr84k_69badf86-2949-448e-b0a6-77045b38f545/console/0.log"
May 21 15:18:11.433925 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.433835    2563 generic.go:358] "Generic (PLEG): container finished" podID="69badf86-2949-448e-b0a6-77045b38f545" containerID="9937f9473dd2272d82527fee66c0c464f04d570f97739c9d0d0c19fda7ad54c9" exitCode=2
May 21 15:18:11.433925 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.433875    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc46ffc95-mr84k" event={"ID":"69badf86-2949-448e-b0a6-77045b38f545","Type":"ContainerDied","Data":"9937f9473dd2272d82527fee66c0c464f04d570f97739c9d0d0c19fda7ad54c9"}
May 21 15:18:11.447888 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.447866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bc46ffc95-mr84k_69badf86-2949-448e-b0a6-77045b38f545/console/0.log"
May 21 15:18:11.448019 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.447927    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:18:11.556899 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.556859    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-console-config\") pod \"69badf86-2949-448e-b0a6-77045b38f545\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") "
May 21 15:18:11.557085 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.556909    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbkbm\" (UniqueName: \"kubernetes.io/projected/69badf86-2949-448e-b0a6-77045b38f545-kube-api-access-zbkbm\") pod \"69badf86-2949-448e-b0a6-77045b38f545\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") "
May 21 15:18:11.557085 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.556944    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-trusted-ca-bundle\") pod \"69badf86-2949-448e-b0a6-77045b38f545\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") "
May 21 15:18:11.557085 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.556977    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-oauth-serving-cert\") pod \"69badf86-2949-448e-b0a6-77045b38f545\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") "
May 21 15:18:11.557085 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.557007    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-service-ca\") pod \"69badf86-2949-448e-b0a6-77045b38f545\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") "
May 21 15:18:11.557085 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.557035    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-oauth-config\") pod \"69badf86-2949-448e-b0a6-77045b38f545\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") "
May 21 15:18:11.557305 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.557123    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-serving-cert\") pod \"69badf86-2949-448e-b0a6-77045b38f545\" (UID: \"69badf86-2949-448e-b0a6-77045b38f545\") "
May 21 15:18:11.557560 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.557507    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69badf86-2949-448e-b0a6-77045b38f545" (UID: "69badf86-2949-448e-b0a6-77045b38f545"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:18:11.557560 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.557518    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-service-ca" (OuterVolumeSpecName: "service-ca") pod "69badf86-2949-448e-b0a6-77045b38f545" (UID: "69badf86-2949-448e-b0a6-77045b38f545"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:18:11.557560 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.557527    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "69badf86-2949-448e-b0a6-77045b38f545" (UID: "69badf86-2949-448e-b0a6-77045b38f545"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:18:11.557900 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.557866    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-console-config" (OuterVolumeSpecName: "console-config") pod "69badf86-2949-448e-b0a6-77045b38f545" (UID: "69badf86-2949-448e-b0a6-77045b38f545"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:18:11.559299 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.559279    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69badf86-2949-448e-b0a6-77045b38f545-kube-api-access-zbkbm" (OuterVolumeSpecName: "kube-api-access-zbkbm") pod "69badf86-2949-448e-b0a6-77045b38f545" (UID: "69badf86-2949-448e-b0a6-77045b38f545"). InnerVolumeSpecName "kube-api-access-zbkbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:18:11.559409 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.559296    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69badf86-2949-448e-b0a6-77045b38f545" (UID: "69badf86-2949-448e-b0a6-77045b38f545"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:18:11.559409 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.559386    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69badf86-2949-448e-b0a6-77045b38f545" (UID: "69badf86-2949-448e-b0a6-77045b38f545"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:18:11.657846 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.657803    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-oauth-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:18:11.657846 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.657837    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69badf86-2949-448e-b0a6-77045b38f545-console-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:18:11.657846 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.657848    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-console-config\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:18:11.657846 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.657857    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbkbm\" (UniqueName: \"kubernetes.io/projected/69badf86-2949-448e-b0a6-77045b38f545-kube-api-access-zbkbm\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:18:11.658122 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.657867    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-trusted-ca-bundle\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:18:11.658122 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.657876    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-oauth-serving-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:18:11.658122 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:11.657885    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69badf86-2949-448e-b0a6-77045b38f545-service-ca\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:18:12.438447 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:12.438399    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bc46ffc95-mr84k_69badf86-2949-448e-b0a6-77045b38f545/console/0.log"
May 21 15:18:12.438933 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:12.438521    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc46ffc95-mr84k" event={"ID":"69badf86-2949-448e-b0a6-77045b38f545","Type":"ContainerDied","Data":"34aad509fd6fdc673afff448c8be22c105cacf0e672886f882bbb9ba7897681c"}
May 21 15:18:12.438933 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:12.438558    2563 scope.go:117] "RemoveContainer" containerID="9937f9473dd2272d82527fee66c0c464f04d570f97739c9d0d0c19fda7ad54c9"
May 21 15:18:12.438933 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:12.438565    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc46ffc95-mr84k"
May 21 15:18:12.460058 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:12.460018    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc46ffc95-mr84k"]
May 21 15:18:12.466390 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:12.466363    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bc46ffc95-mr84k"]
May 21 15:18:12.524541 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:12.524514    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69badf86-2949-448e-b0a6-77045b38f545" path="/var/lib/kubelet/pods/69badf86-2949-448e-b0a6-77045b38f545/volumes"
May 21 15:18:18.395350 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:18.395317    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:18:18.396234 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:18.396215    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:18:18.399742 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:18.399721    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:18:18.400774 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:18.400754    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:18:18.405488 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:18.405470    2563 kubelet.go:1628] "Image garbage collection succeeded"
May 21 15:18:32.686500 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:32.686458    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:18:32.702611 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:32.702585    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:18:33.516496 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:18:33.516466    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 15:19:22.697264 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.697223    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-z4769"]
May 21 15:19:22.697811 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.697788    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69badf86-2949-448e-b0a6-77045b38f545" containerName="console"
May 21 15:19:22.697888 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.697814    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69badf86-2949-448e-b0a6-77045b38f545" containerName="console"
May 21 15:19:22.697937 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.697909    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="69badf86-2949-448e-b0a6-77045b38f545" containerName="console"
May 21 15:19:22.700836 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.700814    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.703674 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.703644    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 15:19:22.710355 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.710332    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4769"]
May 21 15:19:22.852382 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.852344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83accbad-9926-4b13-a655-133b9b376659-kubelet-config\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.852579 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.852405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83accbad-9926-4b13-a655-133b9b376659-original-pull-secret\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.852579 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.852503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83accbad-9926-4b13-a655-133b9b376659-dbus\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.953911 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.953826    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83accbad-9926-4b13-a655-133b9b376659-dbus\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.953911 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.953890    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83accbad-9926-4b13-a655-133b9b376659-kubelet-config\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.954093 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.953953    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83accbad-9926-4b13-a655-133b9b376659-original-pull-secret\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.954093 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.954035    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83accbad-9926-4b13-a655-133b9b376659-kubelet-config\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.954093 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.954045    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83accbad-9926-4b13-a655-133b9b376659-dbus\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:22.956376 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:22.956361    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83accbad-9926-4b13-a655-133b9b376659-original-pull-secret\") pod \"global-pull-secret-syncer-z4769\" (UID: \"83accbad-9926-4b13-a655-133b9b376659\") " pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:23.011239 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:23.011204    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4769"
May 21 15:19:23.143615 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:23.143505    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4769"]
May 21 15:19:23.146532 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:19:23.146504    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83accbad_9926_4b13_a655_133b9b376659.slice/crio-cd2a774b2445457635c90b4018f78c05067dd27c6428d4174b354865e246f5f6 WatchSource:0}: Error finding container cd2a774b2445457635c90b4018f78c05067dd27c6428d4174b354865e246f5f6: Status 404 returned error can't find the container with id cd2a774b2445457635c90b4018f78c05067dd27c6428d4174b354865e246f5f6
May 21 15:19:23.147998 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:23.147982    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:19:23.640927 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:23.640891    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4769" event={"ID":"83accbad-9926-4b13-a655-133b9b376659","Type":"ContainerStarted","Data":"cd2a774b2445457635c90b4018f78c05067dd27c6428d4174b354865e246f5f6"}
May 21 15:19:28.656527 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:28.656490    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4769" event={"ID":"83accbad-9926-4b13-a655-133b9b376659","Type":"ContainerStarted","Data":"2cdfbe656b8006eed7e6ca4509decf1346f55ec455c1596636e11888a0ff28fc"}
May 21 15:19:28.674713 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:19:28.674655    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z4769" podStartSLOduration=1.947292568 podStartE2EDuration="6.674638499s" podCreationTimestamp="2026-05-21 15:19:22 +0000 UTC" firstStartedPulling="2026-05-21 15:19:23.148107763 +0000 UTC m=+365.221423877" lastFinishedPulling="2026-05-21 15:19:27.875453682 +0000 UTC m=+369.948769808" observedRunningTime="2026-05-21 15:19:28.673346595 +0000 UTC m=+370.746662729" watchObservedRunningTime="2026-05-21 15:19:28.674638499 +0000 UTC m=+370.747954633"
May 21 15:20:30.160008 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.159929    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jh7mq"]
May 21 15:20:30.165950 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.163804    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.168444 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.168397    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v2wqw\""
May 21 15:20:30.168652 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.168637    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 15:20:30.169507 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.169492    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 15:20:30.177047 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.177024    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jh7mq"]
May 21 15:20:30.212557 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.212520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61885ffa-31fc-4bf3-9735-c855850dc1bb-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jh7mq\" (UID: \"61885ffa-31fc-4bf3-9735-c855850dc1bb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.212557 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.212560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4k2\" (UniqueName: \"kubernetes.io/projected/61885ffa-31fc-4bf3-9735-c855850dc1bb-kube-api-access-cv4k2\") pod \"cert-manager-webhook-587ccfb98-jh7mq\" (UID: \"61885ffa-31fc-4bf3-9735-c855850dc1bb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.313601 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.313570    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61885ffa-31fc-4bf3-9735-c855850dc1bb-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jh7mq\" (UID: \"61885ffa-31fc-4bf3-9735-c855850dc1bb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.313601 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.313608    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4k2\" (UniqueName: \"kubernetes.io/projected/61885ffa-31fc-4bf3-9735-c855850dc1bb-kube-api-access-cv4k2\") pod \"cert-manager-webhook-587ccfb98-jh7mq\" (UID: \"61885ffa-31fc-4bf3-9735-c855850dc1bb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.348862 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.348831    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61885ffa-31fc-4bf3-9735-c855850dc1bb-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jh7mq\" (UID: \"61885ffa-31fc-4bf3-9735-c855850dc1bb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.352873 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.352848    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4k2\" (UniqueName: \"kubernetes.io/projected/61885ffa-31fc-4bf3-9735-c855850dc1bb-kube-api-access-cv4k2\") pod \"cert-manager-webhook-587ccfb98-jh7mq\" (UID: \"61885ffa-31fc-4bf3-9735-c855850dc1bb\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.490327 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.490232    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:30.635842 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.635809    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jh7mq"]
May 21 15:20:30.639848 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:20:30.639817    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61885ffa_31fc_4bf3_9735_c855850dc1bb.slice/crio-f0635d326ca960a8f65898e31cd6da85cfc1a4404a88face46909af80943a1f0 WatchSource:0}: Error finding container f0635d326ca960a8f65898e31cd6da85cfc1a4404a88face46909af80943a1f0: Status 404 returned error can't find the container with id f0635d326ca960a8f65898e31cd6da85cfc1a4404a88face46909af80943a1f0
May 21 15:20:30.833143 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:30.833057    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq" event={"ID":"61885ffa-31fc-4bf3-9735-c855850dc1bb","Type":"ContainerStarted","Data":"f0635d326ca960a8f65898e31cd6da85cfc1a4404a88face46909af80943a1f0"}
May 21 15:20:33.843367 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:33.843336    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq" event={"ID":"61885ffa-31fc-4bf3-9735-c855850dc1bb","Type":"ContainerStarted","Data":"8f1d93609e5f3a3f601938c303d9a7d4e55bdec5aa3464b759b60b15c07ef648"}
May 21 15:20:33.843760 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:33.843447    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:39.849192 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:39.849157    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq"
May 21 15:20:39.870001 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:20:39.869950    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-jh7mq" podStartSLOduration=6.779785772 podStartE2EDuration="9.869933307s" podCreationTimestamp="2026-05-21 15:20:30 +0000 UTC" firstStartedPulling="2026-05-21 15:20:30.641751956 +0000 UTC m=+432.715068070" lastFinishedPulling="2026-05-21 15:20:33.731899484 +0000 UTC m=+435.805215605" observedRunningTime="2026-05-21 15:20:33.864810133 +0000 UTC m=+435.938126268" watchObservedRunningTime="2026-05-21 15:20:39.869933307 +0000 UTC m=+441.943249441"
May 21 15:21:07.909969 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.909929    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"]
May 21 15:21:07.914099 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.914079    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:07.917409 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.917387    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 15:21:07.918486 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.918465    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 15:21:07.918823 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.918808    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7qw64\""
May 21 15:21:07.918911 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.918808    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 15:21:07.919297 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.919284    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 15:21:07.954594 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:07.954562    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"]
May 21 15:21:08.053720 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.053680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bfpp\" (UniqueName: \"kubernetes.io/projected/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-kube-api-access-7bfpp\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.053899 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.053731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.053899 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.053798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.155194 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.155149    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.155388 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.155215    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.155388 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.155282    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bfpp\" (UniqueName: \"kubernetes.io/projected/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-kube-api-access-7bfpp\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.157857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.157824    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.157999 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.157858    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-webhook-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.164774 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.164702    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bfpp\" (UniqueName: \"kubernetes.io/projected/6c0658e9-ce3b-4c99-a97a-70be3c10a0a7-kube-api-access-7bfpp\") pod \"opendatahub-operator-controller-manager-594496b99d-zhc8v\" (UID: \"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.224483 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.224413    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:08.373033 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.373008    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"]
May 21 15:21:08.376016 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:21:08.375978    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0658e9_ce3b_4c99_a97a_70be3c10a0a7.slice/crio-bb4aac41da05d22eb4e6857c91517624bc8e1eb73aab8fd7c9102715336865b7 WatchSource:0}: Error finding container bb4aac41da05d22eb4e6857c91517624bc8e1eb73aab8fd7c9102715336865b7: Status 404 returned error can't find the container with id bb4aac41da05d22eb4e6857c91517624bc8e1eb73aab8fd7c9102715336865b7
May 21 15:21:08.948478 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:08.948439    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v" event={"ID":"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7","Type":"ContainerStarted","Data":"bb4aac41da05d22eb4e6857c91517624bc8e1eb73aab8fd7c9102715336865b7"}
May 21 15:21:11.959666 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:11.959625    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v" event={"ID":"6c0658e9-ce3b-4c99-a97a-70be3c10a0a7","Type":"ContainerStarted","Data":"c77eeab876faabca6fe9df3454978bb6a5c7b3ab2a6debec5c146ca0b37e90ca"}
May 21 15:21:11.960270 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:11.959744    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:11.979634 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:11.979568    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v" podStartSLOduration=2.265897805 podStartE2EDuration="4.979553944s" podCreationTimestamp="2026-05-21 15:21:07 +0000 UTC" firstStartedPulling="2026-05-21 15:21:08.377824586 +0000 UTC m=+470.451140699" lastFinishedPulling="2026-05-21 15:21:11.091480719 +0000 UTC m=+473.164796838" observedRunningTime="2026-05-21 15:21:11.978369426 +0000 UTC m=+474.051685561" watchObservedRunningTime="2026-05-21 15:21:11.979553944 +0000 UTC m=+474.052870060"
May 21 15:21:14.063811 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.063774    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"]
May 21 15:21:14.067235 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.067217    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.071777 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.071752    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 15:21:14.071777 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.071769    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 15:21:14.071970 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.071758    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z597h\""
May 21 15:21:14.071970 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.071758    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 15:21:14.071970 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.071892    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 15:21:14.072126 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.072098    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 15:21:14.080660 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.080639    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"]
May 21 15:21:14.107730 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.107699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccb568ca-b95f-4ed5-951a-f1894272a045-manager-config\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.107887 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.107745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccb568ca-b95f-4ed5-951a-f1894272a045-metrics-cert\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.107887 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.107767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78p8l\" (UniqueName: \"kubernetes.io/projected/ccb568ca-b95f-4ed5-951a-f1894272a045-kube-api-access-78p8l\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.107887 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.107873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccb568ca-b95f-4ed5-951a-f1894272a045-cert\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.209184 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.209145    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccb568ca-b95f-4ed5-951a-f1894272a045-cert\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.209365 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.209215    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccb568ca-b95f-4ed5-951a-f1894272a045-manager-config\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.209365 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.209247    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccb568ca-b95f-4ed5-951a-f1894272a045-metrics-cert\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.209365 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.209267    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78p8l\" (UniqueName: \"kubernetes.io/projected/ccb568ca-b95f-4ed5-951a-f1894272a045-kube-api-access-78p8l\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.210010 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.209977    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ccb568ca-b95f-4ed5-951a-f1894272a045-manager-config\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.211885 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.211855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccb568ca-b95f-4ed5-951a-f1894272a045-cert\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.211995 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.211863    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ccb568ca-b95f-4ed5-951a-f1894272a045-metrics-cert\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.218138 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.218117    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78p8l\" (UniqueName: \"kubernetes.io/projected/ccb568ca-b95f-4ed5-951a-f1894272a045-kube-api-access-78p8l\") pod \"lws-controller-manager-69ff6d856c-rd2zn\" (UID: \"ccb568ca-b95f-4ed5-951a-f1894272a045\") " pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.377029 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.376915    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:14.523757 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:21:14.523728    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb568ca_b95f_4ed5_951a_f1894272a045.slice/crio-d64ac4b6f5f46b3481c5cca72fc3b8130a7300604f0c3cbd57561bef0344642f WatchSource:0}: Error finding container d64ac4b6f5f46b3481c5cca72fc3b8130a7300604f0c3cbd57561bef0344642f: Status 404 returned error can't find the container with id d64ac4b6f5f46b3481c5cca72fc3b8130a7300604f0c3cbd57561bef0344642f
May 21 15:21:14.525402 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.525363    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"]
May 21 15:21:14.970163 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:14.970127    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn" event={"ID":"ccb568ca-b95f-4ed5-951a-f1894272a045","Type":"ContainerStarted","Data":"d64ac4b6f5f46b3481c5cca72fc3b8130a7300604f0c3cbd57561bef0344642f"}
May 21 15:21:17.982844 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:17.982808    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn" event={"ID":"ccb568ca-b95f-4ed5-951a-f1894272a045","Type":"ContainerStarted","Data":"aa69d086c2d2a3556d30fdb12525ad63c70d6aefcb47013261865efde1ae73de"}
May 21 15:21:17.983241 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:17.982861    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:17.999179 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:17.999135    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn" podStartSLOduration=1.22758767 podStartE2EDuration="3.999116376s" podCreationTimestamp="2026-05-21 15:21:14 +0000 UTC" firstStartedPulling="2026-05-21 15:21:14.525766599 +0000 UTC m=+476.599082712" lastFinishedPulling="2026-05-21 15:21:17.29729529 +0000 UTC m=+479.370611418" observedRunningTime="2026-05-21 15:21:17.998490568 +0000 UTC m=+480.071806703" watchObservedRunningTime="2026-05-21 15:21:17.999116376 +0000 UTC m=+480.072432513"
May 21 15:21:22.964818 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:22.964789    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-zhc8v"
May 21 15:21:28.988049 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:28.988019    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69ff6d856c-rd2zn"
May 21 15:21:36.678783 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.678747    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"]
May 21 15:21:36.682388 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.682361    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.685740 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.685715    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 15:21:36.686743 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.686722    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 15:21:36.686885 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.686726    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 15:21:36.687159 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.687142    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 15:21:36.688175 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.688154    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-74m2v\""
May 21 15:21:36.710952 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.710926    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"]
May 21 15:21:36.796405 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.796361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5385b9-7950-491c-81f0-da3ba96835f3-tls-certs\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.796405 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.796401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e5385b9-7950-491c-81f0-da3ba96835f3-tmp\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.796405 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.796451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrgr\" (UniqueName: \"kubernetes.io/projected/3e5385b9-7950-491c-81f0-da3ba96835f3-kube-api-access-vlrgr\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.897326 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.897294    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5385b9-7950-491c-81f0-da3ba96835f3-tls-certs\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.897326 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.897332    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e5385b9-7950-491c-81f0-da3ba96835f3-tmp\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.897565 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.897355    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrgr\" (UniqueName: \"kubernetes.io/projected/3e5385b9-7950-491c-81f0-da3ba96835f3-kube-api-access-vlrgr\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.899922 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.899886    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e5385b9-7950-491c-81f0-da3ba96835f3-tmp\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.900110 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.900089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5385b9-7950-491c-81f0-da3ba96835f3-tls-certs\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.908522 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.908497    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrgr\" (UniqueName: \"kubernetes.io/projected/3e5385b9-7950-491c-81f0-da3ba96835f3-kube-api-access-vlrgr\") pod \"kube-auth-proxy-7bd665b65-6wqsh\" (UID: \"3e5385b9-7950-491c-81f0-da3ba96835f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:36.993259 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:36.993178    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"
May 21 15:21:37.131354 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:37.131326    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh"]
May 21 15:21:37.133757 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:21:37.133714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5385b9_7950_491c_81f0_da3ba96835f3.slice/crio-4e3796737889e53b144da4ceb7765fb39beadbc2b00992408a105e2e8581689f WatchSource:0}: Error finding container 4e3796737889e53b144da4ceb7765fb39beadbc2b00992408a105e2e8581689f: Status 404 returned error can't find the container with id 4e3796737889e53b144da4ceb7765fb39beadbc2b00992408a105e2e8581689f
May 21 15:21:38.050769 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:38.050719    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh" event={"ID":"3e5385b9-7950-491c-81f0-da3ba96835f3","Type":"ContainerStarted","Data":"4e3796737889e53b144da4ceb7765fb39beadbc2b00992408a105e2e8581689f"}
May 21 15:21:41.063118 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:41.063072    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh" event={"ID":"3e5385b9-7950-491c-81f0-da3ba96835f3","Type":"ContainerStarted","Data":"c37b916085a7cf79577192f59bce4fcd1f44c89cf620d610282e96ea52ca2038"}
May 21 15:21:41.081489 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:21:41.081417    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bd665b65-6wqsh" podStartSLOduration=1.6436304640000001 podStartE2EDuration="5.081402342s" podCreationTimestamp="2026-05-21 15:21:36 +0000 UTC" firstStartedPulling="2026-05-21 15:21:37.1359019 +0000 UTC m=+499.209218015" lastFinishedPulling="2026-05-21 15:21:40.573673777 +0000 UTC m=+502.646989893" observedRunningTime="2026-05-21 15:21:41.079043051 +0000 UTC m=+503.152359187" watchObservedRunningTime="2026-05-21 15:21:41.081402342 +0000 UTC m=+503.154718477"
May 21 15:23:06.974750 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:06.974710    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"]
May 21 15:23:06.978119 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:06.978101    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:06.981321 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:06.981296    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 15:23:06.981486 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:06.981300    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 15:23:06.982577 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:06.982561    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-s5vc4\""
May 21 15:23:06.989997 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:06.989976    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"]
May 21 15:23:07.100592 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:07.100554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkggh\" (UniqueName: \"kubernetes.io/projected/3fa36da8-e7f4-4532-8ad2-6128b328b856-kube-api-access-pkggh\") pod \"limitador-operator-controller-manager-85c4996f8c-6vfh4\" (UID: \"3fa36da8-e7f4-4532-8ad2-6128b328b856\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:07.202036 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:07.201994    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkggh\" (UniqueName: \"kubernetes.io/projected/3fa36da8-e7f4-4532-8ad2-6128b328b856-kube-api-access-pkggh\") pod \"limitador-operator-controller-manager-85c4996f8c-6vfh4\" (UID: \"3fa36da8-e7f4-4532-8ad2-6128b328b856\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:07.215505 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:07.215472    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkggh\" (UniqueName: \"kubernetes.io/projected/3fa36da8-e7f4-4532-8ad2-6128b328b856-kube-api-access-pkggh\") pod \"limitador-operator-controller-manager-85c4996f8c-6vfh4\" (UID: \"3fa36da8-e7f4-4532-8ad2-6128b328b856\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:07.287946 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:07.287859    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:07.415646 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:07.415617    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"]
May 21 15:23:07.419129 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:23:07.419095    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa36da8_e7f4_4532_8ad2_6128b328b856.slice/crio-5d7b811c8a4c1241365eddff4315072abdb249187e2bd3801084e484e97c8c52 WatchSource:0}: Error finding container 5d7b811c8a4c1241365eddff4315072abdb249187e2bd3801084e484e97c8c52: Status 404 returned error can't find the container with id 5d7b811c8a4c1241365eddff4315072abdb249187e2bd3801084e484e97c8c52
May 21 15:23:08.361777 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:08.361734    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4" event={"ID":"3fa36da8-e7f4-4532-8ad2-6128b328b856","Type":"ContainerStarted","Data":"5d7b811c8a4c1241365eddff4315072abdb249187e2bd3801084e484e97c8c52"}
May 21 15:23:10.371712 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:10.371675    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4" event={"ID":"3fa36da8-e7f4-4532-8ad2-6128b328b856","Type":"ContainerStarted","Data":"e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a"}
May 21 15:23:10.372092 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:10.371734    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:10.395589 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:10.395542    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4" podStartSLOduration=2.002808398 podStartE2EDuration="4.395527971s" podCreationTimestamp="2026-05-21 15:23:06 +0000 UTC" firstStartedPulling="2026-05-21 15:23:07.421678483 +0000 UTC m=+589.494994596" lastFinishedPulling="2026-05-21 15:23:09.814398055 +0000 UTC m=+591.887714169" observedRunningTime="2026-05-21 15:23:10.39372557 +0000 UTC m=+592.467041706" watchObservedRunningTime="2026-05-21 15:23:10.395527971 +0000 UTC m=+592.468844159"
May 21 15:23:18.419813 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:18.419778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:23:18.421248 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:18.421226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:23:18.423819 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:18.423798    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:23:18.425328 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:18.425308    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:23:21.377626 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:21.377590    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:22.149490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.149458    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"]
May 21 15:23:22.149718 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.149677    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" containerName="manager" containerID="cri-o://e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a" gracePeriod=2
May 21 15:23:22.163253 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.163223    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"]
May 21 15:23:22.175279 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.175249    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"]
May 21 15:23:22.175769 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.175754    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" containerName="manager"
May 21 15:23:22.175820 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.175774    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" containerName="manager"
May 21 15:23:22.175889 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.175878    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" containerName="manager"
May 21 15:23:22.179985 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.179966    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"
May 21 15:23:22.192067 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.192002    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"]
May 21 15:23:22.207622 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.207588    2563 status_manager.go:895] "Failed to get status for pod" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4" err="pods \"limitador-operator-controller-manager-85c4996f8c-6vfh4\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object"
May 21 15:23:22.344021 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.343990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p854r\" (UniqueName: \"kubernetes.io/projected/f8d177df-8bf0-4b5e-b110-9b9cfab10552-kube-api-access-p854r\") pod \"limitador-operator-controller-manager-85c4996f8c-qq5dc\" (UID: \"f8d177df-8bf0-4b5e-b110-9b9cfab10552\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"
May 21 15:23:22.380376 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.380354    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:22.382904 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.382879    2563 status_manager.go:895] "Failed to get status for pod" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4" err="pods \"limitador-operator-controller-manager-85c4996f8c-6vfh4\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object"
May 21 15:23:22.411842 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.411771    2563 generic.go:358] "Generic (PLEG): container finished" podID="3fa36da8-e7f4-4532-8ad2-6128b328b856" containerID="e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a" exitCode=0
May 21 15:23:22.411842 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.411824    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4"
May 21 15:23:22.411981 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.411875    2563 scope.go:117] "RemoveContainer" containerID="e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a"
May 21 15:23:22.414226 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.414205    2563 status_manager.go:895] "Failed to get status for pod" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6vfh4" err="pods \"limitador-operator-controller-manager-85c4996f8c-6vfh4\" is forbidden: User \"system:node:ip-10-0-134-80.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-80.ec2.internal' and this object"
May 21 15:23:22.419541 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.419525    2563 scope.go:117] "RemoveContainer" containerID="e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a"
May 21 15:23:22.419791 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:23:22.419774    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a\": container with ID starting with e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a not found: ID does not exist" containerID="e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a"
May 21 15:23:22.419837 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.419803    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a"} err="failed to get container status \"e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a\": rpc error: code = NotFound desc = could not find container \"e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a\": container with ID starting with e099ce3232ff07cc852594fc3b564da6b57a06d1f57c693d0b5799a9a349236a not found: ID does not exist"
May 21 15:23:22.445232 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.445208    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p854r\" (UniqueName: \"kubernetes.io/projected/f8d177df-8bf0-4b5e-b110-9b9cfab10552-kube-api-access-p854r\") pod \"limitador-operator-controller-manager-85c4996f8c-qq5dc\" (UID: \"f8d177df-8bf0-4b5e-b110-9b9cfab10552\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"
May 21 15:23:22.454857 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.454832    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p854r\" (UniqueName: \"kubernetes.io/projected/f8d177df-8bf0-4b5e-b110-9b9cfab10552-kube-api-access-p854r\") pod \"limitador-operator-controller-manager-85c4996f8c-qq5dc\" (UID: \"f8d177df-8bf0-4b5e-b110-9b9cfab10552\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"
May 21 15:23:22.519478 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.519444    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"
May 21 15:23:22.546306 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.546276    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkggh\" (UniqueName: \"kubernetes.io/projected/3fa36da8-e7f4-4532-8ad2-6128b328b856-kube-api-access-pkggh\") pod \"3fa36da8-e7f4-4532-8ad2-6128b328b856\" (UID: \"3fa36da8-e7f4-4532-8ad2-6128b328b856\") "
May 21 15:23:22.548599 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.548559    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa36da8-e7f4-4532-8ad2-6128b328b856-kube-api-access-pkggh" (OuterVolumeSpecName: "kube-api-access-pkggh") pod "3fa36da8-e7f4-4532-8ad2-6128b328b856" (UID: "3fa36da8-e7f4-4532-8ad2-6128b328b856"). InnerVolumeSpecName "kube-api-access-pkggh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:23:22.647210 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.647012    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"]
May 21 15:23:22.647414 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:22.647389    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkggh\" (UniqueName: \"kubernetes.io/projected/3fa36da8-e7f4-4532-8ad2-6128b328b856-kube-api-access-pkggh\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:23:22.650016 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:23:22.649987    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d177df_8bf0_4b5e_b110_9b9cfab10552.slice/crio-e4b2b263fd5c2b5f0f85f6d44cad4387abaf68b92a4cca44113d3e981241587c WatchSource:0}: Error finding container e4b2b263fd5c2b5f0f85f6d44cad4387abaf68b92a4cca44113d3e981241587c: Status 404 returned error can't find the container with id e4b2b263fd5c2b5f0f85f6d44cad4387abaf68b92a4cca44113d3e981241587c
May 21 15:23:23.416585 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:23.416487    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc" event={"ID":"f8d177df-8bf0-4b5e-b110-9b9cfab10552","Type":"ContainerStarted","Data":"0cf43d8f474fae53404f0e32de559504df72107a1e18cfe114046cd570a2d1e8"}
May 21 15:23:23.416585 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:23.416535    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"
May 21 15:23:23.416585 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:23.416553    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc" event={"ID":"f8d177df-8bf0-4b5e-b110-9b9cfab10552","Type":"ContainerStarted","Data":"e4b2b263fd5c2b5f0f85f6d44cad4387abaf68b92a4cca44113d3e981241587c"}
May 21 15:23:23.435993 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:23.435945    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc" podStartSLOduration=1.435930295 podStartE2EDuration="1.435930295s" podCreationTimestamp="2026-05-21 15:23:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:23:23.435869378 +0000 UTC m=+605.509185513" watchObservedRunningTime="2026-05-21 15:23:23.435930295 +0000 UTC m=+605.509246431"
May 21 15:23:24.524763 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:24.524717    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa36da8-e7f4-4532-8ad2-6128b328b856" path="/var/lib/kubelet/pods/3fa36da8-e7f4-4532-8ad2-6128b328b856/volumes"
May 21 15:23:34.423408 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:34.423332    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qq5dc"
May 21 15:23:56.866010 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.865969    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j86b5"]
May 21 15:23:56.871722 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.871700    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j86b5"
May 21 15:23:56.874490 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.874457    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v2mbv\""
May 21 15:23:56.875792 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.875766    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j86b5"]
May 21 15:23:56.948121 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.948085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brjjx\" (UniqueName: \"kubernetes.io/projected/995ea165-312e-45c1-aab2-a404a8627495-kube-api-access-brjjx\") pod \"authorino-f99f4b5cd-j86b5\" (UID: \"995ea165-312e-45c1-aab2-a404a8627495\") " pod="kuadrant-system/authorino-f99f4b5cd-j86b5"
May 21 15:23:56.977724 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.977687    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-rldkj"]
May 21 15:23:56.981462 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.981444    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rldkj"
May 21 15:23:56.987297 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:56.987270    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-rldkj"]
May 21 15:23:57.049481 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.049446    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brjjx\" (UniqueName: \"kubernetes.io/projected/995ea165-312e-45c1-aab2-a404a8627495-kube-api-access-brjjx\") pod \"authorino-f99f4b5cd-j86b5\" (UID: \"995ea165-312e-45c1-aab2-a404a8627495\") " pod="kuadrant-system/authorino-f99f4b5cd-j86b5"
May 21 15:23:57.049698 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.049541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7tr6\" (UniqueName: \"kubernetes.io/projected/08e9571a-73d7-4305-9043-73d14af11f56-kube-api-access-q7tr6\") pod \"authorino-7498df8756-rldkj\" (UID: \"08e9571a-73d7-4305-9043-73d14af11f56\") " pod="kuadrant-system/authorino-7498df8756-rldkj"
May 21 15:23:57.058724 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.058690    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brjjx\" (UniqueName: \"kubernetes.io/projected/995ea165-312e-45c1-aab2-a404a8627495-kube-api-access-brjjx\") pod \"authorino-f99f4b5cd-j86b5\" (UID: \"995ea165-312e-45c1-aab2-a404a8627495\") " pod="kuadrant-system/authorino-f99f4b5cd-j86b5"
May 21 15:23:57.150731 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.150704    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7tr6\" (UniqueName: \"kubernetes.io/projected/08e9571a-73d7-4305-9043-73d14af11f56-kube-api-access-q7tr6\") pod \"authorino-7498df8756-rldkj\" (UID: \"08e9571a-73d7-4305-9043-73d14af11f56\") " pod="kuadrant-system/authorino-7498df8756-rldkj"
May 21 15:23:57.160738 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.160705    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7tr6\" (UniqueName: \"kubernetes.io/projected/08e9571a-73d7-4305-9043-73d14af11f56-kube-api-access-q7tr6\") pod \"authorino-7498df8756-rldkj\" (UID: \"08e9571a-73d7-4305-9043-73d14af11f56\") " pod="kuadrant-system/authorino-7498df8756-rldkj"
May 21 15:23:57.182523 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.182494    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j86b5"
May 21 15:23:57.291582 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.291549    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rldkj"
May 21 15:23:57.316010 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.315980    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j86b5"]
May 21 15:23:57.317601 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:23:57.317575    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod995ea165_312e_45c1_aab2_a404a8627495.slice/crio-eea0d41b7a67601bc3be202fbd3ec62b71001f766237948c3c655836cff95d32 WatchSource:0}: Error finding container eea0d41b7a67601bc3be202fbd3ec62b71001f766237948c3c655836cff95d32: Status 404 returned error can't find the container with id eea0d41b7a67601bc3be202fbd3ec62b71001f766237948c3c655836cff95d32
May 21 15:23:57.425622 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.425592    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-rldkj"]
May 21 15:23:57.428479 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:23:57.428451    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08e9571a_73d7_4305_9043_73d14af11f56.slice/crio-232297e55804a20461ea780834983f08bd9f2d60087ee5889b02acf812523660 WatchSource:0}: Error finding container 232297e55804a20461ea780834983f08bd9f2d60087ee5889b02acf812523660: Status 404 returned error can't find the container with id 232297e55804a20461ea780834983f08bd9f2d60087ee5889b02acf812523660
May 21 15:23:57.529242 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.529200    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j86b5" event={"ID":"995ea165-312e-45c1-aab2-a404a8627495","Type":"ContainerStarted","Data":"eea0d41b7a67601bc3be202fbd3ec62b71001f766237948c3c655836cff95d32"}
May 21 15:23:57.530331 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:23:57.530304    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rldkj" event={"ID":"08e9571a-73d7-4305-9043-73d14af11f56","Type":"ContainerStarted","Data":"232297e55804a20461ea780834983f08bd9f2d60087ee5889b02acf812523660"}
May 21 15:24:01.550859 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:01.550803    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rldkj" event={"ID":"08e9571a-73d7-4305-9043-73d14af11f56","Type":"ContainerStarted","Data":"16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4"}
May 21 15:24:01.552136 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:01.552114    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j86b5" event={"ID":"995ea165-312e-45c1-aab2-a404a8627495","Type":"ContainerStarted","Data":"68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0"}
May 21 15:24:01.567374 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:01.567324    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-rldkj" podStartSLOduration=1.918346501 podStartE2EDuration="5.567305939s" podCreationTimestamp="2026-05-21 15:23:56 +0000 UTC" firstStartedPulling="2026-05-21 15:23:57.430102879 +0000 UTC m=+639.503418997" lastFinishedPulling="2026-05-21 15:24:01.079062307 +0000 UTC m=+643.152378435" observedRunningTime="2026-05-21 15:24:01.56548397 +0000 UTC m=+643.638800107" watchObservedRunningTime="2026-05-21 15:24:01.567305939 +0000 UTC m=+643.640622074"
May 21 15:24:01.580105 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:01.580052    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-j86b5" podStartSLOduration=1.808459884 podStartE2EDuration="5.580037909s" podCreationTimestamp="2026-05-21 15:23:56 +0000 UTC" firstStartedPulling="2026-05-21 15:23:57.318939329 +0000 UTC m=+639.392255442" lastFinishedPulling="2026-05-21 15:24:01.090517354 +0000 UTC m=+643.163833467" observedRunningTime="2026-05-21 15:24:01.579809819 +0000 UTC m=+643.653125955" watchObservedRunningTime="2026-05-21 15:24:01.580037909 +0000 UTC m=+643.653354044"
May 21 15:24:01.603864 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:01.603829    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j86b5"]
May 21 15:24:03.559476 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:03.559410    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-j86b5" podUID="995ea165-312e-45c1-aab2-a404a8627495" containerName="authorino" containerID="cri-o://68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0" gracePeriod=30
May 21 15:24:03.807202 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:03.807178    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j86b5"
May 21 15:24:03.920499 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:03.920469    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brjjx\" (UniqueName: \"kubernetes.io/projected/995ea165-312e-45c1-aab2-a404a8627495-kube-api-access-brjjx\") pod \"995ea165-312e-45c1-aab2-a404a8627495\" (UID: \"995ea165-312e-45c1-aab2-a404a8627495\") "
May 21 15:24:03.922872 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:03.922845    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995ea165-312e-45c1-aab2-a404a8627495-kube-api-access-brjjx" (OuterVolumeSpecName: "kube-api-access-brjjx") pod "995ea165-312e-45c1-aab2-a404a8627495" (UID: "995ea165-312e-45c1-aab2-a404a8627495"). InnerVolumeSpecName "kube-api-access-brjjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:24:04.021727 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.021692    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brjjx\" (UniqueName: \"kubernetes.io/projected/995ea165-312e-45c1-aab2-a404a8627495-kube-api-access-brjjx\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:24:04.563086 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.563049    2563 generic.go:358] "Generic (PLEG): container finished" podID="995ea165-312e-45c1-aab2-a404a8627495" containerID="68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0" exitCode=0
May 21 15:24:04.563502 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.563119    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-j86b5"
May 21 15:24:04.563502 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.563117    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j86b5" event={"ID":"995ea165-312e-45c1-aab2-a404a8627495","Type":"ContainerDied","Data":"68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0"}
May 21 15:24:04.563502 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.563158    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-j86b5" event={"ID":"995ea165-312e-45c1-aab2-a404a8627495","Type":"ContainerDied","Data":"eea0d41b7a67601bc3be202fbd3ec62b71001f766237948c3c655836cff95d32"}
May 21 15:24:04.563502 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.563174    2563 scope.go:117] "RemoveContainer" containerID="68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0"
May 21 15:24:04.571351 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.571333    2563 scope.go:117] "RemoveContainer" containerID="68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0"
May 21 15:24:04.571629 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:24:04.571612    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0\": container with ID starting with 68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0 not found: ID does not exist" containerID="68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0"
May 21 15:24:04.571700 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.571635    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0"} err="failed to get container status \"68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0\": rpc error: code = NotFound desc = could not find container \"68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0\": container with ID starting with 68a933f06a133cfc3df145c679b7d21bba3f710f15cd6a572540b3676b8b90f0 not found: ID does not exist"
May 21 15:24:04.579471 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.579446    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j86b5"]
May 21 15:24:04.584024 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:04.584000    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-j86b5"]
May 21 15:24:06.524632 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:06.524597    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995ea165-312e-45c1-aab2-a404a8627495" path="/var/lib/kubelet/pods/995ea165-312e-45c1-aab2-a404a8627495/volumes"
May 21 15:24:29.218606 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.218567    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdm6s"]
May 21 15:24:29.219093 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.219071    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995ea165-312e-45c1-aab2-a404a8627495" containerName="authorino"
May 21 15:24:29.219170 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.219097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="995ea165-312e-45c1-aab2-a404a8627495" containerName="authorino"
May 21 15:24:29.219223 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.219200    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="995ea165-312e-45c1-aab2-a404a8627495" containerName="authorino"
May 21 15:24:29.221054 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.221033    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdm6s"
May 21 15:24:29.229190 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.229163    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdm6s"]
May 21 15:24:29.247561 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.247537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6f4m\" (UniqueName: \"kubernetes.io/projected/12cf192b-ee25-4fa8-af26-ae0f91be2275-kube-api-access-q6f4m\") pod \"authorino-8b475cf9f-pdm6s\" (UID: \"12cf192b-ee25-4fa8-af26-ae0f91be2275\") " pod="kuadrant-system/authorino-8b475cf9f-pdm6s"
May 21 15:24:29.348822 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.348785    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6f4m\" (UniqueName: \"kubernetes.io/projected/12cf192b-ee25-4fa8-af26-ae0f91be2275-kube-api-access-q6f4m\") pod \"authorino-8b475cf9f-pdm6s\" (UID: \"12cf192b-ee25-4fa8-af26-ae0f91be2275\") " pod="kuadrant-system/authorino-8b475cf9f-pdm6s"
May 21 15:24:29.357195 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.357167    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6f4m\" (UniqueName: \"kubernetes.io/projected/12cf192b-ee25-4fa8-af26-ae0f91be2275-kube-api-access-q6f4m\") pod \"authorino-8b475cf9f-pdm6s\" (UID: \"12cf192b-ee25-4fa8-af26-ae0f91be2275\") " pod="kuadrant-system/authorino-8b475cf9f-pdm6s"
May 21 15:24:29.399982 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.399951    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdm6s"]
May 21 15:24:29.400218 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.400207    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdm6s"
May 21 15:24:29.430026 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.429993    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f8qr9"]
May 21 15:24:29.433462 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.433440    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.436096 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.436071    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 21 15:24:29.441526 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.441493    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f8qr9"]
May 21 15:24:29.480356 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.480281    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f8qr9"]
May 21 15:24:29.480585 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:24:29.480565    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-f6kf2 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-f6kf2 tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-f8qr9" podUID="384f9146-39b7-421b-93a5-a6d0d73f0992"
May 21 15:24:29.517186 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.517155    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8d546f96f-vktkw"]
May 21 15:24:29.523245 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.523218    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.528479 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.528450    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8d546f96f-vktkw"]
May 21 15:24:29.545345 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.545315    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdm6s"]
May 21 15:24:29.549009 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:24:29.548983    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12cf192b_ee25_4fa8_af26_ae0f91be2275.slice/crio-b7508971abdef66239dcdf04f95088bacd3b2a688e7bc998166c00e689517f96 WatchSource:0}: Error finding container b7508971abdef66239dcdf04f95088bacd3b2a688e7bc998166c00e689517f96: Status 404 returned error can't find the container with id b7508971abdef66239dcdf04f95088bacd3b2a688e7bc998166c00e689517f96
May 21 15:24:29.550273 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.550252    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:24:29.550802 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.550768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6kf2\" (UniqueName: \"kubernetes.io/projected/384f9146-39b7-421b-93a5-a6d0d73f0992-kube-api-access-f6kf2\") pod \"authorino-56fdd757f5-f8qr9\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") " pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.550868 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.550817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/384f9146-39b7-421b-93a5-a6d0d73f0992-tls-cert\") pod \"authorino-56fdd757f5-f8qr9\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") " pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.550978 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.550934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kwg2\" (UniqueName: \"kubernetes.io/projected/5b296eb1-5181-4649-b4b0-98171bab5d8f-kube-api-access-4kwg2\") pod \"authorino-8d546f96f-vktkw\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") " pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.551068 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.551016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b296eb1-5181-4649-b4b0-98171bab5d8f-tls-cert\") pod \"authorino-8d546f96f-vktkw\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") " pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.648492 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.648442    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-pdm6s" event={"ID":"12cf192b-ee25-4fa8-af26-ae0f91be2275","Type":"ContainerStarted","Data":"b7508971abdef66239dcdf04f95088bacd3b2a688e7bc998166c00e689517f96"}
May 21 15:24:29.648492 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.648484    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.651571 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.651545    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6kf2\" (UniqueName: \"kubernetes.io/projected/384f9146-39b7-421b-93a5-a6d0d73f0992-kube-api-access-f6kf2\") pod \"authorino-56fdd757f5-f8qr9\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") " pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.651711 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.651589    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/384f9146-39b7-421b-93a5-a6d0d73f0992-tls-cert\") pod \"authorino-56fdd757f5-f8qr9\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") " pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.651776 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.651764    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kwg2\" (UniqueName: \"kubernetes.io/projected/5b296eb1-5181-4649-b4b0-98171bab5d8f-kube-api-access-4kwg2\") pod \"authorino-8d546f96f-vktkw\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") " pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.651843 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.651808    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b296eb1-5181-4649-b4b0-98171bab5d8f-tls-cert\") pod \"authorino-8d546f96f-vktkw\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") " pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.653687 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.653661    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.654499 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.654473    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b296eb1-5181-4649-b4b0-98171bab5d8f-tls-cert\") pod \"authorino-8d546f96f-vktkw\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") " pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.654596 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.654512    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/384f9146-39b7-421b-93a5-a6d0d73f0992-tls-cert\") pod \"authorino-56fdd757f5-f8qr9\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") " pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.659440 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.659395    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6kf2\" (UniqueName: \"kubernetes.io/projected/384f9146-39b7-421b-93a5-a6d0d73f0992-kube-api-access-f6kf2\") pod \"authorino-56fdd757f5-f8qr9\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") " pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:29.660136 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.660115    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kwg2\" (UniqueName: \"kubernetes.io/projected/5b296eb1-5181-4649-b4b0-98171bab5d8f-kube-api-access-4kwg2\") pod \"authorino-8d546f96f-vktkw\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") " pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.752225 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.752142    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6kf2\" (UniqueName: \"kubernetes.io/projected/384f9146-39b7-421b-93a5-a6d0d73f0992-kube-api-access-f6kf2\") pod \"384f9146-39b7-421b-93a5-a6d0d73f0992\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") "
May 21 15:24:29.752225 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.752216    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/384f9146-39b7-421b-93a5-a6d0d73f0992-tls-cert\") pod \"384f9146-39b7-421b-93a5-a6d0d73f0992\" (UID: \"384f9146-39b7-421b-93a5-a6d0d73f0992\") "
May 21 15:24:29.754294 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.754252    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/384f9146-39b7-421b-93a5-a6d0d73f0992-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "384f9146-39b7-421b-93a5-a6d0d73f0992" (UID: "384f9146-39b7-421b-93a5-a6d0d73f0992"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:24:29.754294 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.754271    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384f9146-39b7-421b-93a5-a6d0d73f0992-kube-api-access-f6kf2" (OuterVolumeSpecName: "kube-api-access-f6kf2") pod "384f9146-39b7-421b-93a5-a6d0d73f0992" (UID: "384f9146-39b7-421b-93a5-a6d0d73f0992"). InnerVolumeSpecName "kube-api-access-f6kf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:24:29.834458 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.834410    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:24:29.853292 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.853266    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/384f9146-39b7-421b-93a5-a6d0d73f0992-tls-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:24:29.853292 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.853294    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6kf2\" (UniqueName: \"kubernetes.io/projected/384f9146-39b7-421b-93a5-a6d0d73f0992-kube-api-access-f6kf2\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:24:29.960667 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:29.960643    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8d546f96f-vktkw"]
May 21 15:24:29.962954 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:24:29.962928    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b296eb1_5181_4649_b4b0_98171bab5d8f.slice/crio-f2de224ac332513145944bd02ba1d19c50bd724c04b5e473a9d771c97a0e2fc2 WatchSource:0}: Error finding container f2de224ac332513145944bd02ba1d19c50bd724c04b5e473a9d771c97a0e2fc2: Status 404 returned error can't find the container with id f2de224ac332513145944bd02ba1d19c50bd724c04b5e473a9d771c97a0e2fc2
May 21 15:24:30.653178 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.653141    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-pdm6s" event={"ID":"12cf192b-ee25-4fa8-af26-ae0f91be2275","Type":"ContainerStarted","Data":"0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0"}
May 21 15:24:30.653682 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.653217    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-pdm6s" podUID="12cf192b-ee25-4fa8-af26-ae0f91be2275" containerName="authorino" containerID="cri-o://0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0" gracePeriod=30
May 21 15:24:30.654786 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.654743    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d546f96f-vktkw" event={"ID":"5b296eb1-5181-4649-b4b0-98171bab5d8f","Type":"ContainerStarted","Data":"1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0"}
May 21 15:24:30.654786 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.654778    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d546f96f-vktkw" event={"ID":"5b296eb1-5181-4649-b4b0-98171bab5d8f","Type":"ContainerStarted","Data":"f2de224ac332513145944bd02ba1d19c50bd724c04b5e473a9d771c97a0e2fc2"}
May 21 15:24:30.654786 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.654778    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f8qr9"
May 21 15:24:30.669345 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.669304    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-pdm6s" podStartSLOduration=1.259776442 podStartE2EDuration="1.669291772s" podCreationTimestamp="2026-05-21 15:24:29 +0000 UTC" firstStartedPulling="2026-05-21 15:24:29.550371338 +0000 UTC m=+671.623687452" lastFinishedPulling="2026-05-21 15:24:29.959886666 +0000 UTC m=+672.033202782" observedRunningTime="2026-05-21 15:24:30.668700606 +0000 UTC m=+672.742016741" watchObservedRunningTime="2026-05-21 15:24:30.669291772 +0000 UTC m=+672.742607907"
May 21 15:24:30.684937 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.684879    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8d546f96f-vktkw" podStartSLOduration=1.375706644 podStartE2EDuration="1.684863316s" podCreationTimestamp="2026-05-21 15:24:29 +0000 UTC" firstStartedPulling="2026-05-21 15:24:29.964373152 +0000 UTC m=+672.037689285" lastFinishedPulling="2026-05-21 15:24:30.273529836 +0000 UTC m=+672.346845957" observedRunningTime="2026-05-21 15:24:30.684211423 +0000 UTC m=+672.757527559" watchObservedRunningTime="2026-05-21 15:24:30.684863316 +0000 UTC m=+672.758179452"
May 21 15:24:30.710720 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.710687    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f8qr9"]
May 21 15:24:30.716915 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.716879    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f8qr9"]
May 21 15:24:30.718882 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.718862    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-rldkj"]
May 21 15:24:30.719137 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.719110    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-rldkj" podUID="08e9571a-73d7-4305-9043-73d14af11f56" containerName="authorino" containerID="cri-o://16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4" gracePeriod=30
May 21 15:24:30.975362 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.975336    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdm6s"
May 21 15:24:30.978654 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:30.978634    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rldkj"
May 21 15:24:31.063286 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.063252    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7tr6\" (UniqueName: \"kubernetes.io/projected/08e9571a-73d7-4305-9043-73d14af11f56-kube-api-access-q7tr6\") pod \"08e9571a-73d7-4305-9043-73d14af11f56\" (UID: \"08e9571a-73d7-4305-9043-73d14af11f56\") "
May 21 15:24:31.063494 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.063314    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6f4m\" (UniqueName: \"kubernetes.io/projected/12cf192b-ee25-4fa8-af26-ae0f91be2275-kube-api-access-q6f4m\") pod \"12cf192b-ee25-4fa8-af26-ae0f91be2275\" (UID: \"12cf192b-ee25-4fa8-af26-ae0f91be2275\") "
May 21 15:24:31.065613 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.065580    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08e9571a-73d7-4305-9043-73d14af11f56-kube-api-access-q7tr6" (OuterVolumeSpecName: "kube-api-access-q7tr6") pod "08e9571a-73d7-4305-9043-73d14af11f56" (UID: "08e9571a-73d7-4305-9043-73d14af11f56"). InnerVolumeSpecName "kube-api-access-q7tr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:24:31.065726 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.065617    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12cf192b-ee25-4fa8-af26-ae0f91be2275-kube-api-access-q6f4m" (OuterVolumeSpecName: "kube-api-access-q6f4m") pod "12cf192b-ee25-4fa8-af26-ae0f91be2275" (UID: "12cf192b-ee25-4fa8-af26-ae0f91be2275"). InnerVolumeSpecName "kube-api-access-q6f4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:24:31.164865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.164829    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7tr6\" (UniqueName: \"kubernetes.io/projected/08e9571a-73d7-4305-9043-73d14af11f56-kube-api-access-q7tr6\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:24:31.164865 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.164859    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6f4m\" (UniqueName: \"kubernetes.io/projected/12cf192b-ee25-4fa8-af26-ae0f91be2275-kube-api-access-q6f4m\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:24:31.659052 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.659012    2563 generic.go:358] "Generic (PLEG): container finished" podID="12cf192b-ee25-4fa8-af26-ae0f91be2275" containerID="0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0" exitCode=0
May 21 15:24:31.659518 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.659071    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdm6s"
May 21 15:24:31.659518 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.659105    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-pdm6s" event={"ID":"12cf192b-ee25-4fa8-af26-ae0f91be2275","Type":"ContainerDied","Data":"0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0"}
May 21 15:24:31.659518 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.659146    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-pdm6s" event={"ID":"12cf192b-ee25-4fa8-af26-ae0f91be2275","Type":"ContainerDied","Data":"b7508971abdef66239dcdf04f95088bacd3b2a688e7bc998166c00e689517f96"}
May 21 15:24:31.659518 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.659165    2563 scope.go:117] "RemoveContainer" containerID="0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0"
May 21 15:24:31.660491 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.660184    2563 generic.go:358] "Generic (PLEG): container finished" podID="08e9571a-73d7-4305-9043-73d14af11f56" containerID="16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4" exitCode=0
May 21 15:24:31.660491 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.660219    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-rldkj"
May 21 15:24:31.660491 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.660262    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rldkj" event={"ID":"08e9571a-73d7-4305-9043-73d14af11f56","Type":"ContainerDied","Data":"16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4"}
May 21 15:24:31.660491 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.660289    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-rldkj" event={"ID":"08e9571a-73d7-4305-9043-73d14af11f56","Type":"ContainerDied","Data":"232297e55804a20461ea780834983f08bd9f2d60087ee5889b02acf812523660"}
May 21 15:24:31.668875 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.668771    2563 scope.go:117] "RemoveContainer" containerID="0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0"
May 21 15:24:31.669039 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:24:31.669018    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0\": container with ID starting with 0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0 not found: ID does not exist" containerID="0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0"
May 21 15:24:31.669144 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.669051    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0"} err="failed to get container status \"0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0\": rpc error: code = NotFound desc = could not find container \"0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0\": container with ID starting with 0ed2fbb6ee5ec657c7ce44ec346aac1d8a06b3c502772fdf08fc35db45ede2a0 not found: ID does not exist"
May 21 15:24:31.669144 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.669074    2563 scope.go:117] "RemoveContainer" containerID="16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4"
May 21 15:24:31.677031 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.677015    2563 scope.go:117] "RemoveContainer" containerID="16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4"
May 21 15:24:31.677252 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:24:31.677234    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4\": container with ID starting with 16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4 not found: ID does not exist" containerID="16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4"
May 21 15:24:31.677306 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.677260    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4"} err="failed to get container status \"16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4\": rpc error: code = NotFound desc = could not find container \"16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4\": container with ID starting with 16f5a502fa365b6f01ba0ae476ca1382142e7db56bf47ba10886588ceba2a8e4 not found: ID does not exist"
May 21 15:24:31.684399 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.684377    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdm6s"]
May 21 15:24:31.689350 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.689321    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdm6s"]
May 21 15:24:31.699124 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.699100    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-rldkj"]
May 21 15:24:31.705505 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:31.705486    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-rldkj"]
May 21 15:24:32.525010 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:32.524977    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08e9571a-73d7-4305-9043-73d14af11f56" path="/var/lib/kubelet/pods/08e9571a-73d7-4305-9043-73d14af11f56/volumes"
May 21 15:24:32.525308 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:32.525296    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12cf192b-ee25-4fa8-af26-ae0f91be2275" path="/var/lib/kubelet/pods/12cf192b-ee25-4fa8-af26-ae0f91be2275/volumes"
May 21 15:24:32.525629 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:24:32.525616    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="384f9146-39b7-421b-93a5-a6d0d73f0992" path="/var/lib/kubelet/pods/384f9146-39b7-421b-93a5-a6d0d73f0992/volumes"
May 21 15:25:19.801312 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.801272    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"]
May 21 15:25:19.801772 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.801634    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12cf192b-ee25-4fa8-af26-ae0f91be2275" containerName="authorino"
May 21 15:25:19.801772 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.801646    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="12cf192b-ee25-4fa8-af26-ae0f91be2275" containerName="authorino"
May 21 15:25:19.801772 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.801662    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08e9571a-73d7-4305-9043-73d14af11f56" containerName="authorino"
May 21 15:25:19.801772 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.801668    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="08e9571a-73d7-4305-9043-73d14af11f56" containerName="authorino"
May 21 15:25:19.801772 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.801736    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="12cf192b-ee25-4fa8-af26-ae0f91be2275" containerName="authorino"
May 21 15:25:19.801772 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.801748    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="08e9571a-73d7-4305-9043-73d14af11f56" containerName="authorino"
May 21 15:25:19.806152 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.806132    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.809733 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.809709    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 15:25:19.809852 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.809709    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 15:25:19.809852 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.809781    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 21 15:25:19.809852 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.809810    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-44d92\""
May 21 15:25:19.815231 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.815208    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"]
May 21 15:25:19.891288 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.891249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866jz\" (UniqueName: \"kubernetes.io/projected/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-kube-api-access-866jz\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.891482 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.891388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.891482 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.891451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.891612 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.891481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.891612 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.891553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.891612 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.891595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992058 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992020    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992058 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992070    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992274 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992110    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-866jz\" (UniqueName: \"kubernetes.io/projected/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-kube-api-access-866jz\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992274 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992148    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992274 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992169    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992274 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992198    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992622 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992596    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992696 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992634    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:19.992696 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:19.992685    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:20.001330 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:20.001138    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-866jz\" (UniqueName: \"kubernetes.io/projected/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-kube-api-access-866jz\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:20.005569 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:20.005539    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:20.006661 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:20.006629    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cac8346-65fe-4b34-a88a-3adcfa58ab4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9\" (UID: \"6cac8346-65fe-4b34-a88a-3adcfa58ab4f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:20.117704 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:20.117621    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:20.255333 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:20.255297    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"]
May 21 15:25:20.258954 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:25:20.258928    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cac8346_65fe_4b34_a88a_3adcfa58ab4f.slice/crio-139432f2790b4e62cb81f0920a012f6e8782cbaef1d5f46c174e1279de093f68 WatchSource:0}: Error finding container 139432f2790b4e62cb81f0920a012f6e8782cbaef1d5f46c174e1279de093f68: Status 404 returned error can't find the container with id 139432f2790b4e62cb81f0920a012f6e8782cbaef1d5f46c174e1279de093f68
May 21 15:25:20.853011 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:20.852974    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9" event={"ID":"6cac8346-65fe-4b34-a88a-3adcfa58ab4f","Type":"ContainerStarted","Data":"139432f2790b4e62cb81f0920a012f6e8782cbaef1d5f46c174e1279de093f68"}
May 21 15:25:27.883244 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:27.883205    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9" event={"ID":"6cac8346-65fe-4b34-a88a-3adcfa58ab4f","Type":"ContainerStarted","Data":"2e91976327b00fc6cba5b6c7931175239a7220eb860f59745897c29bda4fdc48"}
May 21 15:25:32.903181 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:32.903138    2563 generic.go:358] "Generic (PLEG): container finished" podID="6cac8346-65fe-4b34-a88a-3adcfa58ab4f" containerID="2e91976327b00fc6cba5b6c7931175239a7220eb860f59745897c29bda4fdc48" exitCode=0
May 21 15:25:32.903567 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:32.903211    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9" event={"ID":"6cac8346-65fe-4b34-a88a-3adcfa58ab4f","Type":"ContainerDied","Data":"2e91976327b00fc6cba5b6c7931175239a7220eb860f59745897c29bda4fdc48"}
May 21 15:25:34.915945 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:34.915904    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9" event={"ID":"6cac8346-65fe-4b34-a88a-3adcfa58ab4f","Type":"ContainerStarted","Data":"18201c1d581602291f1272cf2a809b72b7386056dcff038afcc10f89568d1d17"}
May 21 15:25:34.916353 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:34.916111    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:34.937203 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:34.937135    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9" podStartSLOduration=2.023624821 podStartE2EDuration="15.93711558s" podCreationTimestamp="2026-05-21 15:25:19 +0000 UTC" firstStartedPulling="2026-05-21 15:25:20.260914235 +0000 UTC m=+722.334230350" lastFinishedPulling="2026-05-21 15:25:34.174404994 +0000 UTC m=+736.247721109" observedRunningTime="2026-05-21 15:25:34.934944994 +0000 UTC m=+737.008261123" watchObservedRunningTime="2026-05-21 15:25:34.93711558 +0000 UTC m=+737.010431717"
May 21 15:25:44.405988 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.405948    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"]
May 21 15:25:44.412980 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.412960    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.415688 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.415655    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 21 15:25:44.418599 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.418577    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"]
May 21 15:25:44.527698 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.527669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.527876 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.527713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.527876 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.527794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2fdj\" (UniqueName: \"kubernetes.io/projected/f838756f-b5d8-4506-91d6-dc86bb31ae63-kube-api-access-w2fdj\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.527948 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.527886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.527948 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.527938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.528013 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.527959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f838756f-b5d8-4506-91d6-dc86bb31ae63-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628350 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628313    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628554 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628361    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628554 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628398    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f838756f-b5d8-4506-91d6-dc86bb31ae63-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628554 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628452    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628740 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628566    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628740 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628646    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2fdj\" (UniqueName: \"kubernetes.io/projected/f838756f-b5d8-4506-91d6-dc86bb31ae63-kube-api-access-w2fdj\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628852 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628782    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628852 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.628950 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.628860    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.631163 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.631139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f838756f-b5d8-4506-91d6-dc86bb31ae63-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.631523 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.631505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f838756f-b5d8-4506-91d6-dc86bb31ae63-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.636838 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.636814    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2fdj\" (UniqueName: \"kubernetes.io/projected/f838756f-b5d8-4506-91d6-dc86bb31ae63-kube-api-access-w2fdj\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-gds85\" (UID: \"f838756f-b5d8-4506-91d6-dc86bb31ae63\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.724064 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.723971    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:44.896172 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.896144    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"]
May 21 15:25:44.898415 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:25:44.898387    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf838756f_b5d8_4506_91d6_dc86bb31ae63.slice/crio-54dd2a4d1ff0e79db6a78b118ee1c3d3e4325594ecd76fc028ab28b5e3b549d4 WatchSource:0}: Error finding container 54dd2a4d1ff0e79db6a78b118ee1c3d3e4325594ecd76fc028ab28b5e3b549d4: Status 404 returned error can't find the container with id 54dd2a4d1ff0e79db6a78b118ee1c3d3e4325594ecd76fc028ab28b5e3b549d4
May 21 15:25:44.952648 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:44.952620    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85" event={"ID":"f838756f-b5d8-4506-91d6-dc86bb31ae63","Type":"ContainerStarted","Data":"54dd2a4d1ff0e79db6a78b118ee1c3d3e4325594ecd76fc028ab28b5e3b549d4"}
May 21 15:25:45.932460 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:45.932392    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9"
May 21 15:25:45.958614 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:45.958572    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85" event={"ID":"f838756f-b5d8-4506-91d6-dc86bb31ae63","Type":"ContainerStarted","Data":"8e898a66967df401cb8e69cf608a079a39d28cf96b907917f9db8f75c352e606"}
May 21 15:25:50.977998 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:50.977961    2563 generic.go:358] "Generic (PLEG): container finished" podID="f838756f-b5d8-4506-91d6-dc86bb31ae63" containerID="8e898a66967df401cb8e69cf608a079a39d28cf96b907917f9db8f75c352e606" exitCode=0
May 21 15:25:50.978405 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:50.978030    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85" event={"ID":"f838756f-b5d8-4506-91d6-dc86bb31ae63","Type":"ContainerDied","Data":"8e898a66967df401cb8e69cf608a079a39d28cf96b907917f9db8f75c352e606"}
May 21 15:25:51.983283 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:51.983248    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85" event={"ID":"f838756f-b5d8-4506-91d6-dc86bb31ae63","Type":"ContainerStarted","Data":"1740291d83d8185a14e07569fad85116ae2d6035934cdbd381619c5436a73eab"}
May 21 15:25:51.983700 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:51.983472    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:25:52.005648 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:52.005596    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85" podStartSLOduration=7.65420167 podStartE2EDuration="8.005582278s" podCreationTimestamp="2026-05-21 15:25:44 +0000 UTC" firstStartedPulling="2026-05-21 15:25:50.978664262 +0000 UTC m=+753.051980375" lastFinishedPulling="2026-05-21 15:25:51.330044867 +0000 UTC m=+753.403360983" observedRunningTime="2026-05-21 15:25:52.003548111 +0000 UTC m=+754.076864250" watchObservedRunningTime="2026-05-21 15:25:52.005582278 +0000 UTC m=+754.078898412"
May 21 15:25:54.908690 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:54.908653    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"]
May 21 15:25:54.913321 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:54.913302    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:54.915960 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:54.915940    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 15:25:54.921835 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:54.921810    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"]
May 21 15:25:55.022981 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.022940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w78w7\" (UniqueName: \"kubernetes.io/projected/8537bccf-979f-49a3-b91a-4f46b265b7da-kube-api-access-w78w7\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.023169 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.023027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.023169 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.023053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.023169 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.023094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.023169 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.023149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.023328 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.023181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8537bccf-979f-49a3-b91a-4f46b265b7da-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.123868 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.123817    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.123868 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.123873    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.124135 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.123930    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.124135 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.123962    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.124135 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.123988    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8537bccf-979f-49a3-b91a-4f46b265b7da-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.124135 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.124026    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w78w7\" (UniqueName: \"kubernetes.io/projected/8537bccf-979f-49a3-b91a-4f46b265b7da-kube-api-access-w78w7\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.124318 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.124287    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.124370 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.124317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.124453 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.124399    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.126338 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.126311    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8537bccf-979f-49a3-b91a-4f46b265b7da-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.126627 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.126609    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8537bccf-979f-49a3-b91a-4f46b265b7da-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.133218 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.133195    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w78w7\" (UniqueName: \"kubernetes.io/projected/8537bccf-979f-49a3-b91a-4f46b265b7da-kube-api-access-w78w7\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-56h22\" (UID: \"8537bccf-979f-49a3-b91a-4f46b265b7da\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.225235 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.225147    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:25:55.367188 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.367162    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"]
May 21 15:25:55.369871 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:25:55.369838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8537bccf_979f_49a3_b91a_4f46b265b7da.slice/crio-592e24984e10489a44eb7c12067a92cdbd128b08c16c0387d8f27eabca94d141 WatchSource:0}: Error finding container 592e24984e10489a44eb7c12067a92cdbd128b08c16c0387d8f27eabca94d141: Status 404 returned error can't find the container with id 592e24984e10489a44eb7c12067a92cdbd128b08c16c0387d8f27eabca94d141
May 21 15:25:55.999254 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.999215    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22" event={"ID":"8537bccf-979f-49a3-b91a-4f46b265b7da","Type":"ContainerStarted","Data":"e045059f82619c64d7738adedb083d4fc8139c3eca2ce0f64be5318fc76627f3"}
May 21 15:25:55.999645 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:25:55.999263    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22" event={"ID":"8537bccf-979f-49a3-b91a-4f46b265b7da","Type":"ContainerStarted","Data":"592e24984e10489a44eb7c12067a92cdbd128b08c16c0387d8f27eabca94d141"}
May 21 15:26:01.018580 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:01.018544    2563 generic.go:358] "Generic (PLEG): container finished" podID="8537bccf-979f-49a3-b91a-4f46b265b7da" containerID="e045059f82619c64d7738adedb083d4fc8139c3eca2ce0f64be5318fc76627f3" exitCode=0
May 21 15:26:01.019004 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:01.018618    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22" event={"ID":"8537bccf-979f-49a3-b91a-4f46b265b7da","Type":"ContainerDied","Data":"e045059f82619c64d7738adedb083d4fc8139c3eca2ce0f64be5318fc76627f3"}
May 21 15:26:02.999383 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:02.999354    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-gds85"
May 21 15:26:03.027113 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:03.027083    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22" event={"ID":"8537bccf-979f-49a3-b91a-4f46b265b7da","Type":"ContainerStarted","Data":"1479837b1c63cbb2073e91a9510f7065af5a0547c9b6538d5f3b9d7795bab742"}
May 21 15:26:03.027327 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:03.027309    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:26:03.046452 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:03.046365    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22" podStartSLOduration=7.173210866 podStartE2EDuration="9.046346214s" podCreationTimestamp="2026-05-21 15:25:54 +0000 UTC" firstStartedPulling="2026-05-21 15:26:01.019243599 +0000 UTC m=+763.092559712" lastFinishedPulling="2026-05-21 15:26:02.892378946 +0000 UTC m=+764.965695060" observedRunningTime="2026-05-21 15:26:03.045614146 +0000 UTC m=+765.118930283" watchObservedRunningTime="2026-05-21 15:26:03.046346214 +0000 UTC m=+765.119662353"
May 21 15:26:14.042823 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:14.042792    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-56h22"
May 21 15:26:42.137731 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.137651    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fc5c8b8f6-nx8r4"]
May 21 15:26:42.141328 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.141308    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.152112 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.152080    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc5c8b8f6-nx8r4"]
May 21 15:26:42.256650 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.256607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c62w5\" (UniqueName: \"kubernetes.io/projected/681818b1-fb14-404a-88b2-86e5dafc53dc-kube-api-access-c62w5\") pod \"authorino-5fc5c8b8f6-nx8r4\" (UID: \"681818b1-fb14-404a-88b2-86e5dafc53dc\") " pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.256839 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.256706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/681818b1-fb14-404a-88b2-86e5dafc53dc-tls-cert\") pod \"authorino-5fc5c8b8f6-nx8r4\" (UID: \"681818b1-fb14-404a-88b2-86e5dafc53dc\") " pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.357655 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.357620    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c62w5\" (UniqueName: \"kubernetes.io/projected/681818b1-fb14-404a-88b2-86e5dafc53dc-kube-api-access-c62w5\") pod \"authorino-5fc5c8b8f6-nx8r4\" (UID: \"681818b1-fb14-404a-88b2-86e5dafc53dc\") " pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.357786 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.357680    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/681818b1-fb14-404a-88b2-86e5dafc53dc-tls-cert\") pod \"authorino-5fc5c8b8f6-nx8r4\" (UID: \"681818b1-fb14-404a-88b2-86e5dafc53dc\") " pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.360318 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.360295    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/681818b1-fb14-404a-88b2-86e5dafc53dc-tls-cert\") pod \"authorino-5fc5c8b8f6-nx8r4\" (UID: \"681818b1-fb14-404a-88b2-86e5dafc53dc\") " pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.372080 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.372050    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c62w5\" (UniqueName: \"kubernetes.io/projected/681818b1-fb14-404a-88b2-86e5dafc53dc-kube-api-access-c62w5\") pod \"authorino-5fc5c8b8f6-nx8r4\" (UID: \"681818b1-fb14-404a-88b2-86e5dafc53dc\") " pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.450660 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.450625    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4"
May 21 15:26:42.607828 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:42.607801    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fc5c8b8f6-nx8r4"]
May 21 15:26:42.610173 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:26:42.610143    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod681818b1_fb14_404a_88b2_86e5dafc53dc.slice/crio-bd0c720009b77011ac7a28a5e810f77871f2f9073d4a8a8d53b1d8c0ff2c247a WatchSource:0}: Error finding container bd0c720009b77011ac7a28a5e810f77871f2f9073d4a8a8d53b1d8c0ff2c247a: Status 404 returned error can't find the container with id bd0c720009b77011ac7a28a5e810f77871f2f9073d4a8a8d53b1d8c0ff2c247a
May 21 15:26:43.173964 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.173924    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4" event={"ID":"681818b1-fb14-404a-88b2-86e5dafc53dc","Type":"ContainerStarted","Data":"a40d07e0a160b1704ebe7b2df8cdba85a3db6bd08680bca88e8e9faf80f1a4be"}
May 21 15:26:43.173964 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.173967    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4" event={"ID":"681818b1-fb14-404a-88b2-86e5dafc53dc","Type":"ContainerStarted","Data":"bd0c720009b77011ac7a28a5e810f77871f2f9073d4a8a8d53b1d8c0ff2c247a"}
May 21 15:26:43.196350 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.196287    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5fc5c8b8f6-nx8r4" podStartSLOduration=0.841357411 podStartE2EDuration="1.196268201s" podCreationTimestamp="2026-05-21 15:26:42 +0000 UTC" firstStartedPulling="2026-05-21 15:26:42.611380999 +0000 UTC m=+804.684697115" lastFinishedPulling="2026-05-21 15:26:42.966291779 +0000 UTC m=+805.039607905" observedRunningTime="2026-05-21 15:26:43.193308077 +0000 UTC m=+805.266624212" watchObservedRunningTime="2026-05-21 15:26:43.196268201 +0000 UTC m=+805.269584339"
May 21 15:26:43.242573 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.242489    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8d546f96f-vktkw"]
May 21 15:26:43.243080 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.243045    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8d546f96f-vktkw" podUID="5b296eb1-5181-4649-b4b0-98171bab5d8f" containerName="authorino" containerID="cri-o://1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0" gracePeriod=30
May 21 15:26:43.500742 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.500658    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:26:43.570468 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.570404    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kwg2\" (UniqueName: \"kubernetes.io/projected/5b296eb1-5181-4649-b4b0-98171bab5d8f-kube-api-access-4kwg2\") pod \"5b296eb1-5181-4649-b4b0-98171bab5d8f\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") "
May 21 15:26:43.570635 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.570512    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b296eb1-5181-4649-b4b0-98171bab5d8f-tls-cert\") pod \"5b296eb1-5181-4649-b4b0-98171bab5d8f\" (UID: \"5b296eb1-5181-4649-b4b0-98171bab5d8f\") "
May 21 15:26:43.572701 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.572671    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b296eb1-5181-4649-b4b0-98171bab5d8f-kube-api-access-4kwg2" (OuterVolumeSpecName: "kube-api-access-4kwg2") pod "5b296eb1-5181-4649-b4b0-98171bab5d8f" (UID: "5b296eb1-5181-4649-b4b0-98171bab5d8f"). InnerVolumeSpecName "kube-api-access-4kwg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:26:43.582959 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.582928    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b296eb1-5181-4649-b4b0-98171bab5d8f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5b296eb1-5181-4649-b4b0-98171bab5d8f" (UID: "5b296eb1-5181-4649-b4b0-98171bab5d8f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:26:43.671256 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.671215    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kwg2\" (UniqueName: \"kubernetes.io/projected/5b296eb1-5181-4649-b4b0-98171bab5d8f-kube-api-access-4kwg2\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:26:43.671256 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:43.671256    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b296eb1-5181-4649-b4b0-98171bab5d8f-tls-cert\") on node \"ip-10-0-134-80.ec2.internal\" DevicePath \"\""
May 21 15:26:44.178032 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.177998    2563 generic.go:358] "Generic (PLEG): container finished" podID="5b296eb1-5181-4649-b4b0-98171bab5d8f" containerID="1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0" exitCode=0
May 21 15:26:44.178483 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.178050    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8d546f96f-vktkw"
May 21 15:26:44.178483 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.178078    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d546f96f-vktkw" event={"ID":"5b296eb1-5181-4649-b4b0-98171bab5d8f","Type":"ContainerDied","Data":"1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0"}
May 21 15:26:44.178483 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.178121    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8d546f96f-vktkw" event={"ID":"5b296eb1-5181-4649-b4b0-98171bab5d8f","Type":"ContainerDied","Data":"f2de224ac332513145944bd02ba1d19c50bd724c04b5e473a9d771c97a0e2fc2"}
May 21 15:26:44.178483 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.178138    2563 scope.go:117] "RemoveContainer" containerID="1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0"
May 21 15:26:44.187261 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.187243    2563 scope.go:117] "RemoveContainer" containerID="1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0"
May 21 15:26:44.187588 ip-10-0-134-80 kubenswrapper[2563]: E0521 15:26:44.187567    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0\": container with ID starting with 1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0 not found: ID does not exist" containerID="1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0"
May 21 15:26:44.187649 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.187598    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0"} err="failed to get container status \"1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0\": rpc error: code = NotFound desc = could not find container \"1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0\": container with ID starting with 1f4cb27a3541d98d1fafbbc1c41c0fdccf207365255c0ff7c80c1312404e1aa0 not found: ID does not exist"
May 21 15:26:44.201964 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.201938    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8d546f96f-vktkw"]
May 21 15:26:44.212266 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.212240    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8d546f96f-vktkw"]
May 21 15:26:44.524243 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:26:44.524169    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b296eb1-5181-4649-b4b0-98171bab5d8f" path="/var/lib/kubelet/pods/5b296eb1-5181-4649-b4b0-98171bab5d8f/volumes"
May 21 15:28:18.444736 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:28:18.444699    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:28:18.448791 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:28:18.448768    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:28:18.450703 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:28:18.450684    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:28:18.454332 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:28:18.454313    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:33:18.469917 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:33:18.469882    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:33:18.474467 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:33:18.474443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:33:18.477006 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:33:18.476984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:33:18.480896 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:33:18.480879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:38:18.496015 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:38:18.495978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:38:18.502787 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:38:18.502764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:38:18.510072 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:38:18.510049    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:38:18.514459 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:38:18.514438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:43:18.526662 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:43:18.526563    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:43:18.533503 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:43:18.530636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:43:18.537377 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:43:18.537359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:43:18.540925 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:43:18.540909    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:48:18.550443 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:48:18.550331    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:48:18.554993 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:48:18.554633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:48:18.565133 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:48:18.565116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:48:18.568549 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:48:18.568531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:51:17.942231 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:17.942199    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc5c8b8f6-nx8r4_681818b1-fb14-404a-88b2-86e5dafc53dc/authorino/0.log"
May 21 15:51:23.674195 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:23.674160    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-594496b99d-zhc8v_6c0658e9-ce3b-4c99-a97a-70be3c10a0a7/manager/0.log"
May 21 15:51:25.213886 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:25.213857    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc5c8b8f6-nx8r4_681818b1-fb14-404a-88b2-86e5dafc53dc/authorino/0.log"
May 21 15:51:26.056594 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:26.056566    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qq5dc_f8d177df-8bf0-4b5e-b110-9b9cfab10552/manager/0.log"
May 21 15:51:26.626202 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:26.626175    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd665b65-6wqsh_3e5385b9-7950-491c-81f0-da3ba96835f3/kube-auth-proxy/0.log"
May 21 15:51:27.416600 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:27.416553    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-56h22_8537bccf-979f-49a3-b91a-4f46b265b7da/storage-initializer/0.log"
May 21 15:51:27.425654 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:27.425629    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-56h22_8537bccf-979f-49a3-b91a-4f46b265b7da/main/0.log"
May 21 15:51:27.661942 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:27.661897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-gds85_f838756f-b5d8-4506-91d6-dc86bb31ae63/storage-initializer/0.log"
May 21 15:51:27.670055 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:27.669983    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-gds85_f838756f-b5d8-4506-91d6-dc86bb31ae63/main/0.log"
May 21 15:51:27.900368 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:27.900339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9_6cac8346-65fe-4b34-a88a-3adcfa58ab4f/storage-initializer/0.log"
May 21 15:51:27.908728 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:27.908682    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-k2zx9_6cac8346-65fe-4b34-a88a-3adcfa58ab4f/main/0.log"
May 21 15:51:34.947141 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:34.947110    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z4769_83accbad-9926-4b13-a655-133b9b376659/global-pull-secret-syncer/0.log"
May 21 15:51:35.079987 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:35.079953    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jrmx5_3b074476-43a9-4d33-a0d7-7415b8398524/konnectivity-agent/0.log"
May 21 15:51:35.105820 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:35.105782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-80.ec2.internal_2b99ea0cca3367eddd43b660554c798c/haproxy/0.log"
May 21 15:51:39.464832 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:39.464796    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fc5c8b8f6-nx8r4_681818b1-fb14-404a-88b2-86e5dafc53dc/authorino/0.log"
May 21 15:51:39.797931 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:39.797876    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qq5dc_f8d177df-8bf0-4b5e-b110-9b9cfab10552/manager/0.log"
May 21 15:51:41.344770 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.344741    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-lpvzq_74e36400-e696-4725-845f-21b2237d3286/cluster-monitoring-operator/0.log"
May 21 15:51:41.371246 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.371217    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-f9tfx_33847839-0d7f-415b-b1e6-1eb795292430/kube-state-metrics/0.log"
May 21 15:51:41.388323 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.388271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-f9tfx_33847839-0d7f-415b-b1e6-1eb795292430/kube-rbac-proxy-main/0.log"
May 21 15:51:41.408838 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.408804    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-f9tfx_33847839-0d7f-415b-b1e6-1eb795292430/kube-rbac-proxy-self/0.log"
May 21 15:51:41.438360 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.438305    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f8cf7b444-qz4xk_d216cc3f-47ea-4e36-a52b-25ada4fbed04/metrics-server/0.log"
May 21 15:51:41.492567 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.492538    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-24lgb_5a84bad7-0fca-43df-8465-b0fa866d109c/node-exporter/0.log"
May 21 15:51:41.512147 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.512128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-24lgb_5a84bad7-0fca-43df-8465-b0fa866d109c/kube-rbac-proxy/0.log"
May 21 15:51:41.534779 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.534764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-24lgb_5a84bad7-0fca-43df-8465-b0fa866d109c/init-textfile/0.log"
May 21 15:51:41.723678 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.723598    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ccl6m_f7aaaa7c-3dc2-419c-8340-fea861bdea26/kube-rbac-proxy-main/0.log"
May 21 15:51:41.761696 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.761661    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ccl6m_f7aaaa7c-3dc2-419c-8340-fea861bdea26/kube-rbac-proxy-self/0.log"
May 21 15:51:41.808606 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.808581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ccl6m_f7aaaa7c-3dc2-419c-8340-fea861bdea26/openshift-state-metrics/0.log"
May 21 15:51:41.852972 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.852943    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6184558d-2291-4a11-9d1b-48d2c3537f96/prometheus/0.log"
May 21 15:51:41.886860 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.886839    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6184558d-2291-4a11-9d1b-48d2c3537f96/config-reloader/0.log"
May 21 15:51:41.909089 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.909052    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6184558d-2291-4a11-9d1b-48d2c3537f96/thanos-sidecar/0.log"
May 21 15:51:41.929085 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.929063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6184558d-2291-4a11-9d1b-48d2c3537f96/kube-rbac-proxy-web/0.log"
May 21 15:51:41.953446 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.953410    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6184558d-2291-4a11-9d1b-48d2c3537f96/kube-rbac-proxy/0.log"
May 21 15:51:41.973163 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.973145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6184558d-2291-4a11-9d1b-48d2c3537f96/kube-rbac-proxy-thanos/0.log"
May 21 15:51:41.993281 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:41.993228    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6184558d-2291-4a11-9d1b-48d2c3537f96/init-config-reloader/0.log"
May 21 15:51:42.168162 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:42.168131    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79968bc455-lvvpg_4087cde5-9ae5-4358-a41d-5bc18f401312/thanos-query/0.log"
May 21 15:51:42.188659 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:42.188622    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79968bc455-lvvpg_4087cde5-9ae5-4358-a41d-5bc18f401312/kube-rbac-proxy-web/0.log"
May 21 15:51:42.208070 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:42.208050    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79968bc455-lvvpg_4087cde5-9ae5-4358-a41d-5bc18f401312/kube-rbac-proxy/0.log"
May 21 15:51:42.229173 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:42.229148    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79968bc455-lvvpg_4087cde5-9ae5-4358-a41d-5bc18f401312/prom-label-proxy/0.log"
May 21 15:51:42.248003 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:42.247938    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79968bc455-lvvpg_4087cde5-9ae5-4358-a41d-5bc18f401312/kube-rbac-proxy-rules/0.log"
May 21 15:51:42.269263 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:42.269243    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79968bc455-lvvpg_4087cde5-9ae5-4358-a41d-5bc18f401312/kube-rbac-proxy-metrics/0.log"
May 21 15:51:43.258871 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.258831    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"]
May 21 15:51:43.259370 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.259350    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b296eb1-5181-4649-b4b0-98171bab5d8f" containerName="authorino"
May 21 15:51:43.259484 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.259375    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b296eb1-5181-4649-b4b0-98171bab5d8f" containerName="authorino"
May 21 15:51:43.259548 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.259489    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b296eb1-5181-4649-b4b0-98171bab5d8f" containerName="authorino"
May 21 15:51:43.262869 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.262847    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.265598 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.265570    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x8bl7\"/\"default-dockercfg-8fvt8\""
May 21 15:51:43.265711 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.265606    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8bl7\"/\"openshift-service-ca.crt\""
May 21 15:51:43.266555 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.266536    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8bl7\"/\"kube-root-ca.crt\""
May 21 15:51:43.270307 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.270289    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"]
May 21 15:51:43.364512 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.364479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmmg4\" (UniqueName: \"kubernetes.io/projected/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-kube-api-access-qmmg4\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.364512 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.364516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-sys\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.364761 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.364568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-lib-modules\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.364761 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.364594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-proc\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.364761 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.364630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-podres\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.465778 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.465743    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmmg4\" (UniqueName: \"kubernetes.io/projected/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-kube-api-access-qmmg4\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.465778 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.465779    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-sys\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.465995 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.465819    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-lib-modules\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.465995 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.465842    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-proc\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.465995 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.465880    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-podres\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.465995 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.465912    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-sys\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.466315 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.466289    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-lib-modules\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.466442 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.465968    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-proc\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.466530 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.466009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-podres\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.477391 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.477358    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmmg4\" (UniqueName: \"kubernetes.io/projected/3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d-kube-api-access-qmmg4\") pod \"perf-node-gather-daemonset-rcllh\" (UID: \"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.573461 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.573354    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:43.707574 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.707551    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"]
May 21 15:51:43.710120 ip-10-0-134-80 kubenswrapper[2563]: W0521 15:51:43.710091    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3bc0dacf_bfaa_49f4_aca5_0d47a2435d5d.slice/crio-bee264c5685a4163328891e3a42833fa11bca076e572f97a20ee524f8e44180a WatchSource:0}: Error finding container bee264c5685a4163328891e3a42833fa11bca076e572f97a20ee524f8e44180a: Status 404 returned error can't find the container with id bee264c5685a4163328891e3a42833fa11bca076e572f97a20ee524f8e44180a
May 21 15:51:43.711770 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.711751    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:51:43.860822 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.860794    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/1.log"
May 21 15:51:43.870073 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:43.870043    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-46p5l_b45993a1-6d5e-461b-818d-8c920f6fee99/console-operator/2.log"
May 21 15:51:44.302357 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:44.302319    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh" event={"ID":"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d","Type":"ContainerStarted","Data":"841d1c049d575737014d9ff73374c1f9fb14255bdd36e68eec473350d75af1bd"}
May 21 15:51:44.302357 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:44.302358    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh" event={"ID":"3bc0dacf-bfaa-49f4-aca5-0d47a2435d5d","Type":"ContainerStarted","Data":"bee264c5685a4163328891e3a42833fa11bca076e572f97a20ee524f8e44180a"}
May 21 15:51:44.302807 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:44.302416    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:44.319080 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:44.319035    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh" podStartSLOduration=1.319021622 podStartE2EDuration="1.319021622s" podCreationTimestamp="2026-05-21 15:51:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:51:44.316841205 +0000 UTC m=+2306.390157351" watchObservedRunningTime="2026-05-21 15:51:44.319021622 +0000 UTC m=+2306.392337790"
May 21 15:51:44.814925 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:44.814884    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-bl95v_db300487-56e5-4123-b42d-6138de72db25/volume-data-source-validator/0.log"
May 21 15:51:45.613588 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:45.613555    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h68r8_85536ca0-0e61-473b-99ff-847a9463e9e1/dns/0.log"
May 21 15:51:45.634231 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:45.634200    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h68r8_85536ca0-0e61-473b-99ff-847a9463e9e1/kube-rbac-proxy/0.log"
May 21 15:51:45.743208 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:45.743185    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vmq8h_aa1679b9-82e5-444a-a890-1cda5c1baa85/dns-node-resolver/0.log"
May 21 15:51:46.183897 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:46.183865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68nzt_57ac6b42-6423-40b8-8609-1ba404d0b21a/node-ca/0.log"
May 21 15:51:47.128629 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:47.128599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd665b65-6wqsh_3e5385b9-7950-491c-81f0-da3ba96835f3/kube-auth-proxy/0.log"
May 21 15:51:47.875776 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:47.875746    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g2bwf_e212c79f-794d-4d09-a85e-ccd3320d58d6/serve-healthcheck-canary/0.log"
May 21 15:51:48.340689 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:48.340649    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwq4m_e89dbd7d-1825-493a-8760-d485dd3ad879/kube-rbac-proxy/0.log"
May 21 15:51:48.360330 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:48.360308    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwq4m_e89dbd7d-1825-493a-8760-d485dd3ad879/exporter/0.log"
May 21 15:51:48.381622 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:48.381600    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwq4m_e89dbd7d-1825-493a-8760-d485dd3ad879/extractor/0.log"
May 21 15:51:50.316256 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:50.316229    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-rcllh"
May 21 15:51:50.586975 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:50.586896    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-594496b99d-zhc8v_6c0658e9-ce3b-4c99-a97a-70be3c10a0a7/manager/0.log"
May 21 15:51:51.802056 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:51.802026    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69ff6d856c-rd2zn_ccb568ca-b95f-4ed5-951a-f1894272a045/manager/0.log"
May 21 15:51:56.104806 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:56.104721    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-g2cxq_8a40ba7e-c689-46bb-9d26-16584531c815/migrator/0.log"
May 21 15:51:56.137717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:56.137695    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-g2cxq_8a40ba7e-c689-46bb-9d26-16584531c815/graceful-termination/0.log"
May 21 15:51:57.551874 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.551844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8ft87_8b3144a4-b437-4f9b-a5d6-1528c0b8d015/kube-multus/0.log"
May 21 15:51:57.870097 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.870034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smww2_1be1db88-9f20-4176-ab17-93c1063bebe4/kube-multus-additional-cni-plugins/0.log"
May 21 15:51:57.890117 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.890087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smww2_1be1db88-9f20-4176-ab17-93c1063bebe4/egress-router-binary-copy/0.log"
May 21 15:51:57.909002 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.908979    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smww2_1be1db88-9f20-4176-ab17-93c1063bebe4/cni-plugins/0.log"
May 21 15:51:57.932100 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.932073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smww2_1be1db88-9f20-4176-ab17-93c1063bebe4/bond-cni-plugin/0.log"
May 21 15:51:57.951078 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.951052    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smww2_1be1db88-9f20-4176-ab17-93c1063bebe4/routeoverride-cni/0.log"
May 21 15:51:57.970717 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.970696    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smww2_1be1db88-9f20-4176-ab17-93c1063bebe4/whereabouts-cni-bincopy/0.log"
May 21 15:51:57.988571 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:57.988554    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-smww2_1be1db88-9f20-4176-ab17-93c1063bebe4/whereabouts-cni/0.log"
May 21 15:51:58.127294 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:58.127208    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xf7bw_558c0f01-4351-454c-9ca8-0e6cf4bc0887/network-metrics-daemon/0.log"
May 21 15:51:58.143064 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:58.143035    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xf7bw_558c0f01-4351-454c-9ca8-0e6cf4bc0887/kube-rbac-proxy/0.log"
May 21 15:51:58.911505 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:58.911474    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-controller/0.log"
May 21 15:51:58.926543 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:58.926496    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/0.log"
May 21 15:51:58.946103 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:58.946071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovn-acl-logging/1.log"
May 21 15:51:58.969341 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:58.969322    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/kube-rbac-proxy-node/0.log"
May 21 15:51:58.989559 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:58.989533    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/kube-rbac-proxy-ovn-metrics/0.log"
May 21 15:51:59.004318 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:59.004302    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/northd/0.log"
May 21 15:51:59.028501 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:59.028462    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/nbdb/0.log"
May 21 15:51:59.043708 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:59.043671    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/sbdb/0.log"
May 21 15:51:59.217615 ip-10-0-134-80 kubenswrapper[2563]: I0521 15:51:59.217530    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4w244_7bde814a-deda-4f36-9792-fdd6247c89c5/ovnkube-controller/0.log"