Jun 06 05:08:37.014780 ip-10-0-142-193 systemd[1]: Starting Kubernetes Kubelet...
Jun 06 05:08:37.431652 ip-10-0-142-193 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 05:08:37.431652 ip-10-0-142-193 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 06 05:08:37.431652 ip-10-0-142-193 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 05:08:37.431652 ip-10-0-142-193 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 06 05:08:37.431652 ip-10-0-142-193 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 05:08:37.432351 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.431716    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 06 05:08:37.436526 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436510    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:37.436526 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436525    2582 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436530    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436533    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436538    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436542    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436545    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436549    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436552    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436556    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436559    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436561    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436564    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436567    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436569    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436572    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436574    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436579    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436582    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436585    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436588    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:37.436593 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436590    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436593    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436596    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436599    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436602    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436605    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436607    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436610    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436613    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436615    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436619    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436621    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436624    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436626    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436629    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436631    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436633    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436636    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436640    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:37.437076 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436643    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436646    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436649    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436651    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436654    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436657    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436660    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436663    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436666    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436668    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436671    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436674    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436676    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436679    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436681    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436684    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436687    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436691    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436693    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436696    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:37.437548 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436698    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436701    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436704    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436706    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436709    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436712    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436715    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436717    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436720    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436724    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436726    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436729    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436731    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436734    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436736    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436739    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436742    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436744    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436747    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436749    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:37.438067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436752    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436754    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436757    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436759    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436762    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436765    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436767    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436771    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436774    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436777    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436779    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436782    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436785    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436787    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436790    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436792    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436795    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436797    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.436800    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:37.438565 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437550    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437557    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437561    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437564    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437567    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437570    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437573    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437578    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437582    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437585    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437588    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437598    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437602    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437605    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437608    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437610    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437613    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437616    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437618    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437621    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:37.439027 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437625    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437628    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437631    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437634    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437636    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437639    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437641    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437644    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437646    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437649    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437652    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437655    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437658    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437661    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437664    2582 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437666    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437669    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437671    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437674    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:37.439573 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437676    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437679    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437682    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437684    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437686    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437689    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437691    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437694    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437696    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437699    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437702    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437704    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437707    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437710    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437713    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437716    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437719    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437722    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437724    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437727    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:37.440067 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437729    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437732    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437734    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437737    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437739    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437745    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437747    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437750    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437752    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437755    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437758    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437760    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437763    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437766    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437769    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437773    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437777    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437779    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437782    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437785    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:37.440579 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437787    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437790    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437792    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437795    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437797    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437800    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437803    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437806    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437808    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437811    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437814    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437816    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437818    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437821    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437824    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437827    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437829    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437833    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437838    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.437841    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:37.441066 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438209    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438213    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438216    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438219    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438221    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438224    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438227    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438229    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438232    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438234    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438237    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438240    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438242    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438245    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438248    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438250    2582 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438253    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438258    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438262    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438279    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:37.441576 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438283    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438286    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438289    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438291    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438294    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438296    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438299    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438302    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438304    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438307    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438310    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438313    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438315    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438318    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438320    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438323    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438325    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438328    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438330    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438333    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:37.442075 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438336    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438339    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438341    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438344    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438346    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438349    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438351    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438354    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438357    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438364    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438368    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438370    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438373    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438376    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438379    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438383    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438385    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438388    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438390    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:37.442618 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438393    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438395    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438398    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438400    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438404    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438406    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438409    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438411    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438414    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438416    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438419    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438421    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438423    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438426    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438428    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438431    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438433    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438436    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438438    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438441    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:37.443090 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438444    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438447    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438452    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438454    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438457    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438461    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438464    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438467    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438470    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438472    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438475    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438477    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438480    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438482    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438485    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438487    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438490    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438493    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438496    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.438498    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:37.443630 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438574    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438580    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438586    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438591    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438594    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438598    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438602    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438607    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438610    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438613    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438617    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438620    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438623    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438626    2582 flags.go:64] FLAG: --cgroup-root=""
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438631    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438634    2582 flags.go:64] FLAG: --client-ca-file=""
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438637    2582 flags.go:64] FLAG: --cloud-provider="external"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438640    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438644    2582 flags.go:64] FLAG: --cluster-domain=""
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438647    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438650    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438653    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438656    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438660    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 06 05:08:37.444117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438663    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438667    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438670    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438674    2582 flags.go:64] FLAG: --contention-profiling="false"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438677    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438679    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438683    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438686    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438690    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438693    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438696    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438699    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438702    2582 flags.go:64] FLAG: --enable-server="true"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438705    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438708    2582 flags.go:64] FLAG: --event-burst="100"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438711    2582 flags.go:64] FLAG: --event-qps="50"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438714    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438717    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438720    2582 flags.go:64] FLAG: --eviction-hard=""
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438724    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438727    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438730    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438736    2582 flags.go:64] FLAG: --eviction-soft=""
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438739    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438742    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 06 05:08:37.444762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438745    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438749    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438752    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438755    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438758    2582 flags.go:64] FLAG: --feature-gates=""
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438764    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438767    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438770    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438773    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438776    2582 flags.go:64] FLAG: --healthz-port="10248"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438779    2582 flags.go:64] FLAG: --help="false"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438782    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438785    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438788    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438791    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438795    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438799    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438801    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438804    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438807    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438810    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438813    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438816    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438819    2582 flags.go:64] FLAG: --kube-reserved=""
Jun 06 05:08:37.445546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438821    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438824    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438827    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438830    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438832    2582 flags.go:64] FLAG: --lock-file=""
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438838    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438841    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438844    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438850    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438853    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438856    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438859    2582 flags.go:64] FLAG: --logging-format="text"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438862    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438865    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438868    2582 flags.go:64] FLAG: --manifest-url=""
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438870    2582 flags.go:64] FLAG: --manifest-url-header=""
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438875    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438878    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438882    2582 flags.go:64] FLAG: --max-pods="110"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438885    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438888    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438890    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438893    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438899    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438903    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 06 05:08:37.446243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438906    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438912    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438915    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438918    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438922    2582 flags.go:64] FLAG: --pod-cidr=""
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438925    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438930    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438933    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438936    2582 flags.go:64] FLAG: --pods-per-core="0"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438939    2582 flags.go:64] FLAG: --port="10250"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438943    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438946    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01947e21736e7ff4a"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438953    2582 flags.go:64] FLAG: --qos-reserved=""
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438957    2582 flags.go:64] FLAG: --read-only-port="10255"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438960    2582 flags.go:64] FLAG: --register-node="true"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438963    2582 flags.go:64] FLAG: --register-with-taints=""
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438967    2582 flags.go:64] FLAG: --registry-burst="10"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438970    2582 flags.go:64] FLAG: --registry-qps="5"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438973    2582 flags.go:64] FLAG: --reserved-cpus=""
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438976    2582 flags.go:64] FLAG: --reserved-memory=""
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438979    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438982    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438985    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438988    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438991    2582 flags.go:64] FLAG: --runonce="false"
Jun 06 05:08:37.446957 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438994    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.438997    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439000    2582 flags.go:64] FLAG: --seccomp-default="false"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439002    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439005    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439008    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439012    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439015    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439018    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439021    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439024    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439026    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439029    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439032    2582 flags.go:64] FLAG: --system-cgroups=""
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439035    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439041    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439043    2582 flags.go:64] FLAG: --tls-cert-file=""
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439046    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439050    2582 flags.go:64] FLAG: --tls-min-version=""
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439054    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439057    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439060    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439063    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439066    2582 flags.go:64] FLAG: --v="2"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439070    2582 flags.go:64] FLAG: --version="false"
Jun 06 05:08:37.447734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439074    2582 flags.go:64] FLAG: --vmodule=""
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439078    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.439081    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439209    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439214    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439217    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439220    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439223    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439226    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439229    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439231    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439234    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439237    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439240    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439243    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439246    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439248    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439251    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439253    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439256    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:37.448749 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439259    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439261    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439264    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439279    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439282    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439285    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439289    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439292    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439295    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439298    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439301    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439304    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439307    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439309    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439312    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439314    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439317    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439319    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439322    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439324    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:37.449525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439327    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439330    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439332    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439335    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439338    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439340    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439343    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439346    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439349    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439351    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439354    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439356    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439359    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439362    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439364    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439367    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439369    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439372    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439376    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439378    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:37.450040 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439381    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439384    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439387    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439389    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439392    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439395    2582 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439397    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439400    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439402    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439405    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439407    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439410    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439412    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439415    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439417    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439421    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439425    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439428    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439431    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:37.450568 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439434    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439437    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439441    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439444    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439447    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439451    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439454    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439456    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439459    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439461    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439463    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439467    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439470    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439473    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439475    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439478    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439480    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439483    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439485    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:37.451043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439488    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439491    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439493    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.439496    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.440021    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.446819    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.446835    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.447524    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.447534    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448133    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448297    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448312    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448320    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448326    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448331    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:37.451546 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448335    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448340    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448346    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448350    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448355    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448361    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448371    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448376    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448380    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448415    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448422    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448428    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448433    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448437    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448442    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448446    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448452    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448456    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448465    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:37.451938 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448470    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448474    2582 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448478    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448482    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448486    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448490    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448494    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448498    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448503    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448537    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448542    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448546    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448555    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448559    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448563    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448567    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448572    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448576    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448580    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448585    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:37.452467 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448589    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448593    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448597    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448601    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448610    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448614    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448619    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448623    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448627    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448631    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448636    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448640    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448644    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448649    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448653    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448660    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448666    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448676    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448681    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448686    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:37.452972 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448690    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448695    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448724    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448729    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448734    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448739    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448744    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448748    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448753    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448775    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448901    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448909    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448915    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448918    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448921    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448925    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448928    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448931    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448934    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448937    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:37.453472 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448940    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448943    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.448959    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449000    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449138    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449144    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449149    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449153    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449158    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449162    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449166    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449169    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449172    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449175    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:37.454007 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.449181    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449381    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449388    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449391    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449395    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449398    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449403    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449406    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449409    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449414    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449417    2582 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449420    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449423    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449425    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449428    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449430    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449434    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449436    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449439    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449442    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:37.454479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449445    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449447    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449450    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449453    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449455    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449458    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449461    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449464    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449466    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449469    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449471    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449474    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449477    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449479    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449482    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449485    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449488    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449491    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449493    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449496    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:37.454973 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449499    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449502    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449505    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449507    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449510    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449512    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449515    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449517    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449520    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449522    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449525    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449527    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449530    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449533    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449535    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449539    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449543    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449546    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449549    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:37.455483 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449552    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449555    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449557    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449560    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449562    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449565    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449567    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449570    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449573    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449576    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449582    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449585    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449588    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449599    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449602    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449604    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449607    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449610    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449613    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:37.455950 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449615    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449619    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449624    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449626    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449629    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449632    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449635    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449638    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449641    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449643    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449646    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449648    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449651    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449653    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449656    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449659    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449661    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449664    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449666    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:37.456432 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449669    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449672    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:37.449674    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.449680    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.449815    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.451887    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.454421    2582 server.go:1019] "Starting client certificate rotation"
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.454524    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.454553    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 06 05:08:37.456934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.456651    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 06 05:08:37.458212 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.458193    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 06 05:08:37.467946 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.467924    2582 log.go:25] "Validated CRI v1 runtime API"
Jun 06 05:08:37.470405 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.470391    2582 log.go:25] "Validated CRI v1 image API"
Jun 06 05:08:37.472725 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.472709    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 06 05:08:37.477469 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.477448    2582 fs.go:135] Filesystem UUIDs: map[31c7726f-c787-4008-98cc-f16d2f44ee34:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 88ab6d33-841c-4958-a4ac-8c14b53ffd10:/dev/nvme0n1p3]
Jun 06 05:08:37.477559 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.477467    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 06 05:08:37.482647 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.482527    2582 manager.go:216] Machine: {Timestamp:2026-06-06 05:08:37.481982107 +0000 UTC m=+0.341044275 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100245 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d97bde079e1e0f42f68d504b8668 SystemUUID:ec20d97b-de07-9e1e-0f42-f68d504b8668 BootID:c8c5169d-dc94-49a4-96ec-9d65126179ad Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:a0:46:43:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:a0:46:43:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:59:f4:b5:33:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 06 05:08:37.482647 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.482638    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 06 05:08:37.482768 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.482720    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 06 05:08:37.485572 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.485542    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 06 05:08:37.485755 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.485583    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-193.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 06 05:08:37.486176 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.486166    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jun 06 05:08:37.486213 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.486178    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jun 06 05:08:37.486213 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.486187    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 06 05:08:37.487407 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.487395    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 06 05:08:37.488084 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.488070    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 06 05:08:37.488199 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.488182    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 06 05:08:37.490513 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.490501    2582 state_mem.go:36] "Initialized new in-memory state store"
Jun 06 05:08:37.490647 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.490637    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 06 05:08:37.490689 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.490682    2582 kubelet.go:486] "Attempting to sync node with API server"
Jun 06 05:08:37.490723 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.490700    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 06 05:08:37.490723 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.490718    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 06 05:08:37.490803 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.490728    2582 kubelet.go:398] "Adding apiserver pod source"
Jun 06 05:08:37.490803 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.490737    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 06 05:08:37.491192 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.491178    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 06 05:08:37.491237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.491205    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 06 05:08:37.494500 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.494478    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 06 05:08:37.495738 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.495721    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 06 05:08:37.495806 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.495754    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 06 05:08:37.497796 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497783    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 06 05:08:37.497841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497802    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 06 05:08:37.497841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497808    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 06 05:08:37.497841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497814    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 06 05:08:37.497841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497823    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 06 05:08:37.497841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497828    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 06 05:08:37.497841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497836    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 06 05:08:37.497841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497841    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 06 05:08:37.498020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497848    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 06 05:08:37.498020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497854    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 06 05:08:37.498020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497862    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 06 05:08:37.498020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.497867    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 06 05:08:37.498998 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.498988    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 06 05:08:37.498998 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.498999    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 06 05:08:37.500823 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.500799    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 06 05:08:37.500864 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.500799    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-193.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 06 05:08:37.501060 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.501046    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-193.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 06 05:08:37.502473 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.502459    2582 server.go:1268] "Started kubelet"
Jun 06 05:08:37.502548 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.502524    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 06 05:08:37.503040 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.502966    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 06 05:08:37.503129 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.503042    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 06 05:08:37.503409 ip-10-0-142-193 systemd[1]: Started Kubernetes Kubelet.
Jun 06 05:08:37.504541 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.504527    2582 server.go:310] "Adding debug handlers to kubelet server"
Jun 06 05:08:37.504646 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.504631    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 06 05:08:37.507837 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.507817    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 06 05:08:37.510080 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.510065    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 06 05:08:37.510157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.510133    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 06 05:08:37.510219 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.510154    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:37.511041 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.510997    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 06 05:08:37.511041 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511015    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 06 05:08:37.511041 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.510997    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 06 05:08:37.511233 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511062    2582 factory.go:55] Registering systemd factory
Jun 06 05:08:37.511233 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511095    2582 factory.go:223] Registration of the systemd container factory successfully
Jun 06 05:08:37.511233 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511195    2582 reconstruct.go:97] "Volume reconstruction finished"
Jun 06 05:08:37.511233 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511204    2582 reconciler.go:29] "Reconciler: start to sync state"
Jun 06 05:08:37.511435 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511350    2582 factory.go:153] Registering CRI-O factory
Jun 06 05:08:37.511435 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511364    2582 factory.go:223] Registration of the crio container factory successfully
Jun 06 05:08:37.511435 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511416    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 06 05:08:37.511575 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511439    2582 factory.go:103] Registering Raw factory
Jun 06 05:08:37.511575 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.511465    2582 manager.go:1196] Started watching for new ooms in manager
Jun 06 05:08:37.512053 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.512042    2582 manager.go:349] Starting recovery of all containers
Jun 06 05:08:37.515100 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.515070    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 06 05:08:37.515348 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.515319    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-193.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 06 05:08:37.515911 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.515133    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-193.ec2.internal.18b665b1eb458325  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-193.ec2.internal,UID:ip-10-0-142-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-193.ec2.internal,},FirstTimestamp:2026-06-06 05:08:37.502427941 +0000 UTC m=+0.361490110,LastTimestamp:2026-06-06 05:08:37.502427941 +0000 UTC m=+0.361490110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-193.ec2.internal,}"
Jun 06 05:08:37.525725 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.525709    2582 manager.go:354] Recovery completed
Jun 06 05:08:37.527650 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.527625    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fwdmp"
Jun 06 05:08:37.529463 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.529452    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:37.531655 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.531636    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:37.531720 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.531667    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:37.531720 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.531678    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:37.532251 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.532235    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 06 05:08:37.532251 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.532251    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 06 05:08:37.532377 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.532285    2582 state_mem.go:36] "Initialized new in-memory state store"
Jun 06 05:08:37.532377 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.532243    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:37.533035 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.533021    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:37.533083 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.533048    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:37.533083 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.533057    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:37.533245 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.533234    2582 policy_none.go:49] "None policy: Start"
Jun 06 05:08:37.533292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.533248    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 06 05:08:37.533292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.533258    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 06 05:08:37.533811 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.533730    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-193.ec2.internal.18b665b1ed0377b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-193.ec2.internal,UID:ip-10-0-142-193.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-193.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-193.ec2.internal,},FirstTimestamp:2026-06-06 05:08:37.531654068 +0000 UTC m=+0.390716238,LastTimestamp:2026-06-06 05:08:37.531654068 +0000 UTC m=+0.390716238,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-193.ec2.internal,}"
Jun 06 05:08:37.534018 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.534006    2582 policy_none.go:47] "Start"
Jun 06 05:08:37.534745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.534730    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fwdmp"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.576893    2582 manager.go:337] "Starting Device Plugin manager"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.576941    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.576954    2582 server.go:87] "Starting device plugin registration server"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.577192    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.577203    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.577347    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.577428    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.577437    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.578103    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 06 05:08:37.587357 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.578162    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:37.589168 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.589146    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 06 05:08:37.590308 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.590290    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 06 05:08:37.590409 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.590324    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 06 05:08:37.590409 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.590344    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 06 05:08:37.590511 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.590410    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 06 05:08:37.592096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.592078    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:37.677509 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.677468    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:37.678485 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.678470    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:37.678555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.678500    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:37.678555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.678512    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:37.678555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.678534    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.686969 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.686928    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.686969 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.686950    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-193.ec2.internal\": node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:37.690606 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.690584    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal"]
Jun 06 05:08:37.690710 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.690646    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:37.691998 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.691985    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:37.692056 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.692012    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:37.692056 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.692027    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:37.692987 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.692976    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:37.693113 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.693096    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.693200 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.693144    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:37.694282 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.694251    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:37.694384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.694262    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:37.694384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.694317    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:37.694384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.694331    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:37.694384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.694294    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:37.694566 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.694384    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:37.695508 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.695489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.695595 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.695522    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:37.696197 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.696179    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:37.696290 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.696210    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:37.696290 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.696221    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:37.710974 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.710956    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:37.718812 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.718789    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-193.ec2.internal\" not found" node="ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.722769 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.722752    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-193.ec2.internal\" not found" node="ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.811188 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.811143    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:37.812298 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.812279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/060bae564ec193646c7c0fa2a1f6170e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-193.ec2.internal\" (UID: \"060bae564ec193646c7c0fa2a1f6170e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.812348 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.812308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7738dc3de06fcdc6cd27b58af1712c02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal\" (UID: \"7738dc3de06fcdc6cd27b58af1712c02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.812348 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.812328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7738dc3de06fcdc6cd27b58af1712c02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal\" (UID: \"7738dc3de06fcdc6cd27b58af1712c02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.911460 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:37.911427    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:37.912571 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.912539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/060bae564ec193646c7c0fa2a1f6170e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-193.ec2.internal\" (UID: \"060bae564ec193646c7c0fa2a1f6170e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.912612 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.912582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7738dc3de06fcdc6cd27b58af1712c02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal\" (UID: \"7738dc3de06fcdc6cd27b58af1712c02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.912612 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.912601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7738dc3de06fcdc6cd27b58af1712c02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal\" (UID: \"7738dc3de06fcdc6cd27b58af1712c02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.912673 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.912640    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/060bae564ec193646c7c0fa2a1f6170e-config\") pod \"kube-apiserver-proxy-ip-10-0-142-193.ec2.internal\" (UID: \"060bae564ec193646c7c0fa2a1f6170e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.912673 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.912643    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7738dc3de06fcdc6cd27b58af1712c02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal\" (UID: \"7738dc3de06fcdc6cd27b58af1712c02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:37.912735 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:37.912632    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7738dc3de06fcdc6cd27b58af1712c02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal\" (UID: \"7738dc3de06fcdc6cd27b58af1712c02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:38.012134 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.012060    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.022360 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.022331    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:38.026229 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.026214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:38.112830 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.112792    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.213243 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.213210    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.313687 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.313593    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.414129 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.414084    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.452461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.452257    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 06 05:08:38.453093 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.452585    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 06 05:08:38.476370 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.476346    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:38.514235 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.514213    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.537544 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.537471    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 05:03:37 +0000 UTC" deadline="2028-02-17 08:12:30.184047996 +0000 UTC"
Jun 06 05:08:38.537544 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.537539    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14907h3m51.646511703s"
Jun 06 05:08:38.614973 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.614936    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.655527 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:38.655487    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7738dc3de06fcdc6cd27b58af1712c02.slice/crio-f009f5bd4971107f449eab2a8a050c92152191f853e5caa357c4a21a82b344a4 WatchSource:0}: Error finding container f009f5bd4971107f449eab2a8a050c92152191f853e5caa357c4a21a82b344a4: Status 404 returned error can't find the container with id f009f5bd4971107f449eab2a8a050c92152191f853e5caa357c4a21a82b344a4
Jun 06 05:08:38.655865 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:38.655843    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060bae564ec193646c7c0fa2a1f6170e.slice/crio-6ad3e257f72b122d6f9e60730aefd085afa27948efa9e08113c1e90dfffdb26c WatchSource:0}: Error finding container 6ad3e257f72b122d6f9e60730aefd085afa27948efa9e08113c1e90dfffdb26c: Status 404 returned error can't find the container with id 6ad3e257f72b122d6f9e60730aefd085afa27948efa9e08113c1e90dfffdb26c
Jun 06 05:08:38.660146 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.660129    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:08:38.715361 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.715318    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.815856 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.815823    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.916305 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:38.916214    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-193.ec2.internal\" not found"
Jun 06 05:08:38.989379 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:38.989351    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:39.010598 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.010570    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:39.022409 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.022382    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 06 05:08:39.024016 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.023983    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal"
Jun 06 05:08:39.031856 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.031828    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 06 05:08:39.107611 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.107575    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:39.492379 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.492341    2582 apiserver.go:52] "Watching apiserver"
Jun 06 05:08:39.500699 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.500668    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 06 05:08:39.503068 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.503037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-7k9lr","openshift-multus/network-metrics-daemon-wv65h","openshift-network-diagnostics/network-check-target-6fwqv","openshift-network-operator/iptables-alerter-bkb85","kube-system/global-pull-secret-syncer-4h6kg","kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal","openshift-cluster-node-tuning-operator/tuned-n447v","openshift-dns/node-resolver-7dhtw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal","openshift-multus/multus-additional-cni-plugins-z67zh","openshift-multus/multus-qgmhn","openshift-ovn-kubernetes/ovnkube-node-p4xl4","kube-system/konnectivity-agent-nz87r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"]
Jun 06 05:08:39.505597 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.505571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.507480 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.507438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:39.507586 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.507527    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:39.508705 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.508418    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 06 05:08:39.508705 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.508595    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pr97g\""
Jun 06 05:08:39.508705 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.508648    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 06 05:08:39.508895 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.508711    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 06 05:08:39.508895 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.508824    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 06 05:08:39.508984 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.508904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 06 05:08:39.509644 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.509346    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:39.509644 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.509425    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:39.510959 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.510723    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 06 05:08:39.511552 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.511354    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.513457 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.513345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.514104 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.513831    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 06 05:08:39.514104 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.513832    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 06 05:08:39.514104 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.513903    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 06 05:08:39.515114 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.514955    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m94zn\""
Jun 06 05:08:39.516112 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.516094    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h4ln8\""
Jun 06 05:08:39.516224 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.516112    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.516735 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.516711    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 06 05:08:39.516735 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.516729    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 06 05:08:39.518337 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.518019    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.519494 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.519589 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh84b\" (UniqueName: \"kubernetes.io/projected/d28ddda6-b11e-4174-8d80-f7dec7acbc41-kube-api-access-wh84b\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.519589 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519555    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 06 05:08:39.519589 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-245w5\" (UniqueName: \"kubernetes.io/projected/89665e91-1799-4a69-b55a-54c498846550-kube-api-access-245w5\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:39.519746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-sys-fs\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.519746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-system-cni-dir\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.519746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cnibin\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.519746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:39.519746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-socket-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.519746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519747    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85238ec9-ad65-4dcb-a789-d83c9861f21b-hosts-file\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kd97\" (UniqueName: \"kubernetes.io/projected/85238ec9-ad65-4dcb-a789-d83c9861f21b-kube-api-access-7kd97\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519947    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-registration-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-device-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.519994    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.520011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mfzc\" (UniqueName: \"kubernetes.io/projected/3bdf9f5e-4f2f-4be8-93df-214257019dbc-kube-api-access-8mfzc\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.520047 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.520046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85238ec9-ad65-4dcb-a789-d83c9861f21b-tmp-dir\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.520680 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.520078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-os-release\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.520680 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.520120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cni-binary-copy\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.520680 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.520263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.520850 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.520834    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 06 05:08:39.520901 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.520888    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 06 05:08:39.521065 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.521046    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 06 05:08:39.521065 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.521062    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 06 05:08:39.521317 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.521298    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 06 05:08:39.521422 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.521344    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 06 05:08:39.521536 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.521504    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rg49\""
Jun 06 05:08:39.521595 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.521585    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9l66b\""
Jun 06 05:08:39.522409 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.522245    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:08:39.522815 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.522702    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.522815 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.522723    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 06 05:08:39.523237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.523096    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r4n8g\""
Jun 06 05:08:39.523621 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.523379    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 06 05:08:39.527786 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.525918    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 06 05:08:39.527786 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.526198    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 06 05:08:39.527786 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.525695    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-222t4\""
Jun 06 05:08:39.527786 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.526794    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.529191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.529171    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 06 05:08:39.529337 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.529321    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wlht6\""
Jun 06 05:08:39.529439 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.529424    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.529632 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.529605    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:39.531880 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.531833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.535036 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.535018    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hmw4t\""
Jun 06 05:08:39.535182 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.535065    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 06 05:08:39.535855 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.535835    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:08:39.535948 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.535901    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 06 05:08:39.538022 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.538001    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qtg9n"
Jun 06 05:08:39.544925 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.544904    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qtg9n"
Jun 06 05:08:39.594839 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.594773    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal" event={"ID":"7738dc3de06fcdc6cd27b58af1712c02","Type":"ContainerStarted","Data":"f009f5bd4971107f449eab2a8a050c92152191f853e5caa357c4a21a82b344a4"}
Jun 06 05:08:39.596210 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.596182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal" event={"ID":"060bae564ec193646c7c0fa2a1f6170e","Type":"ContainerStarted","Data":"6ad3e257f72b122d6f9e60730aefd085afa27948efa9e08113c1e90dfffdb26c"}
Jun 06 05:08:39.612213 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.612192    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 06 05:08:39.620386 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-os-release\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.620540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cni-binary-copy\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.620540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-sys-fs\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.620540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-modprobe-d\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.620540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f040a8fe-109d-4355-abd6-5d1ee6101544-host\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.620540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-host\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-slash\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-env-overrides\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkg8z\" (UniqueName: \"kubernetes.io/projected/eef09fbb-8000-41fc-aeb1-533d75c4be90-kube-api-access-vkg8z\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620668    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-os-release\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-cni-multus\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.620785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kd97\" (UniqueName: \"kubernetes.io/projected/85238ec9-ad65-4dcb-a789-d83c9861f21b-kube-api-access-7kd97\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.621188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysctl-conf\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.621188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.621188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovn-node-metrics-cert\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.621188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620952    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.621188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-cnibin\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.621188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.620991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-multus-certs\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.621492 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621202    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cni-binary-copy\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.621760 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-sys-fs\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.621871 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-device-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.621871 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-lib-modules\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.621871 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-cni-bin\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.622049 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.622049 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621902    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-device-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.622049 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.621954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f4f23c5-3994-4b56-9502-dc371024ea36-agent-certs\") pod \"konnectivity-agent-nz87r\" (UID: \"5f4f23c5-3994-4b56-9502-dc371024ea36\") " pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.622049 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.622249 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-system-cni-dir\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.622249 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-systemd\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.622249 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-system-cni-dir\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.622249 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovnkube-script-lib\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.622463 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f4f23c5-3994-4b56-9502-dc371024ea36-konnectivity-ca\") pod \"konnectivity-agent-nz87r\" (UID: \"5f4f23c5-3994-4b56-9502-dc371024ea36\") " pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.622463 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-system-cni-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.622463 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-os-release\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.622648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-socket-dir-parent\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.622648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.622648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85238ec9-ad65-4dcb-a789-d83c9861f21b-hosts-file\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.622795 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-systemd\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.622795 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-ovn\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.622795 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622777    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85238ec9-ad65-4dcb-a789-d83c9861f21b-hosts-file\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.622942 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovnkube-config\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.622942 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622784    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.622942 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gssds\" (UniqueName: \"kubernetes.io/projected/f040a8fe-109d-4355-abd6-5d1ee6101544-kube-api-access-gssds\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.622942 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-etc-kubernetes\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.623122 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.622952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ec17605-be56-4a99-baa7-65fd72731055-kubelet-config\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.623122 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:39.623214 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-log-socket\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.623214 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.623159    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:39.623214 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-k8s-cni-cncf-io\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.623374 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.623225    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:40.123204293 +0000 UTC m=+2.982266470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:39.623374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-run\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.623374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-cni-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.623374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b3345ed-3dc7-4347-b6d1-2f0187753f53-cni-binary-copy\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.623374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-hostroot\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ec17605-be56-4a99-baa7-65fd72731055-dbus\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cnibin\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623402    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-kubelet\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-node-log\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623458    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-cnibin\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-cni-netd\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.623675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623608    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-kubernetes\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.624102 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d28ddda6-b11e-4174-8d80-f7dec7acbc41-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.624102 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.623929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-tmp\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.624414 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-run-netns\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.624500 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.624500 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-registration-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.624609 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mfzc\" (UniqueName: \"kubernetes.io/projected/3bdf9f5e-4f2f-4be8-93df-214257019dbc-kube-api-access-8mfzc\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.624609 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85238ec9-ad65-4dcb-a789-d83c9861f21b-tmp-dir\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.624738 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r58kf\" (UniqueName: \"kubernetes.io/projected/9b3345ed-3dc7-4347-b6d1-2f0187753f53-kube-api-access-r58kf\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.624738 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh84b\" (UniqueName: \"kubernetes.io/projected/d28ddda6-b11e-4174-8d80-f7dec7acbc41-kube-api-access-wh84b\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.624738 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-245w5\" (UniqueName: \"kubernetes.io/projected/89665e91-1799-4a69-b55a-54c498846550-kube-api-access-245w5\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:39.624738 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysctl-d\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.624934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5fqw\" (UniqueName: \"kubernetes.io/projected/59bc29f0-1841-4ede-ba06-946ede4ebda8-kube-api-access-n5fqw\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.624934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624807    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-registration-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.624934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-kubelet\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.624934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-daemon-config\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.624934 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-socket-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.625154 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-sys\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.625154 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.624968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59bc29f0-1841-4ede-ba06-946ede4ebda8-iptables-alerter-script\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.625154 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-systemd-units\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.625286 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625170    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-socket-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.625286 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-conf-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.625374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.625374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysconfig\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.625483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625384    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85238ec9-ad65-4dcb-a789-d83c9861f21b-tmp-dir\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.625483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-var-lib-kubelet\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.625483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625427    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bdf9f5e-4f2f-4be8-93df-214257019dbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.625483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bc29f0-1841-4ede-ba06-946ede4ebda8-host-slash\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.625683 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-var-lib-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.625683 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-etc-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.625683 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f040a8fe-109d-4355-abd6-5d1ee6101544-serviceca\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.625683 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-tuned\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.625683 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625641    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9m72\" (UniqueName: \"kubernetes.io/projected/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-kube-api-access-j9m72\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.625895 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-netns\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.625895 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.625751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-cni-bin\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.629002 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.628979    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:08:39.629118 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.629006    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:08:39.629118 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.629021    2582 projected.go:196] Error preparing data for projected volume kube-api-access-78wjl for pod openshift-network-diagnostics/network-check-target-6fwqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:39.629118 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.629084    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl podName:ca54cfb3-d638-4f3d-8d64-6d871bccf05e nodeName:}" failed. No retries permitted until 2026-06-06 05:08:40.129067805 +0000 UTC m=+2.988129977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-78wjl" (UniqueName: "kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl") pod "network-check-target-6fwqv" (UID: "ca54cfb3-d638-4f3d-8d64-6d871bccf05e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:39.629378 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.629353    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 06 05:08:39.633103 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.633078    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mfzc\" (UniqueName: \"kubernetes.io/projected/3bdf9f5e-4f2f-4be8-93df-214257019dbc-kube-api-access-8mfzc\") pod \"aws-ebs-csi-driver-node-grfwr\" (UID: \"3bdf9f5e-4f2f-4be8-93df-214257019dbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.633200 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.633141    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kd97\" (UniqueName: \"kubernetes.io/projected/85238ec9-ad65-4dcb-a789-d83c9861f21b-kube-api-access-7kd97\") pod \"node-resolver-7dhtw\" (UID: \"85238ec9-ad65-4dcb-a789-d83c9861f21b\") " pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.633200 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.633164    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh84b\" (UniqueName: \"kubernetes.io/projected/d28ddda6-b11e-4174-8d80-f7dec7acbc41-kube-api-access-wh84b\") pod \"multus-additional-cni-plugins-z67zh\" (UID: \"d28ddda6-b11e-4174-8d80-f7dec7acbc41\") " pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.633335 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.633216    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-245w5\" (UniqueName: \"kubernetes.io/projected/89665e91-1799-4a69-b55a-54c498846550-kube-api-access-245w5\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:39.726728 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b3345ed-3dc7-4347-b6d1-2f0187753f53-cni-binary-copy\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.726728 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-hostroot\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ec17605-be56-4a99-baa7-65fd72731055-dbus\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-kubelet\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-node-log\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726831    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-hostroot\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726862    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-kubelet\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-cni-netd\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726880    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ec17605-be56-4a99-baa7-65fd72731055-dbus\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-kubernetes\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726937    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-node-log\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-tmp\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.726971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.726972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-run-netns\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727007    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-cni-netd\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727050    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-run-netns\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727071    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-kubernetes\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r58kf\" (UniqueName: \"kubernetes.io/projected/9b3345ed-3dc7-4347-b6d1-2f0187753f53-kube-api-access-r58kf\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.727096    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysctl-d\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5fqw\" (UniqueName: \"kubernetes.io/projected/59bc29f0-1841-4ede-ba06-946ede4ebda8-kube-api-access-n5fqw\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:39.727155    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret podName:1ec17605-be56-4a99-baa7-65fd72731055 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:40.227136877 +0000 UTC m=+3.086199032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret") pod "global-pull-secret-syncer-4h6kg" (UID: "1ec17605-be56-4a99-baa7-65fd72731055") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-kubelet\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-daemon-config\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-sys\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59bc29f0-1841-4ede-ba06-946ede4ebda8-iptables-alerter-script\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-systemd-units\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-conf-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727319    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysctl-d\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.727518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysconfig\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727347    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-kubelet\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-var-lib-kubelet\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727379    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-systemd-units\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727347    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-sys\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-conf-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727406    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-var-lib-kubelet\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bc29f0-1841-4ede-ba06-946ede4ebda8-host-slash\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727437    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysconfig\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-var-lib-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-etc-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727497    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59bc29f0-1841-4ede-ba06-946ede4ebda8-host-slash\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f040a8fe-109d-4355-abd6-5d1ee6101544-serviceca\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727519    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-var-lib-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-tuned\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727553    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-etc-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9m72\" (UniqueName: \"kubernetes.io/projected/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-kube-api-access-j9m72\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-netns\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.728366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-cni-bin\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727608    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b3345ed-3dc7-4347-b6d1-2f0187753f53-cni-binary-copy\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-modprobe-d\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f040a8fe-109d-4355-abd6-5d1ee6101544-host\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-host\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-slash\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727790    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-daemon-config\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-env-overrides\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkg8z\" (UniqueName: \"kubernetes.io/projected/eef09fbb-8000-41fc-aeb1-533d75c4be90-kube-api-access-vkg8z\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727855    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-netns\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-cni-multus\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727906    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-host\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysctl-conf\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727918    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-cni-bin\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727958    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59bc29f0-1841-4ede-ba06-946ede4ebda8-iptables-alerter-script\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovn-node-metrics-cert\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.729220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728011    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-modprobe-d\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728014    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-slash\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728024    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-var-lib-cni-multus\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-cnibin\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728041    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-openvswitch\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-multus-certs\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728067    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-cnibin\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.727958    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f040a8fe-109d-4355-abd6-5d1ee6101544-serviceca\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-lib-modules\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728102    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f040a8fe-109d-4355-abd6-5d1ee6101544-host\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-cni-bin\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728147    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-sysctl-conf\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728188    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f4f23c5-3994-4b56-9502-dc371024ea36-agent-certs\") pod \"konnectivity-agent-nz87r\" (UID: \"5f4f23c5-3994-4b56-9502-dc371024ea36\") " pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-systemd\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728241    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-lib-modules\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovnkube-script-lib\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f4f23c5-3994-4b56-9502-dc371024ea36-konnectivity-ca\") pod \"konnectivity-agent-nz87r\" (UID: \"5f4f23c5-3994-4b56-9502-dc371024ea36\") " pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728308    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-cni-bin\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-system-cni-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728013    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-host-run-ovn-kubernetes\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728353    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-systemd\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728385    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-multus-certs\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-os-release\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728419    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-os-release\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-socket-dir-parent\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-systemd\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728499    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-system-cni-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-ovn\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovnkube-config\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728574    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-ovn\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gssds\" (UniqueName: \"kubernetes.io/projected/f040a8fe-109d-4355-abd6-5d1ee6101544-kube-api-access-gssds\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728607    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-run-systemd\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728547    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-socket-dir-parent\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728643    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-etc-kubernetes\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.730902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728931    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-env-overrides\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728606    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-etc-kubernetes\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.728988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ec17605-be56-4a99-baa7-65fd72731055-kubelet-config\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-log-socket\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729044    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovnkube-script-lib\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-k8s-cni-cncf-io\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-host-run-k8s-cni-cncf-io\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-run\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-cni-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729162    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eef09fbb-8000-41fc-aeb1-533d75c4be90-log-socket\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729131    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ec17605-be56-4a99-baa7-65fd72731055-kubelet-config\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729209    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-run\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729235    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b3345ed-3dc7-4347-b6d1-2f0187753f53-multus-cni-dir\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729337    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f4f23c5-3994-4b56-9502-dc371024ea36-konnectivity-ca\") pod \"konnectivity-agent-nz87r\" (UID: \"5f4f23c5-3994-4b56-9502-dc371024ea36\") " pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729745    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-tmp\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.729748    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovnkube-config\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.730310    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-etc-tuned\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.730669    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eef09fbb-8000-41fc-aeb1-533d75c4be90-ovn-node-metrics-cert\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.731599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.731254    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f4f23c5-3994-4b56-9502-dc371024ea36-agent-certs\") pod \"konnectivity-agent-nz87r\" (UID: \"5f4f23c5-3994-4b56-9502-dc371024ea36\") " pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.735960 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.735932    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r58kf\" (UniqueName: \"kubernetes.io/projected/9b3345ed-3dc7-4347-b6d1-2f0187753f53-kube-api-access-r58kf\") pod \"multus-qgmhn\" (UID: \"9b3345ed-3dc7-4347-b6d1-2f0187753f53\") " pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.736604 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.736582    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkg8z\" (UniqueName: \"kubernetes.io/projected/eef09fbb-8000-41fc-aeb1-533d75c4be90-kube-api-access-vkg8z\") pod \"ovnkube-node-p4xl4\" (UID: \"eef09fbb-8000-41fc-aeb1-533d75c4be90\") " pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.736719 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.736632    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9m72\" (UniqueName: \"kubernetes.io/projected/4f00ccf2-f8b9-4c22-b3ff-a719de44d014-kube-api-access-j9m72\") pod \"tuned-n447v\" (UID: \"4f00ccf2-f8b9-4c22-b3ff-a719de44d014\") " pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.736719 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.736659    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5fqw\" (UniqueName: \"kubernetes.io/projected/59bc29f0-1841-4ede-ba06-946ede4ebda8-kube-api-access-n5fqw\") pod \"iptables-alerter-bkb85\" (UID: \"59bc29f0-1841-4ede-ba06-946ede4ebda8\") " pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.737123 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.737107    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gssds\" (UniqueName: \"kubernetes.io/projected/f040a8fe-109d-4355-abd6-5d1ee6101544-kube-api-access-gssds\") pod \"node-ca-7k9lr\" (UID: \"f040a8fe-109d-4355-abd6-5d1ee6101544\") " pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.748076 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.748034    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:39.818680 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.818651    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z67zh"
Jun 06 05:08:39.828977 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.828923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr"
Jun 06 05:08:39.829258 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.829230    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28ddda6_b11e_4174_8d80_f7dec7acbc41.slice/crio-6d72d62c741cb2f82a9016444fd423c766a0ae46a329476664af81687d2a27b3 WatchSource:0}: Error finding container 6d72d62c741cb2f82a9016444fd423c766a0ae46a329476664af81687d2a27b3: Status 404 returned error can't find the container with id 6d72d62c741cb2f82a9016444fd423c766a0ae46a329476664af81687d2a27b3
Jun 06 05:08:39.836775 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.836752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7dhtw"
Jun 06 05:08:39.837053 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.837032    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdf9f5e_4f2f_4be8_93df_214257019dbc.slice/crio-a65faf0f3779bfb43471e7ffbcc9cf9527c6073067c5db3267617e1a08dbac1b WatchSource:0}: Error finding container a65faf0f3779bfb43471e7ffbcc9cf9527c6073067c5db3267617e1a08dbac1b: Status 404 returned error can't find the container with id a65faf0f3779bfb43471e7ffbcc9cf9527c6073067c5db3267617e1a08dbac1b
Jun 06 05:08:39.843406 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.843387    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:08:39.846966 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.846944    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85238ec9_ad65_4dcb_a789_d83c9861f21b.slice/crio-892607236da40356bdc9829606684a55e2e07d9e621e707a4b4172106e2e4435 WatchSource:0}: Error finding container 892607236da40356bdc9829606684a55e2e07d9e621e707a4b4172106e2e4435: Status 404 returned error can't find the container with id 892607236da40356bdc9829606684a55e2e07d9e621e707a4b4172106e2e4435
Jun 06 05:08:39.850144 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.850124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7k9lr"
Jun 06 05:08:39.851584 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.851561    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef09fbb_8000_41fc_aeb1_533d75c4be90.slice/crio-af961b94245b2b6c5bc81d8e94c4286d1b4014f869e20ccde9fccbe6cba39aa2 WatchSource:0}: Error finding container af961b94245b2b6c5bc81d8e94c4286d1b4014f869e20ccde9fccbe6cba39aa2: Status 404 returned error can't find the container with id af961b94245b2b6c5bc81d8e94c4286d1b4014f869e20ccde9fccbe6cba39aa2
Jun 06 05:08:39.855586 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.855547    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n447v"
Jun 06 05:08:39.859203 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.859181    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf040a8fe_109d_4355_abd6_5d1ee6101544.slice/crio-01ff015ee63695b70ec4f51169b32fe501a48e35aaa16e311632979b81139acf WatchSource:0}: Error finding container 01ff015ee63695b70ec4f51169b32fe501a48e35aaa16e311632979b81139acf: Status 404 returned error can't find the container with id 01ff015ee63695b70ec4f51169b32fe501a48e35aaa16e311632979b81139acf
Jun 06 05:08:39.862307 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.862284    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:08:39.863801 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.863779    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f00ccf2_f8b9_4c22_b3ff_a719de44d014.slice/crio-f36b3354195758560d97e3e171eb06941087b2baef26078ea6193dc76cd7e293 WatchSource:0}: Error finding container f36b3354195758560d97e3e171eb06941087b2baef26078ea6193dc76cd7e293: Status 404 returned error can't find the container with id f36b3354195758560d97e3e171eb06941087b2baef26078ea6193dc76cd7e293
Jun 06 05:08:39.869151 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.869132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qgmhn"
Jun 06 05:08:39.871657 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.871632    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4f23c5_3994_4b56_9502_dc371024ea36.slice/crio-fbaa1c1f00a2d7fa6856083927a95fe1dea0c210bcc5f1690659363f3d096a11 WatchSource:0}: Error finding container fbaa1c1f00a2d7fa6856083927a95fe1dea0c210bcc5f1690659363f3d096a11: Status 404 returned error can't find the container with id fbaa1c1f00a2d7fa6856083927a95fe1dea0c210bcc5f1690659363f3d096a11
Jun 06 05:08:39.876169 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:39.876147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bkb85"
Jun 06 05:08:39.880677 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.880652    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3345ed_3dc7_4347_b6d1_2f0187753f53.slice/crio-63a25133942dba797d11d644ba15e759eb132bcbdea6b68cb6d724c4e7187192 WatchSource:0}: Error finding container 63a25133942dba797d11d644ba15e759eb132bcbdea6b68cb6d724c4e7187192: Status 404 returned error can't find the container with id 63a25133942dba797d11d644ba15e759eb132bcbdea6b68cb6d724c4e7187192
Jun 06 05:08:39.886150 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:08:39.886127    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59bc29f0_1841_4ede_ba06_946ede4ebda8.slice/crio-660e06472d8f0c9a561c4f6890a3e022d7d757c814adc745ad7bf7069bd56419 WatchSource:0}: Error finding container 660e06472d8f0c9a561c4f6890a3e022d7d757c814adc745ad7bf7069bd56419: Status 404 returned error can't find the container with id 660e06472d8f0c9a561c4f6890a3e022d7d757c814adc745ad7bf7069bd56419
Jun 06 05:08:40.133033 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.132999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:40.133164 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.133068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:40.133228 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.133179    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:40.133295 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.133257    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:41.133232231 +0000 UTC m=+3.992294387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:40.133295 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.133181    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:08:40.133421 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.133304    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:08:40.133421 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.133319    2582 projected.go:196] Error preparing data for projected volume kube-api-access-78wjl for pod openshift-network-diagnostics/network-check-target-6fwqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:40.133421 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.133362    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl podName:ca54cfb3-d638-4f3d-8d64-6d871bccf05e nodeName:}" failed. No retries permitted until 2026-06-06 05:08:41.13335111 +0000 UTC m=+3.992413268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-78wjl" (UniqueName: "kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl") pod "network-check-target-6fwqv" (UID: "ca54cfb3-d638-4f3d-8d64-6d871bccf05e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:40.233923 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.233890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:40.234113 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.234070    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:40.234179 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.234158    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret podName:1ec17605-be56-4a99-baa7-65fd72731055 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:41.234132549 +0000 UTC m=+4.093194730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret") pod "global-pull-secret-syncer-4h6kg" (UID: "1ec17605-be56-4a99-baa7-65fd72731055") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:40.548031 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.547964    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 05:03:39 +0000 UTC" deadline="2028-03-15 21:40:31.578091038 +0000 UTC"
Jun 06 05:08:40.548031 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.548028    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15568h31m51.030068065s"
Jun 06 05:08:40.590999 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.590965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:40.591149 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.590966    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:40.591149 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.591080    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:40.591224 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:40.591178    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:40.599804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.599772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nz87r" event={"ID":"5f4f23c5-3994-4b56-9502-dc371024ea36","Type":"ContainerStarted","Data":"fbaa1c1f00a2d7fa6856083927a95fe1dea0c210bcc5f1690659363f3d096a11"}
Jun 06 05:08:40.601009 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.600979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n447v" event={"ID":"4f00ccf2-f8b9-4c22-b3ff-a719de44d014","Type":"ContainerStarted","Data":"f36b3354195758560d97e3e171eb06941087b2baef26078ea6193dc76cd7e293"}
Jun 06 05:08:40.602243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.602206    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7k9lr" event={"ID":"f040a8fe-109d-4355-abd6-5d1ee6101544","Type":"ContainerStarted","Data":"01ff015ee63695b70ec4f51169b32fe501a48e35aaa16e311632979b81139acf"}
Jun 06 05:08:40.603535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.603509    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"af961b94245b2b6c5bc81d8e94c4286d1b4014f869e20ccde9fccbe6cba39aa2"}
Jun 06 05:08:40.604694 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.604669    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr" event={"ID":"3bdf9f5e-4f2f-4be8-93df-214257019dbc","Type":"ContainerStarted","Data":"a65faf0f3779bfb43471e7ffbcc9cf9527c6073067c5db3267617e1a08dbac1b"}
Jun 06 05:08:40.606614 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.606595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal" event={"ID":"7738dc3de06fcdc6cd27b58af1712c02","Type":"ContainerStarted","Data":"fe2a095f08555f5c349af2fe3b88e5913e60d6e72deb6169ba51767a2170c488"}
Jun 06 05:08:40.607860 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.607834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bkb85" event={"ID":"59bc29f0-1841-4ede-ba06-946ede4ebda8","Type":"ContainerStarted","Data":"660e06472d8f0c9a561c4f6890a3e022d7d757c814adc745ad7bf7069bd56419"}
Jun 06 05:08:40.608993 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.608970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qgmhn" event={"ID":"9b3345ed-3dc7-4347-b6d1-2f0187753f53","Type":"ContainerStarted","Data":"63a25133942dba797d11d644ba15e759eb132bcbdea6b68cb6d724c4e7187192"}
Jun 06 05:08:40.610145 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.610122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dhtw" event={"ID":"85238ec9-ad65-4dcb-a789-d83c9861f21b","Type":"ContainerStarted","Data":"892607236da40356bdc9829606684a55e2e07d9e621e707a4b4172106e2e4435"}
Jun 06 05:08:40.611321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:40.611301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerStarted","Data":"6d72d62c741cb2f82a9016444fd423c766a0ae46a329476664af81687d2a27b3"}
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.141780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.142034    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.142065    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.142078    2582 projected.go:196] Error preparing data for projected volume kube-api-access-78wjl for pod openshift-network-diagnostics/network-check-target-6fwqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.142087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.142176    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl podName:ca54cfb3-d638-4f3d-8d64-6d871bccf05e nodeName:}" failed. No retries permitted until 2026-06-06 05:08:43.142155442 +0000 UTC m=+6.001217605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-78wjl" (UniqueName: "kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl") pod "network-check-target-6fwqv" (UID: "ca54cfb3-d638-4f3d-8d64-6d871bccf05e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.142262    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:41.142364 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.142326    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:43.142312178 +0000 UTC m=+6.001374350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:41.243214 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.243173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:41.243417 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.243406    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:41.243484 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.243470    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret podName:1ec17605-be56-4a99-baa7-65fd72731055 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:43.243451634 +0000 UTC m=+6.102513809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret") pod "global-pull-secret-syncer-4h6kg" (UID: "1ec17605-be56-4a99-baa7-65fd72731055") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:41.548578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.548484    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 05:03:39 +0000 UTC" deadline="2028-03-13 06:17:19.857623608 +0000 UTC"
Jun 06 05:08:41.548578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.548528    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15505h8m38.309101186s"
Jun 06 05:08:41.591717 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.591191    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:41.591717 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:41.591349    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:41.620992 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.620330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal" event={"ID":"060bae564ec193646c7c0fa2a1f6170e","Type":"ContainerStarted","Data":"d9333ebeb8c7c633c0aacdc986331360f823482345eaaad3d978391c72054676"}
Jun 06 05:08:41.625577 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.625042    2582 generic.go:356] "Generic (PLEG): container finished" podID="7738dc3de06fcdc6cd27b58af1712c02" containerID="fe2a095f08555f5c349af2fe3b88e5913e60d6e72deb6169ba51767a2170c488" exitCode=0
Jun 06 05:08:41.625577 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.625085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal" event={"ID":"7738dc3de06fcdc6cd27b58af1712c02","Type":"ContainerDied","Data":"fe2a095f08555f5c349af2fe3b88e5913e60d6e72deb6169ba51767a2170c488"}
Jun 06 05:08:41.635132 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:41.634898    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-193.ec2.internal" podStartSLOduration=2.634878101 podStartE2EDuration="2.634878101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:08:41.634776347 +0000 UTC m=+4.493838524" watchObservedRunningTime="2026-06-06 05:08:41.634878101 +0000 UTC m=+4.493940279"
Jun 06 05:08:42.591495 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:42.591001    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:42.591495 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:42.591128    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:42.591495 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:42.591440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:42.592164 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:42.591551    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:42.656763 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:42.656725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal" event={"ID":"7738dc3de06fcdc6cd27b58af1712c02","Type":"ContainerStarted","Data":"4bc066cae27ac737aac4bc4cba2ced4670eaa4ca08a1d77e41c2419395bf98e7"}
Jun 06 05:08:43.161956 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:43.161913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:43.162141 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:43.161988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:43.162213 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.162158    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:43.162294 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.162237    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:47.162217013 +0000 UTC m=+10.021279173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:43.162704 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.162685    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:08:43.162775 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.162711    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:08:43.162775 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.162724    2582 projected.go:196] Error preparing data for projected volume kube-api-access-78wjl for pod openshift-network-diagnostics/network-check-target-6fwqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:43.162775 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.162768    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl podName:ca54cfb3-d638-4f3d-8d64-6d871bccf05e nodeName:}" failed. No retries permitted until 2026-06-06 05:08:47.162753651 +0000 UTC m=+10.021815807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-78wjl" (UniqueName: "kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl") pod "network-check-target-6fwqv" (UID: "ca54cfb3-d638-4f3d-8d64-6d871bccf05e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:43.263922 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:43.263351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:43.263922 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.263505    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:43.263922 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.263568    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret podName:1ec17605-be56-4a99-baa7-65fd72731055 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:47.263550326 +0000 UTC m=+10.122612482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret") pod "global-pull-secret-syncer-4h6kg" (UID: "1ec17605-be56-4a99-baa7-65fd72731055") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:43.591246 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:43.591216    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:43.591423 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:43.591375    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:44.591096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:44.591062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:44.591561 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:44.591200    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:44.591561 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:44.591070    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:44.591679 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:44.591661    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:45.591021 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:45.590984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:45.591197 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:45.591142    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:46.591499 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:46.591463    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:46.591977 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:46.591604    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:46.591977 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:46.591657    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:46.591977 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:46.591761    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:47.197284 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:47.197229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:47.197494 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:47.197326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:47.197494 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.197419    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:08:47.197494 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.197442    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:08:47.197494 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.197455    2582 projected.go:196] Error preparing data for projected volume kube-api-access-78wjl for pod openshift-network-diagnostics/network-check-target-6fwqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:47.197723 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.197424    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:47.197723 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.197522    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl podName:ca54cfb3-d638-4f3d-8d64-6d871bccf05e nodeName:}" failed. No retries permitted until 2026-06-06 05:08:55.197502781 +0000 UTC m=+18.056564937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-78wjl" (UniqueName: "kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl") pod "network-check-target-6fwqv" (UID: "ca54cfb3-d638-4f3d-8d64-6d871bccf05e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:47.197723 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.197547    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:55.197534666 +0000 UTC m=+18.056596837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:47.298050 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:47.297958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:47.298230 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.298126    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:47.298230 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.298192    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret podName:1ec17605-be56-4a99-baa7-65fd72731055 nodeName:}" failed. No retries permitted until 2026-06-06 05:08:55.298172044 +0000 UTC m=+18.157234217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret") pod "global-pull-secret-syncer-4h6kg" (UID: "1ec17605-be56-4a99-baa7-65fd72731055") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:47.595916 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:47.595877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:47.596369 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:47.596000    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:48.591291 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:48.591122    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:48.591469 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:48.591290    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:48.591716 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:48.591558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:48.591716 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:48.591676    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:49.591329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:49.591292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:49.591880 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:49.591451    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:50.591363 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:50.591329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:50.591795 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:50.591343    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:50.591795 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:50.591468    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:50.591795 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:50.591560    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:51.590783 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:51.590745    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:51.590968 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:51.590924    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:52.590756 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:52.590722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:52.590756 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:52.590755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:52.591305 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:52.590855    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:52.591305 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:52.590943    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:53.590641 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:53.590613    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:53.590829 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:53.590741    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:54.591582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:54.591550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:54.592067 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:54.591595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:54.592067 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:54.591696    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:54.592067 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:54.591813    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:55.259183 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:55.259141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:55.259386 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:55.259212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:55.259386 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.259322    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:55.259386 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.259336    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:08:55.259386 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.259352    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:08:55.259386 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.259364    2582 projected.go:196] Error preparing data for projected volume kube-api-access-78wjl for pod openshift-network-diagnostics/network-check-target-6fwqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:55.259624 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.259392    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:11.259371786 +0000 UTC m=+34.118433961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:08:55.259624 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.259408    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl podName:ca54cfb3-d638-4f3d-8d64-6d871bccf05e nodeName:}" failed. No retries permitted until 2026-06-06 05:09:11.25940107 +0000 UTC m=+34.118463225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-78wjl" (UniqueName: "kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl") pod "network-check-target-6fwqv" (UID: "ca54cfb3-d638-4f3d-8d64-6d871bccf05e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:08:55.360253 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:55.360219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:55.360418 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.360395    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:55.360485 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.360466    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret podName:1ec17605-be56-4a99-baa7-65fd72731055 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:11.360445917 +0000 UTC m=+34.219508072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret") pod "global-pull-secret-syncer-4h6kg" (UID: "1ec17605-be56-4a99-baa7-65fd72731055") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:08:55.591491 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:55.591458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:55.591664 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:55.591605    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:56.590914 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:56.590880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:56.590914 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:56.590902    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:56.591140 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:56.590993    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:56.591194 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:56.591132    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:57.591940 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:57.591902    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:57.592389 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:57.592028    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:58.590651 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:58.590619    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:08:58.590799 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:58.590722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:08:58.590799 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:58.590773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:08:58.590885 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:58.590865    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:08:59.591087 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.591065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:08:59.591445 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:08:59.591172    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:08:59.691201 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.691170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qgmhn" event={"ID":"9b3345ed-3dc7-4347-b6d1-2f0187753f53","Type":"ContainerStarted","Data":"f28b7d51facbf6a9fecf7d9ba23bddc764dafe5815d4f6856293f530a94b6d48"}
Jun 06 05:08:59.693994 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.693619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7dhtw" event={"ID":"85238ec9-ad65-4dcb-a789-d83c9861f21b","Type":"ContainerStarted","Data":"6e0cbb6d1f7e10a55b2b355275ed366bbc9d0ba7ace3e183a34b766c06ec59d4"}
Jun 06 05:08:59.705423 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.705395    2582 generic.go:356] "Generic (PLEG): container finished" podID="d28ddda6-b11e-4174-8d80-f7dec7acbc41" containerID="4bd093b3faae10e41a092ff2c505296a3c5c151a4068c1274a3298272d37667f" exitCode=0
Jun 06 05:08:59.705550 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.705487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerDied","Data":"4bd093b3faae10e41a092ff2c505296a3c5c151a4068c1274a3298272d37667f"}
Jun 06 05:08:59.707442 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.707416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nz87r" event={"ID":"5f4f23c5-3994-4b56-9502-dc371024ea36","Type":"ContainerStarted","Data":"8e9e092a2fd89d53b5af7a41a0ed8fd75119a22af4b271dd6fa24a998cdd6514"}
Jun 06 05:08:59.709181 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.709117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n447v" event={"ID":"4f00ccf2-f8b9-4c22-b3ff-a719de44d014","Type":"ContainerStarted","Data":"856178a797e4675f1cd097f74ffdac1f55a0ec7eb58c8600cd4c90ebadffda84"}
Jun 06 05:08:59.710432 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.710389    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-193.ec2.internal" podStartSLOduration=20.710377583 podStartE2EDuration="20.710377583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:08:42.677564579 +0000 UTC m=+5.536626757" watchObservedRunningTime="2026-06-06 05:08:59.710377583 +0000 UTC m=+22.569439760"
Jun 06 05:08:59.710604 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.710539    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qgmhn" podStartSLOduration=2.496680017 podStartE2EDuration="21.710530274s" totalImagesPullingTime="19.213850257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:08:59.710150482 +0000 UTC m=+22.569212661" watchObservedRunningTime="2026-06-06 05:08:59.710530274 +0000 UTC m=+22.569592448"
Jun 06 05:08:59.711043 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.711021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7k9lr" event={"ID":"f040a8fe-109d-4355-abd6-5d1ee6101544","Type":"ContainerStarted","Data":"6aa3f6bfdfecef7be1f1bddcd9f08bec4e114c8df4d9d934723678e321cb4bfd"}
Jun 06 05:08:59.714760 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.714741    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:08:59.715119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.715099    2582 generic.go:356] "Generic (PLEG): container finished" podID="eef09fbb-8000-41fc-aeb1-533d75c4be90" containerID="d43f4e2fbe137eef996b6ced1dfb14806f73bc093169fd280deb5d9b986ee216" exitCode=1
Jun 06 05:08:59.715203 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.715162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"0fc9ce052c72e23fe603e5e897f3bc6a51b1966d23c1b671523b63be91ce1c6d"}
Jun 06 05:08:59.715259 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.715222    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"6a70a81614a9ab56a182feb9b5ae9d4106f66fbbb47e991e52e50d7d59747676"}
Jun 06 05:08:59.715333 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.715289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"876dfabbe5b93969a8ecd21acd48725bbed5193fc02ee70d7a0586db2adb2034"}
Jun 06 05:08:59.715371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.715334    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerDied","Data":"d43f4e2fbe137eef996b6ced1dfb14806f73bc093169fd280deb5d9b986ee216"}
Jun 06 05:08:59.715371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.715366    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"50818e89a83a189bdd86ce39bcca2534ccd8437cc43a45025ef8f28f8203c628"}
Jun 06 05:08:59.716711 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.716680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr" event={"ID":"3bdf9f5e-4f2f-4be8-93df-214257019dbc","Type":"ContainerStarted","Data":"a59d74c1256f17212edbfa969ead4511018f601241b64ef9cec555ac56fd3fe8"}
Jun 06 05:08:59.748475 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.748428    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7dhtw" podStartSLOduration=3.513322546 podStartE2EDuration="22.748407848s" totalImagesPullingTime="19.235085302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:08:59.747578364 +0000 UTC m=+22.606640542" watchObservedRunningTime="2026-06-06 05:08:59.748407848 +0000 UTC m=+22.607470025"
Jun 06 05:08:59.770619 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.770549    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n447v" podStartSLOduration=3.547041611 podStartE2EDuration="22.770529731s" totalImagesPullingTime="19.22348812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:08:59.770024287 +0000 UTC m=+22.629086464" watchObservedRunningTime="2026-06-06 05:08:59.770529731 +0000 UTC m=+22.629591963"
Jun 06 05:08:59.784857 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.784813    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nz87r" podStartSLOduration=11.204905702 podStartE2EDuration="21.784797738s" totalImagesPullingTime="10.579892036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:08:59.784305831 +0000 UTC m=+22.643368005" watchObservedRunningTime="2026-06-06 05:08:59.784797738 +0000 UTC m=+22.643859914"
Jun 06 05:08:59.806096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:08:59.806050    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7k9lr" podStartSLOduration=3.58111058 podStartE2EDuration="22.806033592s" totalImagesPullingTime="19.224923012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:08:59.805530482 +0000 UTC m=+22.664592659" watchObservedRunningTime="2026-06-06 05:08:59.806033592 +0000 UTC m=+22.665095806"
Jun 06 05:09:00.574222 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.574196    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 06 05:09:00.590911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.590812    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T05:09:00.574215999Z","UUID":"917799e5-c382-4db1-9134-1108b7e4b138","Handler":null,"Name":"","Endpoint":""}
Jun 06 05:09:00.590911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.590900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:00.591086 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.590920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:00.591086 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:00.591021    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:09:00.591743 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:00.591125    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:09:00.592625 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.592607    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 06 05:09:00.592724 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.592648    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 06 05:09:00.724233 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.724159    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:09:00.724622 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.724593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"bfef2709119066f36584712490dc36856bdca45f80f403b92402daa95747b0e3"}
Jun 06 05:09:00.726461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.726426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr" event={"ID":"3bdf9f5e-4f2f-4be8-93df-214257019dbc","Type":"ContainerStarted","Data":"f69ee0d41cd479a633c19f1dd1b6526ffd4575291445ccf85a05153a144bada5"}
Jun 06 05:09:00.728147 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.728125    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bkb85" event={"ID":"59bc29f0-1841-4ede-ba06-946ede4ebda8","Type":"ContainerStarted","Data":"df049aedc6ba0e3a539efbbebc506b939fe0114b5efacc8e9779ab9b0bb5b1fa"}
Jun 06 05:09:00.744924 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:00.744881    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bkb85" podStartSLOduration=3.596245365 podStartE2EDuration="22.744868024s" totalImagesPullingTime="19.148622659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:00.744586504 +0000 UTC m=+23.603648682" watchObservedRunningTime="2026-06-06 05:09:00.744868024 +0000 UTC m=+23.603930228"
Jun 06 05:09:01.380330 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:01.380296    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:09:01.381016 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:01.380996    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:09:01.591033 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:01.591005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:01.591184 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:01.591156    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:09:01.733220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:01.733182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr" event={"ID":"3bdf9f5e-4f2f-4be8-93df-214257019dbc","Type":"ContainerStarted","Data":"7dc210d09d770ca4eef14bf52e486b39d7ad5eec588d7ce52a34ba10a8309208"}
Jun 06 05:09:01.733419 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:01.733400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:09:01.733848 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:01.733831    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nz87r"
Jun 06 05:09:01.755694 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:01.755648    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grfwr" podStartSLOduration=11.955301251 podStartE2EDuration="24.755633899s" totalImagesPullingTime="12.800332648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:01.754863205 +0000 UTC m=+24.613925385" watchObservedRunningTime="2026-06-06 05:09:01.755633899 +0000 UTC m=+24.614696089"
Jun 06 05:09:02.591245 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:02.591207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:02.591781 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:02.591207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:02.591781 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:02.591350    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:09:02.591781 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:02.591409    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:09:02.738487 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:02.738457    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:09:02.738975 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:02.738931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"890fa675b9cf35826a50506c466422771821232d40058188c4fd046dbd344b48"}
Jun 06 05:09:03.590932 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:03.590901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:03.591118 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:03.591030    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:09:04.590650 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.590514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:04.591027 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.590516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:04.591027 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:04.590755    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:09:04.591027 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:04.590799    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:09:04.747574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.747550    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:09:04.747914 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.747888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"7c502b6619862cf76d02ca0481c2802d94474363c3934dd4f265bc8b975ff70a"}
Jun 06 05:09:04.748100 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.748081    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:09:04.748205 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.748145    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:09:04.748205 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.748177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:09:04.748383 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.748365    2582 scope.go:117] "RemoveContainer" containerID="d43f4e2fbe137eef996b6ced1dfb14806f73bc093169fd280deb5d9b986ee216"
Jun 06 05:09:04.763475 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.763453    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:09:04.763637 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:04.763624    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:09:05.590578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:05.590553    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:05.590741 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:05.590665    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:09:05.751635 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:05.751598    2582 generic.go:356] "Generic (PLEG): container finished" podID="d28ddda6-b11e-4174-8d80-f7dec7acbc41" containerID="913873ae5dadd9f225ba16562bd7f7696afa4f47879ef80c0141bb9cb9eec699" exitCode=0
Jun 06 05:09:05.751775 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:05.751689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerDied","Data":"913873ae5dadd9f225ba16562bd7f7696afa4f47879ef80c0141bb9cb9eec699"}
Jun 06 05:09:05.755304 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:05.755285    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:09:05.755660 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:05.755640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" event={"ID":"eef09fbb-8000-41fc-aeb1-533d75c4be90","Type":"ContainerStarted","Data":"117ef684639f15011936b7f66f67ec5529e0817ee6787414edd27ba43ed463bb"}
Jun 06 05:09:05.795537 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:05.795486    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4" podStartSLOduration=9.498202073 podStartE2EDuration="28.795470852s" totalImagesPullingTime="19.297268779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:05.793740924 +0000 UTC m=+28.652803099" watchObservedRunningTime="2026-06-06 05:09:05.795470852 +0000 UTC m=+28.654533032"
Jun 06 05:09:06.591494 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.591306    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:06.591958 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.591308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:06.591958 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:06.591562    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:09:06.591958 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:06.591678    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:09:06.676998 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.676966    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4h6kg"]
Jun 06 05:09:06.680369 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.680330    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fwqv"]
Jun 06 05:09:06.680989 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.680963    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wv65h"]
Jun 06 05:09:06.681113 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.681101    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:06.681246 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:06.681219    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:09:06.757911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.757876    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:06.757911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:06.757890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:06.758118 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:06.757998    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:09:06.758380 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:06.758358    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:09:07.761966 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:07.761931    2582 generic.go:356] "Generic (PLEG): container finished" podID="d28ddda6-b11e-4174-8d80-f7dec7acbc41" containerID="65faa61cafb6e612bd07413c5eba66dc0f94347e73c87bdead9913d89ded2654" exitCode=0
Jun 06 05:09:07.762634 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:07.761974    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerDied","Data":"65faa61cafb6e612bd07413c5eba66dc0f94347e73c87bdead9913d89ded2654"}
Jun 06 05:09:08.591356 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:08.591321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:08.591356 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:08.591349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:08.591586 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:08.591349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:08.591586 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:08.591428    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:09:08.591586 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:08.591506    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:09:08.591724 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:08.591590    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:09:09.769082 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:09.768898    2582 generic.go:356] "Generic (PLEG): container finished" podID="d28ddda6-b11e-4174-8d80-f7dec7acbc41" containerID="9604eed98fa281fa4463ae9d3840b088966dfa27934dc5db3d9af461af932aa5" exitCode=0
Jun 06 05:09:09.769082 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:09.768936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerDied","Data":"9604eed98fa281fa4463ae9d3840b088966dfa27934dc5db3d9af461af932aa5"}
Jun 06 05:09:10.591352 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:10.591321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:10.591352 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:10.591337    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:10.591582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:10.591334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:10.591582 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:10.591486    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:09:10.591582 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:10.591526    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fwqv" podUID="ca54cfb3-d638-4f3d-8d64-6d871bccf05e"
Jun 06 05:09:10.591734 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:10.591596    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4h6kg" podUID="1ec17605-be56-4a99-baa7-65fd72731055"
Jun 06 05:09:11.279606 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:11.279570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:11.280105 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:11.279653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:11.280105 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.279790    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:11.280105 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.279809    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:11.280105 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.279822    2582 projected.go:196] Error preparing data for projected volume kube-api-access-78wjl for pod openshift-network-diagnostics/network-check-target-6fwqv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:11.280105 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.279880    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl podName:ca54cfb3-d638-4f3d-8d64-6d871bccf05e nodeName:}" failed. No retries permitted until 2026-06-06 05:09:43.27986411 +0000 UTC m=+66.138926283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-78wjl" (UniqueName: "kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl") pod "network-check-target-6fwqv" (UID: "ca54cfb3-d638-4f3d-8d64-6d871bccf05e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:11.280105 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.279927    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:11.280105 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.279991    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:43.279975425 +0000 UTC m=+66.139037588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:11.380318 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:11.380280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:11.380539 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.380398    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:11.380539 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:11.380459    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret podName:1ec17605-be56-4a99-baa7-65fd72731055 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:43.380441142 +0000 UTC m=+66.239503320 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret") pod "global-pull-secret-syncer-4h6kg" (UID: "1ec17605-be56-4a99-baa7-65fd72731055") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:11.988895 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:11.988811    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-193.ec2.internal" event="NodeReady"
Jun 06 05:09:11.989158 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:11.988976    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 06 05:09:12.023075 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.023043    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9b496446-dgprz"]
Jun 06 05:09:12.046876 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.046839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9b496446-dgprz"]
Jun 06 05:09:12.046876 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.046886    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9bbql"]
Jun 06 05:09:12.047088 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.046963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.049694 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.049647    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 06 05:09:12.049845 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.049757    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 06 05:09:12.049845 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.049811    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qthsg\""
Jun 06 05:09:12.049845 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.049837    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 06 05:09:12.056089 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.056063    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 06 05:09:12.063237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.063216    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-shh2l"]
Jun 06 05:09:12.063403 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.063383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.065888 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.065864    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qbbkp\""
Jun 06 05:09:12.066003 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.065922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 06 05:09:12.066112 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.066093    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 06 05:09:12.084971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.084947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shh2l"]
Jun 06 05:09:12.085158 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.084987    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9bbql"]
Jun 06 05:09:12.085158 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.085093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.087770 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.087586    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 06 05:09:12.087770 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.087605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fzsg2\""
Jun 06 05:09:12.087770 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.087619    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 06 05:09:12.087770 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.087639    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 06 05:09:12.163573 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.163530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nz87r_5f4f23c5-3994-4b56-9502-dc371024ea36/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:12.185427 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7708bc-ab15-44a8-8399-5da9076c0fd2-config-volume\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.185611 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-certificates\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.185611 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-bound-sa-token\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.185611 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4hz\" (UniqueName: \"kubernetes.io/projected/ef7708bc-ab15-44a8-8399-5da9076c0fd2-kube-api-access-zs4hz\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.185611 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.185611 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-installation-pull-secrets\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.185846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-trusted-ca\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.185846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n2np\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-kube-api-access-9n2np\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.185846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.185846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqvdx\" (UniqueName: \"kubernetes.io/projected/a0b76e14-9df2-4368-a311-ec3991bc389c-kube-api-access-fqvdx\") pod \"ingress-canary-shh2l\" (UID: \"a0b76e14-9df2-4368-a311-ec3991bc389c\") " pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.185846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef7708bc-ab15-44a8-8399-5da9076c0fd2-tmp-dir\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.186044 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0b76e14-9df2-4368-a311-ec3991bc389c-cert\") pod \"ingress-canary-shh2l\" (UID: \"a0b76e14-9df2-4368-a311-ec3991bc389c\") " pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.186044 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d13314ee-5ca9-46e9-b13f-cb95c3519fca-ca-trust-extracted\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.186044 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.185928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-image-registry-private-configuration\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.237219 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.237184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nz87r_5f4f23c5-3994-4b56-9502-dc371024ea36/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:12.287225 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-trusted-ca\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287225 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n2np\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-kube-api-access-9n2np\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287225 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqvdx\" (UniqueName: \"kubernetes.io/projected/a0b76e14-9df2-4368-a311-ec3991bc389c-kube-api-access-fqvdx\") pod \"ingress-canary-shh2l\" (UID: \"a0b76e14-9df2-4368-a311-ec3991bc389c\") " pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef7708bc-ab15-44a8-8399-5da9076c0fd2-tmp-dir\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0b76e14-9df2-4368-a311-ec3991bc389c-cert\") pod \"ingress-canary-shh2l\" (UID: \"a0b76e14-9df2-4368-a311-ec3991bc389c\") " pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d13314ee-5ca9-46e9-b13f-cb95c3519fca-ca-trust-extracted\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-image-registry-private-configuration\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.287399    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7708bc-ab15-44a8-8399-5da9076c0fd2-config-volume\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-certificates\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.287475    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:12.787451346 +0000 UTC m=+35.646513517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-bound-sa-token\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4hz\" (UniqueName: \"kubernetes.io/projected/ef7708bc-ab15-44a8-8399-5da9076c0fd2-kube-api-access-zs4hz\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-installation-pull-secrets\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.287836 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.287702    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef7708bc-ab15-44a8-8399-5da9076c0fd2-tmp-dir\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.288650 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.288000    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-certificates\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.288650 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.288078    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:09:12.288650 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.288096    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:09:12.288650 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.288146    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:09:12.788131012 +0000 UTC m=+35.647193182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:09:12.288650 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.288209    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef7708bc-ab15-44a8-8399-5da9076c0fd2-config-volume\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.288650 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.288263    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d13314ee-5ca9-46e9-b13f-cb95c3519fca-ca-trust-extracted\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.288650 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.288307    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-trusted-ca\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.292007 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.291982    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-image-registry-private-configuration\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.292007 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.291994    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-installation-pull-secrets\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.292007 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.292002    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0b76e14-9df2-4368-a311-ec3991bc389c-cert\") pod \"ingress-canary-shh2l\" (UID: \"a0b76e14-9df2-4368-a311-ec3991bc389c\") " pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.298640 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.298621    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqvdx\" (UniqueName: \"kubernetes.io/projected/a0b76e14-9df2-4368-a311-ec3991bc389c-kube-api-access-fqvdx\") pod \"ingress-canary-shh2l\" (UID: \"a0b76e14-9df2-4368-a311-ec3991bc389c\") " pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.298823 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.298804    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4hz\" (UniqueName: \"kubernetes.io/projected/ef7708bc-ab15-44a8-8399-5da9076c0fd2-kube-api-access-zs4hz\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.298882 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.298831    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-bound-sa-token\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.299134 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.299109    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n2np\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-kube-api-access-9n2np\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.394324 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.394286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shh2l"
Jun 06 05:09:12.590801 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.590767    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:12.590973 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.590812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:12.590973 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.590812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:12.593862 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.593836    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l6jm8\""
Jun 06 05:09:12.593987 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.593898    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 06 05:09:12.594069 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.593987    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-smjds\""
Jun 06 05:09:12.594069 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.594046    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 06 05:09:12.594069 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.594090    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 06 05:09:12.594699 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.594680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 06 05:09:12.792890 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.792853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:12.793069 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:12.792908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:12.793069 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.793042    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:12.793069 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.793065    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:09:12.793211 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.793079    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:09:12.793211 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.793135    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:13.793112074 +0000 UTC m=+36.652174284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:12.793211 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:12.793160    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:09:13.793150414 +0000 UTC m=+36.652212572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:09:13.803147 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:13.803101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:13.803694 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:13.803205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:13.803694 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:13.803255    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:13.803694 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:13.803327    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:09:13.803694 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:13.803340    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:15.803317916 +0000 UTC m=+38.662380092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:13.803694 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:13.803347    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:09:13.803694 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:13.803397    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:09:15.803382165 +0000 UTC m=+38.662444320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:09:13.988156 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:13.988128    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shh2l"]
Jun 06 05:09:13.992771 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:09:13.992736    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b76e14_9df2_4368_a311_ec3991bc389c.slice/crio-a46a7e43d3eafa8af8db232a8060756c5e590a82b5eb639064a3b83070725802 WatchSource:0}: Error finding container a46a7e43d3eafa8af8db232a8060756c5e590a82b5eb639064a3b83070725802: Status 404 returned error can't find the container with id a46a7e43d3eafa8af8db232a8060756c5e590a82b5eb639064a3b83070725802
Jun 06 05:09:14.785619 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:14.785589    2582 generic.go:356] "Generic (PLEG): container finished" podID="d28ddda6-b11e-4174-8d80-f7dec7acbc41" containerID="36b8a625636486d9ea90a7d78e6617e72da45b5fb3a4863f6b2eb7b136aa1f77" exitCode=0
Jun 06 05:09:14.785790 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:14.785657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerDied","Data":"36b8a625636486d9ea90a7d78e6617e72da45b5fb3a4863f6b2eb7b136aa1f77"}
Jun 06 05:09:14.786752 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:14.786730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shh2l" event={"ID":"a0b76e14-9df2-4368-a311-ec3991bc389c","Type":"ContainerStarted","Data":"a46a7e43d3eafa8af8db232a8060756c5e590a82b5eb639064a3b83070725802"}
Jun 06 05:09:15.792335 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:15.792295    2582 generic.go:356] "Generic (PLEG): container finished" podID="d28ddda6-b11e-4174-8d80-f7dec7acbc41" containerID="ad34723545178b980220669d35f9cfd13a74cec27fd2888ae05b7e5328fc5b27" exitCode=0
Jun 06 05:09:15.792886 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:15.792346    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerDied","Data":"ad34723545178b980220669d35f9cfd13a74cec27fd2888ae05b7e5328fc5b27"}
Jun 06 05:09:15.819598 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:15.819556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:15.819748 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:15.819632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:15.819812 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:15.819769    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:15.819865 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:15.819825    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:19.819807425 +0000 UTC m=+42.678869583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:15.820220 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:15.820202    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:09:15.820220 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:15.820219    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:09:15.820385 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:15.820286    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:09:19.820255775 +0000 UTC m=+42.679317945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:09:16.593885 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.593854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nz87r_5f4f23c5-3994-4b56-9502-dc371024ea36/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:16.694736 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.694693    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nz87r_5f4f23c5-3994-4b56-9502-dc371024ea36/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:16.798313 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.798261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z67zh" event={"ID":"d28ddda6-b11e-4174-8d80-f7dec7acbc41","Type":"ContainerStarted","Data":"8e7b95ea9803724301415c81f04060a4a8cbf0a155b4380217f859f06a76146b"}
Jun 06 05:09:16.799726 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.799672    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shh2l" event={"ID":"a0b76e14-9df2-4368-a311-ec3991bc389c","Type":"ContainerStarted","Data":"3ddbdc00b340c4133348bc9ef3c1995a623ee62c557a04545ea81b97bf1c3498"}
Jun 06 05:09:16.820710 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.820662    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z67zh" podStartSLOduration=9.285818813 podStartE2EDuration="39.82064752s" totalImagesPullingTime="30.534828707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:16.819240269 +0000 UTC m=+39.678302446" watchObservedRunningTime="2026-06-06 05:09:16.82064752 +0000 UTC m=+39.679709696"
Jun 06 05:09:16.833497 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.833448    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-shh2l" podStartSLOduration=2.277955256 podStartE2EDuration="4.83343528s" totalImagesPullingTime="2.555480024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:16.832737386 +0000 UTC m=+39.691799562" watchObservedRunningTime="2026-06-06 05:09:16.83343528 +0000 UTC m=+39.692497456"
Jun 06 05:09:16.945856 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.945816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nz87r_5f4f23c5-3994-4b56-9502-dc371024ea36/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:16.995826 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:16.995786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nz87r_5f4f23c5-3994-4b56-9502-dc371024ea36/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:19.852417 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:19.852386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:19.852841 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:19.852436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:19.852841 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:19.852526    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:09:19.852841 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:19.852542    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:09:19.852841 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:19.852591    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:09:27.85257592 +0000 UTC m=+50.711638101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:09:19.852841 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:19.852592    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:19.852841 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:19.852630    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:27.852620202 +0000 UTC m=+50.711682358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:27.919191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:27.919152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:27.919673 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:27.919209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:27.919673 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:27.919311    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:09:27.919673 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:27.919328    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:27.919673 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:27.919377    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:43.91936168 +0000 UTC m=+66.778423834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:27.919673 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:27.919329    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:09:27.919673 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:27.919442    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:09:43.919428134 +0000 UTC m=+66.778490305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:09:36.775634 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:36.775606    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p4xl4"
Jun 06 05:09:43.330495 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.330439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:09:43.330903 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.330520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:43.333750 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.333729    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 06 05:09:43.333852 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.333776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 06 05:09:43.340828 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:43.340806    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 06 05:09:43.340902 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:43.340878    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:10:47.34085648 +0000 UTC m=+130.199918656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : secret "metrics-daemon-secret" not found
Jun 06 05:09:43.342852 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.342837    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 06 05:09:43.354577 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.354556    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78wjl\" (UniqueName: \"kubernetes.io/projected/ca54cfb3-d638-4f3d-8d64-6d871bccf05e-kube-api-access-78wjl\") pod \"network-check-target-6fwqv\" (UID: \"ca54cfb3-d638-4f3d-8d64-6d871bccf05e\") " pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:43.431737 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.431693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:43.434351 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.434332    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 06 05:09:43.444359 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.444340    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ec17605-be56-4a99-baa7-65fd72731055-original-pull-secret\") pod \"global-pull-secret-syncer-4h6kg\" (UID: \"1ec17605-be56-4a99-baa7-65fd72731055\") " pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:43.502687 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.502655    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4h6kg"
Jun 06 05:09:43.511617 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.511600    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-smjds\""
Jun 06 05:09:43.520400 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.520379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:43.654030 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.653988    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4h6kg"]
Jun 06 05:09:43.657759 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:09:43.657729    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec17605_be56_4a99_baa7_65fd72731055.slice/crio-e41f12073f8c49158edb9ba5e9585c4da922ac74a7a50083a1dafb0e7c7231d0 WatchSource:0}: Error finding container e41f12073f8c49158edb9ba5e9585c4da922ac74a7a50083a1dafb0e7c7231d0: Status 404 returned error can't find the container with id e41f12073f8c49158edb9ba5e9585c4da922ac74a7a50083a1dafb0e7c7231d0
Jun 06 05:09:43.664300 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.664258    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fwqv"]
Jun 06 05:09:43.666998 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:09:43.666974    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca54cfb3_d638_4f3d_8d64_6d871bccf05e.slice/crio-3bdc145aef122c765e89688b8d25cc2a6e5aed7e09ef18a85809cb4bdc5b7926 WatchSource:0}: Error finding container 3bdc145aef122c765e89688b8d25cc2a6e5aed7e09ef18a85809cb4bdc5b7926: Status 404 returned error can't find the container with id 3bdc145aef122c765e89688b8d25cc2a6e5aed7e09ef18a85809cb4bdc5b7926
Jun 06 05:09:43.861878 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.861783    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fwqv" event={"ID":"ca54cfb3-d638-4f3d-8d64-6d871bccf05e","Type":"ContainerStarted","Data":"3bdc145aef122c765e89688b8d25cc2a6e5aed7e09ef18a85809cb4bdc5b7926"}
Jun 06 05:09:43.862849 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.862826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4h6kg" event={"ID":"1ec17605-be56-4a99-baa7-65fd72731055","Type":"ContainerStarted","Data":"e41f12073f8c49158edb9ba5e9585c4da922ac74a7a50083a1dafb0e7c7231d0"}
Jun 06 05:09:43.934534 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.934498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:09:43.934701 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:43.934559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:09:43.934701 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:43.934653    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:09:43.934701 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:43.934680    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:09:43.934701 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:43.934657    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:43.934830 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:43.934738    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:10:15.934722284 +0000 UTC m=+98.793784443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:09:43.934830 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:09:43.934751    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:10:15.934745883 +0000 UTC m=+98.793808038 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:48.876394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:48.876354    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fwqv" event={"ID":"ca54cfb3-d638-4f3d-8d64-6d871bccf05e","Type":"ContainerStarted","Data":"8103bf52e51cc98ef7a2c48e8d62e9df346039276acba4506d16877890d998a7"}
Jun 06 05:09:48.876872 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:48.876449    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:09:48.877701 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:48.877678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4h6kg" event={"ID":"1ec17605-be56-4a99-baa7-65fd72731055","Type":"ContainerStarted","Data":"d0f59d2045fcdcba5454f5b54f6aa21aa38eae0b9e582908db1a394a8fe05502"}
Jun 06 05:09:48.891661 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:48.891618    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6fwqv" podStartSLOduration=67.626182622 podStartE2EDuration="1m11.891588831s" totalImagesPullingTime="4.265406209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:48.890674174 +0000 UTC m=+71.749736351" watchObservedRunningTime="2026-06-06 05:09:48.891588831 +0000 UTC m=+71.750651000"
Jun 06 05:09:48.903965 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:09:48.903928    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4h6kg" podStartSLOduration=66.626488928 podStartE2EDuration="1m10.903914849s" totalImagesPullingTime="4.277425921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:48.903648302 +0000 UTC m=+71.762710479" watchObservedRunningTime="2026-06-06 05:09:48.903914849 +0000 UTC m=+71.762977017"
Jun 06 05:10:15.956535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:10:15.956500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:10:15.957035 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:10:15.956550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:10:15.957035 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:10:15.956643    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:10:15.957035 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:10:15.956645    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:10:15.957035 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:10:15.956661    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:10:15.957035 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:10:15.956702    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:19.956688052 +0000 UTC m=+162.815750208 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:10:15.957035 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:10:15.956715    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:11:19.956709255 +0000 UTC m=+162.815771410 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:10:19.882323 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:10:19.882294    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6fwqv"
Jun 06 05:10:47.372615 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:10:47.372561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:10:47.373119 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:10:47.372713    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 06 05:10:47.373119 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:10:47.372778    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs podName:89665e91-1799-4a69-b55a-54c498846550 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:49.372760835 +0000 UTC m=+252.231822998 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs") pod "network-metrics-daemon-wv65h" (UID: "89665e91-1799-4a69-b55a-54c498846550") : secret "metrics-daemon-secret" not found
Jun 06 05:11:15.059547 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:15.059488    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-c9b496446-dgprz" podUID="d13314ee-5ca9-46e9-b13f-cb95c3519fca"
Jun 06 05:11:15.073887 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:15.073864    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9bbql" podUID="ef7708bc-ab15-44a8-8399-5da9076c0fd2"
Jun 06 05:11:15.083603 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:15.083578    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9bbql"
Jun 06 05:11:15.615741 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:15.615709    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wv65h" podUID="89665e91-1799-4a69-b55a-54c498846550"
Jun 06 05:11:20.002831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:20.002743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:11:20.002831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:20.002805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:11:20.003241 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:20.002897    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:11:20.003241 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:20.002902    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 05:11:20.003241 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:20.002918    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9b496446-dgprz: secret "image-registry-tls" not found
Jun 06 05:11:20.003241 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:20.002972    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls podName:ef7708bc-ab15-44a8-8399-5da9076c0fd2 nodeName:}" failed. No retries permitted until 2026-06-06 05:13:22.002954632 +0000 UTC m=+284.862016788 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls") pod "dns-default-9bbql" (UID: "ef7708bc-ab15-44a8-8399-5da9076c0fd2") : secret "dns-default-metrics-tls" not found
Jun 06 05:11:20.003241 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:20.002985    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls podName:d13314ee-5ca9-46e9-b13f-cb95c3519fca nodeName:}" failed. No retries permitted until 2026-06-06 05:13:22.002979902 +0000 UTC m=+284.862042057 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls") pod "image-registry-c9b496446-dgprz" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca") : secret "image-registry-tls" not found
Jun 06 05:11:27.594878 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:27.593177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:11:27.594878 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:27.593556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:11:54.835296 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.835222    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"]
Jun 06 05:11:54.840745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.840720    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"]
Jun 06 05:11:54.840884 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.840854    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:54.843602 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.843577    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"]
Jun 06 05:11:54.843753 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.843621    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sls42\""
Jun 06 05:11:54.843753 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.843625    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 06 05:11:54.843753 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.843621    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 06 05:11:54.843913 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.843858    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"
Jun 06 05:11:54.845984 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.845959    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gngxg\""
Jun 06 05:11:54.846707 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.846686    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c7d6c6877-lc882"]
Jun 06 05:11:54.846822 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.846771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:54.849153 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.849135    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 06 05:11:54.849410 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.849395    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"]
Jun 06 05:11:54.849479 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.849419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"]
Jun 06 05:11:54.849479 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.849431    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"]
Jun 06 05:11:54.849552 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.849486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:54.850354 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.850336    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xr7zj\""
Jun 06 05:11:54.850483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.850341    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 06 05:11:54.850483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.850410    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 06 05:11:54.850483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.850462    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 06 05:11:54.851741 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.851704    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 06 05:11:54.851899 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.851879    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 06 05:11:54.852042 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.852022    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 06 05:11:54.852120 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.852045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 06 05:11:54.852179 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.852034    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 06 05:11:54.852367 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.852346    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 06 05:11:54.852367 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.852429    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dqtrk\""
Jun 06 05:11:54.862756 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.862735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c7d6c6877-lc882"]
Jun 06 05:11:54.916691 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.916655    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"]
Jun 06 05:11:54.919695 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.919662    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"]
Jun 06 05:11:54.919824 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.919771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:54.922250 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.922228    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 06 05:11:54.922400 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.922328    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"]
Jun 06 05:11:54.922400 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.922326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 06 05:11:54.922400 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.922360    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:11:54.922554 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.922407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:54.922612 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.922596    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 06 05:11:54.922876 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.922858    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8kcpt\""
Jun 06 05:11:54.924792 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.924773    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-964x4\""
Jun 06 05:11:54.925167 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.925152    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 06 05:11:54.925250 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.925173    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 06 05:11:54.925470 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.925453    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 06 05:11:54.925563 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.925538    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:54.926378 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.926360    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:11:54.928248 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.928232    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-79r82\""
Jun 06 05:11:54.928355 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.928333    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 06 05:11:54.928355 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.928341    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:11:54.928669 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.928653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 06 05:11:54.930898 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.930878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"]
Jun 06 05:11:54.931771 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.931738    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"]
Jun 06 05:11:54.946397 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.946374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"]
Jun 06 05:11:54.948477 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:54.948635 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rc75\" (UniqueName: \"kubernetes.io/projected/c05531af-ac75-4cf5-b361-f3caf10728b7-kube-api-access-8rc75\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:54.948635 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:54.948759 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdf8j\" (UniqueName: \"kubernetes.io/projected/c1d2a316-1671-45af-b0a6-6332a51da69d-kube-api-access-rdf8j\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:54.948759 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:54.948844 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:54.948844 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/997e6d4e-8f92-42a7-8330-072e5148ead7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:54.948922 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s7tc\" (UniqueName: \"kubernetes.io/projected/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-kube-api-access-8s7tc\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:54.948922 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-config\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:54.949024 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.948972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjtk\" (UniqueName: \"kubernetes.io/projected/997e6d4e-8f92-42a7-8330-072e5148ead7-kube-api-access-7hjtk\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:54.949024 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-default-certificate\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:54.949110 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:54.949110 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:54.949218 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:54.949218 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-stats-auth\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:54.949218 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:54.949458 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mpbt\" (UniqueName: \"kubernetes.io/projected/614819d6-b20f-43ea-bd5b-d81e80b3d8ef-kube-api-access-7mpbt\") pod \"network-check-source-dbd9cf844-5m5s6\" (UID: \"614819d6-b20f-43ea-bd5b-d81e80b3d8ef\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"
Jun 06 05:11:54.949458 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:54.949458 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:54.949376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w96sr\" (UniqueName: \"kubernetes.io/projected/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-kube-api-access-w96sr\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.013899 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.013862    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"]
Jun 06 05:11:55.019210 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.019178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"
Jun 06 05:11:55.021963 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.021934    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 06 05:11:55.021963 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.021936    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:11:55.022177 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.022030    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ddg9p\""
Jun 06 05:11:55.023575 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.023551    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"]
Jun 06 05:11:55.050329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/997e6d4e-8f92-42a7-8330-072e5148ead7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:55.050518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s7tc\" (UniqueName: \"kubernetes.io/projected/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-kube-api-access-8s7tc\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:55.050518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-config\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.050518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjtk\" (UniqueName: \"kubernetes.io/projected/997e6d4e-8f92-42a7-8330-072e5148ead7-kube-api-access-7hjtk\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:55.050518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-default-certificate\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.050518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.050518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:55.050518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-stats-auth\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v72st\" (UniqueName: \"kubernetes.io/projected/d6611bec-45ff-437e-bbeb-d1c236a92c32-kube-api-access-v72st\") pod \"volume-data-source-validator-78dd696465-7ggnv\" (UID: \"d6611bec-45ff-437e-bbeb-d1c236a92c32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050665    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mpbt\" (UniqueName: \"kubernetes.io/projected/614819d6-b20f-43ea-bd5b-d81e80b3d8ef-kube-api-access-7mpbt\") pod \"network-check-source-dbd9cf844-5m5s6\" (UID: \"614819d6-b20f-43ea-bd5b-d81e80b3d8ef\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w96sr\" (UniqueName: \"kubernetes.io/projected/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-kube-api-access-w96sr\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050755    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rc75\" (UniqueName: \"kubernetes.io/projected/c05531af-ac75-4cf5-b361-f3caf10728b7-kube-api-access-8rc75\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdf8j\" (UniqueName: \"kubernetes.io/projected/c1d2a316-1671-45af-b0a6-6332a51da69d-kube-api-access-rdf8j\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.050839    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 05:11:55.050875 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.050902    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls podName:997e6d4e-8f92-42a7-8330-072e5148ead7 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:55.550884426 +0000 UTC m=+198.409946601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7mcd8" (UID: "997e6d4e-8f92-42a7-8330-072e5148ead7") : secret "cluster-monitoring-operator-tls" not found
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.050998    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-config\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.051113    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.051147    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/997e6d4e-8f92-42a7-8330-072e5148ead7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.051174    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.051198    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:11:55.55116462 +0000 UTC m=+198.410226782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : secret "router-metrics-certs-default" not found
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.051239    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert podName:19f77e19-1efe-4ed5-a9bb-b3e2b561c16b nodeName:}" failed. No retries permitted until 2026-06-06 05:11:55.551222099 +0000 UTC m=+198.410284259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bkwl8" (UID: "19f77e19-1efe-4ed5-a9bb-b3e2b561c16b") : secret "networking-console-plugin-cert" not found
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.051263    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:11:55.551251605 +0000 UTC m=+198.410313791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : configmap references non-existent config key: service-ca.crt
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.051312    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 06 05:11:55.051628 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.051348    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls podName:c05531af-ac75-4cf5-b361-f3caf10728b7 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:55.55133788 +0000 UTC m=+198.410400058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ffdh5" (UID: "c05531af-ac75-4cf5-b361-f3caf10728b7") : secret "samples-operator-tls" not found
Jun 06 05:11:55.052198 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.051827    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:55.052198 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.051925    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:55.053245 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.053221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:55.053427 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.053410    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.053486 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.053449    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-default-certificate\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.053551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.053537    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-stats-auth\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.071487 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.071463    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w96sr\" (UniqueName: \"kubernetes.io/projected/b5e2c96a-5c24-4ce9-99fd-1afcff47a06b-kube-api-access-w96sr\") pod \"service-ca-operator-6bc5ff68f5-b8rcn\" (UID: \"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.071792 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.071760    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s7tc\" (UniqueName: \"kubernetes.io/projected/419fcb35-bfbc-47e2-95e9-a8cdbaaf799b-kube-api-access-8s7tc\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-jj47z\" (UID: \"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:55.071897 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.071864    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rc75\" (UniqueName: \"kubernetes.io/projected/c05531af-ac75-4cf5-b361-f3caf10728b7-kube-api-access-8rc75\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:55.072042 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.072020    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjtk\" (UniqueName: \"kubernetes.io/projected/997e6d4e-8f92-42a7-8330-072e5148ead7-kube-api-access-7hjtk\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:55.072316 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.072300    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdf8j\" (UniqueName: \"kubernetes.io/projected/c1d2a316-1671-45af-b0a6-6332a51da69d-kube-api-access-rdf8j\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.072316 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.072305    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mpbt\" (UniqueName: \"kubernetes.io/projected/614819d6-b20f-43ea-bd5b-d81e80b3d8ef-kube-api-access-7mpbt\") pod \"network-check-source-dbd9cf844-5m5s6\" (UID: \"614819d6-b20f-43ea-bd5b-d81e80b3d8ef\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"
Jun 06 05:11:55.152287 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.152175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v72st\" (UniqueName: \"kubernetes.io/projected/d6611bec-45ff-437e-bbeb-d1c236a92c32-kube-api-access-v72st\") pod \"volume-data-source-validator-78dd696465-7ggnv\" (UID: \"d6611bec-45ff-437e-bbeb-d1c236a92c32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"
Jun 06 05:11:55.158667 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.158642    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"
Jun 06 05:11:55.159610 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.159589    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v72st\" (UniqueName: \"kubernetes.io/projected/d6611bec-45ff-437e-bbeb-d1c236a92c32-kube-api-access-v72st\") pod \"volume-data-source-validator-78dd696465-7ggnv\" (UID: \"d6611bec-45ff-437e-bbeb-d1c236a92c32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"
Jun 06 05:11:55.230095 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.230067    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"
Jun 06 05:11:55.237580 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.237548    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"
Jun 06 05:11:55.285731 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.284072    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6"]
Jun 06 05:11:55.288535 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:11:55.288506    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614819d6_b20f_43ea_bd5b_d81e80b3d8ef.slice/crio-bdf9b422ec19bf2146503b80366d571a8062a50eb4cf5f1da5c8fbca3eea7b9f WatchSource:0}: Error finding container bdf9b422ec19bf2146503b80366d571a8062a50eb4cf5f1da5c8fbca3eea7b9f: Status 404 returned error can't find the container with id bdf9b422ec19bf2146503b80366d571a8062a50eb4cf5f1da5c8fbca3eea7b9f
Jun 06 05:11:55.328500 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.328477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"
Jun 06 05:11:55.364895 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.364861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn"]
Jun 06 05:11:55.369140 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:11:55.369109    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e2c96a_5c24_4ce9_99fd_1afcff47a06b.slice/crio-2aa7282b3d8afe90066d80731167c7d009c5b434febb1a2b923ea41de6394d57 WatchSource:0}: Error finding container 2aa7282b3d8afe90066d80731167c7d009c5b434febb1a2b923ea41de6394d57: Status 404 returned error can't find the container with id 2aa7282b3d8afe90066d80731167c7d009c5b434febb1a2b923ea41de6394d57
Jun 06 05:11:55.386734 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.386701    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z"]
Jun 06 05:11:55.390525 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:11:55.390485    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419fcb35_bfbc_47e2_95e9_a8cdbaaf799b.slice/crio-8e8dfc95d9e4c427424cab293a276a3f3d423fa619c356eadf41adea9d7c5746 WatchSource:0}: Error finding container 8e8dfc95d9e4c427424cab293a276a3f3d423fa619c356eadf41adea9d7c5746: Status 404 returned error can't find the container with id 8e8dfc95d9e4c427424cab293a276a3f3d423fa619c356eadf41adea9d7c5746
Jun 06 05:11:55.457163 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.457133    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv"]
Jun 06 05:11:55.459964 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:11:55.459941    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6611bec_45ff_437e_bbeb_d1c236a92c32.slice/crio-a3d7c944a331b7aa3871e3924750c7c8024dc09db17f9b8c0a5d44f3df9f0e8b WatchSource:0}: Error finding container a3d7c944a331b7aa3871e3924750c7c8024dc09db17f9b8c0a5d44f3df9f0e8b: Status 404 returned error can't find the container with id a3d7c944a331b7aa3871e3924750c7c8024dc09db17f9b8c0a5d44f3df9f0e8b
Jun 06 05:11:55.555074 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.555045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:55.555243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.555087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:55.555243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.555109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.555243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.555162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:55.555243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:55.555180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:55.555243 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555213    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555215    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555301    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls podName:c05531af-ac75-4cf5-b361-f3caf10728b7 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:56.555280601 +0000 UTC m=+199.414342771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ffdh5" (UID: "c05531af-ac75-4cf5-b361-f3caf10728b7") : secret "samples-operator-tls" not found
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555314    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555320    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:11:56.555311165 +0000 UTC m=+199.414373325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : configmap references non-existent config key: service-ca.crt
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555327    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555349    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert podName:19f77e19-1efe-4ed5-a9bb-b3e2b561c16b nodeName:}" failed. No retries permitted until 2026-06-06 05:11:56.555330129 +0000 UTC m=+199.414392291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bkwl8" (UID: "19f77e19-1efe-4ed5-a9bb-b3e2b561c16b") : secret "networking-console-plugin-cert" not found
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555368    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:11:56.555357853 +0000 UTC m=+199.414420012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : secret "router-metrics-certs-default" not found
Jun 06 05:11:55.555467 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:55.555384    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls podName:997e6d4e-8f92-42a7-8330-072e5148ead7 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:56.555375751 +0000 UTC m=+199.414437912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7mcd8" (UID: "997e6d4e-8f92-42a7-8330-072e5148ead7") : secret "cluster-monitoring-operator-tls" not found
Jun 06 05:11:56.181027 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.180936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv" event={"ID":"d6611bec-45ff-437e-bbeb-d1c236a92c32","Type":"ContainerStarted","Data":"a3d7c944a331b7aa3871e3924750c7c8024dc09db17f9b8c0a5d44f3df9f0e8b"}
Jun 06 05:11:56.184615 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.184551    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn" event={"ID":"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b","Type":"ContainerStarted","Data":"2aa7282b3d8afe90066d80731167c7d009c5b434febb1a2b923ea41de6394d57"}
Jun 06 05:11:56.186285 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.186237    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6" event={"ID":"614819d6-b20f-43ea-bd5b-d81e80b3d8ef","Type":"ContainerStarted","Data":"53293288a4b2ecc98351ee5daed84c77dc6a8f15389ea48c32682af445f7a8d5"}
Jun 06 05:11:56.186394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.186298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6" event={"ID":"614819d6-b20f-43ea-bd5b-d81e80b3d8ef","Type":"ContainerStarted","Data":"bdf9b422ec19bf2146503b80366d571a8062a50eb4cf5f1da5c8fbca3eea7b9f"}
Jun 06 05:11:56.188208 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.188156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z" event={"ID":"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b","Type":"ContainerStarted","Data":"8e8dfc95d9e4c427424cab293a276a3f3d423fa619c356eadf41adea9d7c5746"}
Jun 06 05:11:56.203050 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.201899    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5m5s6" podStartSLOduration=2.201881839 podStartE2EDuration="2.201881839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:11:56.201208013 +0000 UTC m=+199.060270192" watchObservedRunningTime="2026-06-06 05:11:56.201881839 +0000 UTC m=+199.060944018"
Jun 06 05:11:56.564760 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.564669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:56.564930 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.564771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:56.564930 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.564801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:56.564930 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.564874    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:11:58.56485513 +0000 UTC m=+201.423917305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : configmap references non-existent config key: service-ca.crt
Jun 06 05:11:56.564930 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.564904    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 05:11:56.565159 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.564940    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls podName:997e6d4e-8f92-42a7-8330-072e5148ead7 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:58.564928339 +0000 UTC m=+201.423990494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7mcd8" (UID: "997e6d4e-8f92-42a7-8330-072e5148ead7") : secret "cluster-monitoring-operator-tls" not found
Jun 06 05:11:56.565159 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.564935    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 05:11:56.565159 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.564987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:56.565159 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.565007    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:11:58.564985845 +0000 UTC m=+201.424048018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : secret "router-metrics-certs-default" not found
Jun 06 05:11:56.565159 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.565041    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 06 05:11:56.565159 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.565074    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls podName:c05531af-ac75-4cf5-b361-f3caf10728b7 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:58.565064041 +0000 UTC m=+201.424126220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ffdh5" (UID: "c05531af-ac75-4cf5-b361-f3caf10728b7") : secret "samples-operator-tls" not found
Jun 06 05:11:56.565159 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:56.565072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:56.565539 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.565170    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 05:11:56.565539 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:56.565211    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert podName:19f77e19-1efe-4ed5-a9bb-b3e2b561c16b nodeName:}" failed. No retries permitted until 2026-06-06 05:11:58.565196592 +0000 UTC m=+201.424258750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bkwl8" (UID: "19f77e19-1efe-4ed5-a9bb-b3e2b561c16b") : secret "networking-console-plugin-cert" not found
Jun 06 05:11:57.193072 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:57.193029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv" event={"ID":"d6611bec-45ff-437e-bbeb-d1c236a92c32","Type":"ContainerStarted","Data":"fb8038ec64128d958954a15c078cb69fca09ee37b41a089ef918d341291672ce"}
Jun 06 05:11:57.208443 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:57.208395    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-7ggnv" podStartSLOduration=1.910747031 podStartE2EDuration="3.208375052s" totalImagesPullingTime="1.297628021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:11:57.207581963 +0000 UTC m=+200.066644146" watchObservedRunningTime="2026-06-06 05:11:57.208375052 +0000 UTC m=+200.067437230"
Jun 06 05:11:58.197926 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.197890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z" event={"ID":"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b","Type":"ContainerStarted","Data":"ae3aa127d60fd64c042c803b8f3ab02c239ca411bcc5a03156ed8db5278587a6"}
Jun 06 05:11:58.199336 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.199302    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn" event={"ID":"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b","Type":"ContainerStarted","Data":"323759b3e02bd44b0abc7f6593ca10dd3ced0d8920d6dbbfed0c33dd378d8a15"}
Jun 06 05:11:58.212707 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.212653    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z" podStartSLOduration=1.623064049 podStartE2EDuration="4.21263989s" totalImagesPullingTime="2.589575841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:11:58.211906302 +0000 UTC m=+201.070968482" watchObservedRunningTime="2026-06-06 05:11:58.21263989 +0000 UTC m=+201.071702066"
Jun 06 05:11:58.225677 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.225560    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn" podStartSLOduration=1.6183936399999999 podStartE2EDuration="4.225542189s" totalImagesPullingTime="2.607148549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:11:58.225341079 +0000 UTC m=+201.084403247" watchObservedRunningTime="2026-06-06 05:11:58.225542189 +0000 UTC m=+201.084604368"
Jun 06 05:11:58.581903 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.581797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:11:58.581903 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.581860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:11:58.581903 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.581891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.581962    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.581996    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.581967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.582042    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls podName:c05531af-ac75-4cf5-b361-f3caf10728b7 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:02.582021174 +0000 UTC m=+205.441083331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ffdh5" (UID: "c05531af-ac75-4cf5-b361-f3caf10728b7") : secret "samples-operator-tls" not found
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.582050    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.582107    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert podName:19f77e19-1efe-4ed5-a9bb-b3e2b561c16b nodeName:}" failed. No retries permitted until 2026-06-06 05:12:02.582091135 +0000 UTC m=+205.441153293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bkwl8" (UID: "19f77e19-1efe-4ed5-a9bb-b3e2b561c16b") : secret "networking-console-plugin-cert" not found
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.582127    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:12:02.582117035 +0000 UTC m=+205.441179193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : secret "router-metrics-certs-default" not found
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.582153    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:12:02.582143779 +0000 UTC m=+205.441205958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : configmap references non-existent config key: service-ca.crt
Jun 06 05:11:58.582190 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:11:58.582172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:11:58.582544 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.582317    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 05:11:58.582544 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:11:58.582379    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls podName:997e6d4e-8f92-42a7-8330-072e5148ead7 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:02.582363699 +0000 UTC m=+205.441425859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7mcd8" (UID: "997e6d4e-8f92-42a7-8330-072e5148ead7") : secret "cluster-monitoring-operator-tls" not found
Jun 06 05:12:00.514737 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:00.514710    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dhtw_85238ec9-ad65-4dcb-a789-d83c9861f21b/dns-node-resolver/0.log"
Jun 06 05:12:01.314996 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.314969    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7k9lr_f040a8fe-109d-4355-abd6-5d1ee6101544/node-ca/0.log"
Jun 06 05:12:01.882511 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.882468    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-lxk7f"]
Jun 06 05:12:01.886415 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.886396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:01.888975 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.888948    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 06 05:12:01.889106 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.888954    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vsltq\""
Jun 06 05:12:01.889106 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.889003    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 06 05:12:01.890127 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.890107    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 06 05:12:01.890371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.890354    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 06 05:12:01.893758 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.893734    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-lxk7f"]
Jun 06 05:12:01.912363 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.912342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b31a9999-5320-4777-9d7c-5ca31a60915c-signing-key\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:01.912459 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.912386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b31a9999-5320-4777-9d7c-5ca31a60915c-signing-cabundle\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:01.912459 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:01.912416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5rt\" (UniqueName: \"kubernetes.io/projected/b31a9999-5320-4777-9d7c-5ca31a60915c-kube-api-access-gm5rt\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.013376 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.013340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b31a9999-5320-4777-9d7c-5ca31a60915c-signing-key\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.013540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.013401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b31a9999-5320-4777-9d7c-5ca31a60915c-signing-cabundle\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.013594 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.013572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5rt\" (UniqueName: \"kubernetes.io/projected/b31a9999-5320-4777-9d7c-5ca31a60915c-kube-api-access-gm5rt\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.014107 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.014083    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b31a9999-5320-4777-9d7c-5ca31a60915c-signing-cabundle\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.015833 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.015814    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b31a9999-5320-4777-9d7c-5ca31a60915c-signing-key\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.021570 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.021546    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5rt\" (UniqueName: \"kubernetes.io/projected/b31a9999-5320-4777-9d7c-5ca31a60915c-kube-api-access-gm5rt\") pod \"service-ca-7d74d578b8-lxk7f\" (UID: \"b31a9999-5320-4777-9d7c-5ca31a60915c\") " pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.195595 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.195503    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f"
Jun 06 05:12:02.315852 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.315820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-lxk7f"]
Jun 06 05:12:02.318846 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:02.318822    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31a9999_5320_4777_9d7c_5ca31a60915c.slice/crio-eb1adc53fb5321f18bb4c26a7719750d6c6b7aafc8d8c9f6b022f48e1a15dac4 WatchSource:0}: Error finding container eb1adc53fb5321f18bb4c26a7719750d6c6b7aafc8d8c9f6b022f48e1a15dac4: Status 404 returned error can't find the container with id eb1adc53fb5321f18bb4c26a7719750d6c6b7aafc8d8c9f6b022f48e1a15dac4
Jun 06 05:12:02.516164 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.516090    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shh2l_a0b76e14-9df2-4368-a311-ec3991bc389c/serve-healthcheck-canary/0.log"
Jun 06 05:12:02.618296 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.618248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:12:02.618465 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.618306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:12:02.618465 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.618335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:02.618465 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.618386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:02.618465 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:02.618408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:12:02.618465 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618411    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618466    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618482    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls podName:c05531af-ac75-4cf5-b361-f3caf10728b7 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:10.61846048 +0000 UTC m=+213.477522653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-ffdh5" (UID: "c05531af-ac75-4cf5-b361-f3caf10728b7") : secret "samples-operator-tls" not found
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618495    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618496    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618501    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:12:10.618491367 +0000 UTC m=+213.477553525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : configmap references non-existent config key: service-ca.crt
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618567    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert podName:19f77e19-1efe-4ed5-a9bb-b3e2b561c16b nodeName:}" failed. No retries permitted until 2026-06-06 05:12:10.618550462 +0000 UTC m=+213.477612632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bkwl8" (UID: "19f77e19-1efe-4ed5-a9bb-b3e2b561c16b") : secret "networking-console-plugin-cert" not found
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618583    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls podName:997e6d4e-8f92-42a7-8330-072e5148ead7 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:10.618573503 +0000 UTC m=+213.477635666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7mcd8" (UID: "997e6d4e-8f92-42a7-8330-072e5148ead7") : secret "cluster-monitoring-operator-tls" not found
Jun 06 05:12:02.618668 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:02.618602    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs podName:c1d2a316-1671-45af-b0a6-6332a51da69d nodeName:}" failed. No retries permitted until 2026-06-06 05:12:10.618592294 +0000 UTC m=+213.477654455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs") pod "router-default-6c7d6c6877-lc882" (UID: "c1d2a316-1671-45af-b0a6-6332a51da69d") : secret "router-metrics-certs-default" not found
Jun 06 05:12:03.214885 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:03.214847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f" event={"ID":"b31a9999-5320-4777-9d7c-5ca31a60915c","Type":"ContainerStarted","Data":"38e0dd7c96e2c2b6775dd9db6ca69c149938edb38b145661f543c3cfe57d53ff"}
Jun 06 05:12:03.215263 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:03.214903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f" event={"ID":"b31a9999-5320-4777-9d7c-5ca31a60915c","Type":"ContainerStarted","Data":"eb1adc53fb5321f18bb4c26a7719750d6c6b7aafc8d8c9f6b022f48e1a15dac4"}
Jun 06 05:12:03.233412 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:03.233360    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-lxk7f" podStartSLOduration=2.233335183 podStartE2EDuration="2.233335183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:03.232985469 +0000 UTC m=+206.092047648" watchObservedRunningTime="2026-06-06 05:12:03.233335183 +0000 UTC m=+206.092397359"
Jun 06 05:12:10.688795 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.688750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:10.689329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.688809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:12:10.689329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.688879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:12:10.689329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.688920    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:12:10.689329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.688947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:10.689329 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:10.689065    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 05:12:10.689329 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:10.689161    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert podName:19f77e19-1efe-4ed5-a9bb-b3e2b561c16b nodeName:}" failed. No retries permitted until 2026-06-06 05:12:26.689135724 +0000 UTC m=+229.548197897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-bkwl8" (UID: "19f77e19-1efe-4ed5-a9bb-b3e2b561c16b") : secret "networking-console-plugin-cert" not found
Jun 06 05:12:10.689740 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.689717    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1d2a316-1671-45af-b0a6-6332a51da69d-service-ca-bundle\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:10.691493 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.691469    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/997e6d4e-8f92-42a7-8330-072e5148ead7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7mcd8\" (UID: \"997e6d4e-8f92-42a7-8330-072e5148ead7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:12:10.692091 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.692062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1d2a316-1671-45af-b0a6-6332a51da69d-metrics-certs\") pod \"router-default-6c7d6c6877-lc882\" (UID: \"c1d2a316-1671-45af-b0a6-6332a51da69d\") " pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:10.692196 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.692062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c05531af-ac75-4cf5-b361-f3caf10728b7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-ffdh5\" (UID: \"c05531af-ac75-4cf5-b361-f3caf10728b7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:12:10.765374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.765327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"
Jun 06 05:12:10.770012 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.769968    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:10.841868 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.841839    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"
Jun 06 05:12:10.909091 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.909003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8"]
Jun 06 05:12:10.912628 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:10.911467    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997e6d4e_8f92_42a7_8330_072e5148ead7.slice/crio-ecb46765d782c24690fda742d4c0077df5c5a22ff0a3d0a57383bbc601b69582 WatchSource:0}: Error finding container ecb46765d782c24690fda742d4c0077df5c5a22ff0a3d0a57383bbc601b69582: Status 404 returned error can't find the container with id ecb46765d782c24690fda742d4c0077df5c5a22ff0a3d0a57383bbc601b69582
Jun 06 05:12:10.928994 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.928965    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c7d6c6877-lc882"]
Jun 06 05:12:10.932126 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:10.932103    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d2a316_1671_45af_b0a6_6332a51da69d.slice/crio-266c349f6d9808227a6710b927ebffe221d1980202b0a2eca16639c052541173 WatchSource:0}: Error finding container 266c349f6d9808227a6710b927ebffe221d1980202b0a2eca16639c052541173: Status 404 returned error can't find the container with id 266c349f6d9808227a6710b927ebffe221d1980202b0a2eca16639c052541173
Jun 06 05:12:10.980831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:10.980808    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5"]
Jun 06 05:12:11.240553 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:11.240456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c7d6c6877-lc882" event={"ID":"c1d2a316-1671-45af-b0a6-6332a51da69d","Type":"ContainerStarted","Data":"cba4625685a3b27a87bc27d5f2f394645fda4d397d42e66e4cef196fbf9ba1a1"}
Jun 06 05:12:11.240701 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:11.240556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c7d6c6877-lc882" event={"ID":"c1d2a316-1671-45af-b0a6-6332a51da69d","Type":"ContainerStarted","Data":"266c349f6d9808227a6710b927ebffe221d1980202b0a2eca16639c052541173"}
Jun 06 05:12:11.241583 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:11.241553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5" event={"ID":"c05531af-ac75-4cf5-b361-f3caf10728b7","Type":"ContainerStarted","Data":"a6194df27e2a0f513b29466d8b9d0e300b1abd27ffef5d2ad11a707b3f1aa7fa"}
Jun 06 05:12:11.242514 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:11.242489    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8" event={"ID":"997e6d4e-8f92-42a7-8330-072e5148ead7","Type":"ContainerStarted","Data":"ecb46765d782c24690fda742d4c0077df5c5a22ff0a3d0a57383bbc601b69582"}
Jun 06 05:12:11.260657 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:11.260607    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c7d6c6877-lc882" podStartSLOduration=17.260592059 podStartE2EDuration="17.260592059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:11.259207631 +0000 UTC m=+214.118269808" watchObservedRunningTime="2026-06-06 05:12:11.260592059 +0000 UTC m=+214.119654236"
Jun 06 05:12:11.770613 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:11.770569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:11.773372 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:11.773336    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:12.246097 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:12.246068    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:12.247473 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:12.247445    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c7d6c6877-lc882"
Jun 06 05:12:13.251404 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:13.251374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8" event={"ID":"997e6d4e-8f92-42a7-8330-072e5148ead7","Type":"ContainerStarted","Data":"c1be52b2492ae0429b02741062b363edda56ffa386ccff37d259c968e3d00256"}
Jun 06 05:12:13.253625 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:13.253597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5" event={"ID":"c05531af-ac75-4cf5-b361-f3caf10728b7","Type":"ContainerStarted","Data":"50344491bc95b38079f93d46cf2644259125023df5b373960a9e9bb033de41ee"}
Jun 06 05:12:13.253750 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:13.253658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5" event={"ID":"c05531af-ac75-4cf5-b361-f3caf10728b7","Type":"ContainerStarted","Data":"02e4a47f8f639c682806bf33d366f58fa7e4319a06c974fbaf7a9ade29928727"}
Jun 06 05:12:13.266846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:13.266801    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7mcd8" podStartSLOduration=17.113174698 podStartE2EDuration="19.266787027s" totalImagesPullingTime="2.153612329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:13.265444164 +0000 UTC m=+216.124506340" watchObservedRunningTime="2026-06-06 05:12:13.266787027 +0000 UTC m=+216.125849203"
Jun 06 05:12:13.280090 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:13.280039    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-ffdh5" podStartSLOduration=17.251652792 podStartE2EDuration="19.280021696s" totalImagesPullingTime="2.028368904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:13.279366962 +0000 UTC m=+216.138429138" watchObservedRunningTime="2026-06-06 05:12:13.280021696 +0000 UTC m=+216.139083876"
Jun 06 05:12:23.182880 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.182845    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rjz5x"]
Jun 06 05:12:23.186437 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.186417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.190600 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.190574    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 06 05:12:23.190721 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.190579    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p7ddh\""
Jun 06 05:12:23.190721 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.190700    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 06 05:12:23.190828 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.190784    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 06 05:12:23.190892 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.190842    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 06 05:12:23.198344 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.198323    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjz5x"]
Jun 06 05:12:23.233828 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.233798    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-pw8h6"]
Jun 06 05:12:23.236601 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.236580    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-pw8h6"
Jun 06 05:12:23.236791 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.236769    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"]
Jun 06 05:12:23.239229 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.239211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"
Jun 06 05:12:23.239401 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.239380    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 06 05:12:23.239489 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.239391    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 06 05:12:23.239489 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.239445    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gr42c\""
Jun 06 05:12:23.241518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.241502    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 06 05:12:23.241930 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.241910    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mwk98\""
Jun 06 05:12:23.246985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.246966    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-pw8h6"]
Jun 06 05:12:23.259693 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.259667    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"]
Jun 06 05:12:23.298204 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.298175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-data-volume\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.298353 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.298217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.298353 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.298302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.298353 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.298335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9sfj\" (UniqueName: \"kubernetes.io/projected/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-kube-api-access-r9sfj\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.298504 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.298360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-crio-socket\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399358 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9sfj\" (UniqueName: \"kubernetes.io/projected/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-kube-api-access-r9sfj\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-crio-socket\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnlkg\" (UniqueName: \"kubernetes.io/projected/6f86cb5a-b428-490b-a095-268c383ec622-kube-api-access-dnlkg\") pod \"downloads-6657875f97-pw8h6\" (UID: \"6f86cb5a-b428-490b-a095-268c383ec622\") " pod="openshift-console/downloads-6657875f97-pw8h6"
Jun 06 05:12:23.399555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9154828d-1203-4b78-a1a8-604fa4664f52-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9bl7l\" (UID: \"9154828d-1203-4b78-a1a8-604fa4664f52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"
Jun 06 05:12:23.399763 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399556    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-crio-socket\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399763 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-data-volume\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399890 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399870    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-data-volume\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.399977 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.399960    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.401641 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.401613    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.408046 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.408027    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9sfj\" (UniqueName: \"kubernetes.io/projected/ec6615a8-aef3-4ccb-ac78-8ad03cf584c7-kube-api-access-r9sfj\") pod \"insights-runtime-extractor-rjz5x\" (UID: \"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7\") " pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.495503 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.495415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjz5x"
Jun 06 05:12:23.500532 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.500513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnlkg\" (UniqueName: \"kubernetes.io/projected/6f86cb5a-b428-490b-a095-268c383ec622-kube-api-access-dnlkg\") pod \"downloads-6657875f97-pw8h6\" (UID: \"6f86cb5a-b428-490b-a095-268c383ec622\") " pod="openshift-console/downloads-6657875f97-pw8h6"
Jun 06 05:12:23.500667 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.500541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9154828d-1203-4b78-a1a8-604fa4664f52-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9bl7l\" (UID: \"9154828d-1203-4b78-a1a8-604fa4664f52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"
Jun 06 05:12:23.504096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.504065    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9154828d-1203-4b78-a1a8-604fa4664f52-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9bl7l\" (UID: \"9154828d-1203-4b78-a1a8-604fa4664f52\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"
Jun 06 05:12:23.510703 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.510683    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnlkg\" (UniqueName: \"kubernetes.io/projected/6f86cb5a-b428-490b-a095-268c383ec622-kube-api-access-dnlkg\") pod \"downloads-6657875f97-pw8h6\" (UID: \"6f86cb5a-b428-490b-a095-268c383ec622\") " pod="openshift-console/downloads-6657875f97-pw8h6"
Jun 06 05:12:23.549562 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.549357    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-pw8h6"
Jun 06 05:12:23.553822 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.553805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"
Jun 06 05:12:23.645226 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.645193    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjz5x"]
Jun 06 05:12:23.707473 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.707447    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-pw8h6"]
Jun 06 05:12:23.710006 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:23.709981    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f86cb5a_b428_490b_a095_268c383ec622.slice/crio-d7aff2b89e21cf6f8faa8603a67b166d0dc46cd79dbfd6811aaa7e8e9c0c9dba WatchSource:0}: Error finding container d7aff2b89e21cf6f8faa8603a67b166d0dc46cd79dbfd6811aaa7e8e9c0c9dba: Status 404 returned error can't find the container with id d7aff2b89e21cf6f8faa8603a67b166d0dc46cd79dbfd6811aaa7e8e9c0c9dba
Jun 06 05:12:23.727942 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:23.727913    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"]
Jun 06 05:12:23.730876 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:23.730847    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9154828d_1203_4b78_a1a8_604fa4664f52.slice/crio-46f57bdd8381cf9e5270c5422849923c159a182ea4a40a49e58a5c5bf8eaf9ea WatchSource:0}: Error finding container 46f57bdd8381cf9e5270c5422849923c159a182ea4a40a49e58a5c5bf8eaf9ea: Status 404 returned error can't find the container with id 46f57bdd8381cf9e5270c5422849923c159a182ea4a40a49e58a5c5bf8eaf9ea
Jun 06 05:12:24.290655 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:24.290620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l" event={"ID":"9154828d-1203-4b78-a1a8-604fa4664f52","Type":"ContainerStarted","Data":"46f57bdd8381cf9e5270c5422849923c159a182ea4a40a49e58a5c5bf8eaf9ea"}
Jun 06 05:12:24.291871 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:24.291839    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-pw8h6" event={"ID":"6f86cb5a-b428-490b-a095-268c383ec622","Type":"ContainerStarted","Data":"d7aff2b89e21cf6f8faa8603a67b166d0dc46cd79dbfd6811aaa7e8e9c0c9dba"}
Jun 06 05:12:24.293472 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:24.293434    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjz5x" event={"ID":"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7","Type":"ContainerStarted","Data":"fbc8867ff555bd1aedfb4ccee8545caf6f745cd5140c775b466615ffa8d2cc90"}
Jun 06 05:12:24.293605 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:24.293497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjz5x" event={"ID":"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7","Type":"ContainerStarted","Data":"3d3ec06a55f52ab2904b3d4b8c1e23739589b6bcfd4a18232ff0a6703072daca"}
Jun 06 05:12:25.299170 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:25.299125    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l" event={"ID":"9154828d-1203-4b78-a1a8-604fa4664f52","Type":"ContainerStarted","Data":"3410d3ab7377903657249b073308f13feec05fe47cd0b10d3420ae4ae0e841d1"}
Jun 06 05:12:25.299763 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:25.299559    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"
Jun 06 05:12:25.301839 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:25.301804    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjz5x" event={"ID":"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7","Type":"ContainerStarted","Data":"df84d61051ed70a48e034b1245cfd6b7cb1e754bde237c08877c553581c25061"}
Jun 06 05:12:25.305324 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:25.305302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l"
Jun 06 05:12:25.314225 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:25.314174    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9bl7l" podStartSLOduration=1.3162131879999999 podStartE2EDuration="2.314160386s" totalImagesPullingTime="997.947198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:25.312555265 +0000 UTC m=+228.171617442" watchObservedRunningTime="2026-06-06 05:12:25.314160386 +0000 UTC m=+228.173222562"
Jun 06 05:12:26.306693 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:26.306602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjz5x" event={"ID":"ec6615a8-aef3-4ccb-ac78-8ad03cf584c7","Type":"ContainerStarted","Data":"733b0a94fcfe0e1f6d9fe45b8d81e0514bb68b349b1a1da87ebacf40fde8f2a1"}
Jun 06 05:12:26.323014 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:26.322961    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rjz5x" podStartSLOduration=1.233189147 podStartE2EDuration="3.322943126s" totalImagesPullingTime="2.089753979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:12:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:26.321960077 +0000 UTC m=+229.181022254" watchObservedRunningTime="2026-06-06 05:12:26.322943126 +0000 UTC m=+229.182005303"
Jun 06 05:12:26.731428 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:26.731391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:12:26.734066 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:26.734038    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19f77e19-1efe-4ed5-a9bb-b3e2b561c16b-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-bkwl8\" (UID: \"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:12:26.952160 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:26.952120    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"
Jun 06 05:12:27.102981 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.102945    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8"]
Jun 06 05:12:27.106357 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:27.106311    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f77e19_1efe_4ed5_a9bb_b3e2b561c16b.slice/crio-1d9b54d84511f847de50f58b0dcf47cc9b84dcc53ac0003b3bcceb5c5326f38d WatchSource:0}: Error finding container 1d9b54d84511f847de50f58b0dcf47cc9b84dcc53ac0003b3bcceb5c5326f38d: Status 404 returned error can't find the container with id 1d9b54d84511f847de50f58b0dcf47cc9b84dcc53ac0003b3bcceb5c5326f38d
Jun 06 05:12:27.154344 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.154302    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76b6dbb575-dwwjw"]
Jun 06 05:12:27.158861 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.158838    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.161313 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.161287    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvmzr\""
Jun 06 05:12:27.161438 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.161351    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 06 05:12:27.162653 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.162348    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 06 05:12:27.162653 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.162456    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 06 05:12:27.162653 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.162489    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 06 05:12:27.162653 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.162557    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 06 05:12:27.167115 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.166994    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 06 05:12:27.169256 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.169232    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b6dbb575-dwwjw"]
Jun 06 05:12:27.236327 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.236296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-serving-cert\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.236327 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.236327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-oauth-serving-cert\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.236546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.236352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-trusted-ca-bundle\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.236546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.236443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-service-ca\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.236546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.236512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-console-config\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.236657 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.236559    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7npcf\" (UniqueName: \"kubernetes.io/projected/9e4193ce-d3da-4de1-924b-460ac425705c-kube-api-access-7npcf\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.236657 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.236592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-oauth-config\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.312366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.312260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8" event={"ID":"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b","Type":"ContainerStarted","Data":"1d9b54d84511f847de50f58b0dcf47cc9b84dcc53ac0003b3bcceb5c5326f38d"}
Jun 06 05:12:27.337586 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.337556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-service-ca\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.337774 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.337609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-console-config\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.337847 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.337766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7npcf\" (UniqueName: \"kubernetes.io/projected/9e4193ce-d3da-4de1-924b-460ac425705c-kube-api-access-7npcf\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.337847 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.337819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-oauth-config\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.337956 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.337901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-serving-cert\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.337956 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.337928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-oauth-serving-cert\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.338043 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.337966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-trusted-ca-bundle\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.338831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.338435    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-console-config\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.338831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.338483    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-service-ca\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.338831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.338801    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-trusted-ca-bundle\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.338831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.338801    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-oauth-serving-cert\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.340719 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.340697    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-serving-cert\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.340946 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.340929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-oauth-config\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.357423 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.357400    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7npcf\" (UniqueName: \"kubernetes.io/projected/9e4193ce-d3da-4de1-924b-460ac425705c-kube-api-access-7npcf\") pod \"console-76b6dbb575-dwwjw\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") " pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.470988 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.470946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:27.613880 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:27.613846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76b6dbb575-dwwjw"]
Jun 06 05:12:27.617284 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:27.617244    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4193ce_d3da_4de1_924b_460ac425705c.slice/crio-88f8f75a5d3b27b8e45b7e9d5e6405f7c2682da44af7be75ef567f00d8355aae WatchSource:0}: Error finding container 88f8f75a5d3b27b8e45b7e9d5e6405f7c2682da44af7be75ef567f00d8355aae: Status 404 returned error can't find the container with id 88f8f75a5d3b27b8e45b7e9d5e6405f7c2682da44af7be75ef567f00d8355aae
Jun 06 05:12:28.318157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:28.318124    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b6dbb575-dwwjw" event={"ID":"9e4193ce-d3da-4de1-924b-460ac425705c","Type":"ContainerStarted","Data":"88f8f75a5d3b27b8e45b7e9d5e6405f7c2682da44af7be75ef567f00d8355aae"}
Jun 06 05:12:29.325756 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:29.325687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8" event={"ID":"19f77e19-1efe-4ed5-a9bb-b3e2b561c16b","Type":"ContainerStarted","Data":"5b70462f251fd4f647bb82352b558e1e6c54eafa45837db1e1eae581228f6c73"}
Jun 06 05:12:29.343147 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:29.343044    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-bkwl8" podStartSLOduration=34.120666774 podStartE2EDuration="35.343022661s" totalImagesPullingTime="1.222355887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:29.341417555 +0000 UTC m=+232.200479732" watchObservedRunningTime="2026-06-06 05:12:29.343022661 +0000 UTC m=+232.202084839"
Jun 06 05:12:31.336468 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.336432    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b6dbb575-dwwjw" event={"ID":"9e4193ce-d3da-4de1-924b-460ac425705c","Type":"ContainerStarted","Data":"22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3"}
Jun 06 05:12:31.355166 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.355103    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76b6dbb575-dwwjw" podStartSLOduration=1.060861553 podStartE2EDuration="4.355082773s" totalImagesPullingTime="3.29422122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:31.352564149 +0000 UTC m=+234.211626332" watchObservedRunningTime="2026-06-06 05:12:31.355082773 +0000 UTC m=+234.214144930"
Jun 06 05:12:31.964921 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.963635    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"]
Jun 06 05:12:31.967441 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.967409    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wzmxb"]
Jun 06 05:12:31.967684 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.967663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:31.972146 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.971541    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 06 05:12:31.972146 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.971769    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p5cm8\""
Jun 06 05:12:31.973384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.972878    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 06 05:12:31.973384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.973065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 06 05:12:31.973384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.973232    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 06 05:12:31.975248 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.974719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:31.985321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.984510    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"]
Jun 06 05:12:31.985321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.984757    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 06 05:12:31.985321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.984962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 06 05:12:31.985321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.985162    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 06 05:12:31.993805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:31.991096    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v7p6h\""
Jun 06 05:12:32.082800 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.082764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-wtmp\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.082979 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.082802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.082979 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.082836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-sys\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.082979 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.082939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.083106 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-root\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.083106 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-tls\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.083106 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e7c99d57-417f-4d20-b110-d4af1bbdb080-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.083234 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.083234 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4jhd\" (UniqueName: \"kubernetes.io/projected/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-api-access-v4jhd\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.083358 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-textfile\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.083358 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67a13be3-bcd3-437d-bc37-131fc6ac12d2-metrics-client-ca\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.083358 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083349    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7c99d57-417f-4d20-b110-d4af1bbdb080-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.083487 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tjl7\" (UniqueName: \"kubernetes.io/projected/67a13be3-bcd3-437d-bc37-131fc6ac12d2-kube-api-access-6tjl7\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.083487 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.083487 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.083461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.184672 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4jhd\" (UniqueName: \"kubernetes.io/projected/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-api-access-v4jhd\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.184850 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-textfile\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.184850 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67a13be3-bcd3-437d-bc37-131fc6ac12d2-metrics-client-ca\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.184972 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7c99d57-417f-4d20-b110-d4af1bbdb080-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.184972 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tjl7\" (UniqueName: \"kubernetes.io/projected/67a13be3-bcd3-437d-bc37-131fc6ac12d2-kube-api-access-6tjl7\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.184972 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.184972 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.185161 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.184988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-wtmp\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.185161 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185016    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.185161 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-sys\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.185161 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.185392 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-root\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.185392 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-tls\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.185392 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e7c99d57-417f-4d20-b110-d4af1bbdb080-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.185392 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.186165 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185590    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67a13be3-bcd3-437d-bc37-131fc6ac12d2-metrics-client-ca\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.186165 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185668    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-sys\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.186165 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185839    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-root\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.186165 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185999    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.186461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.186221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.186461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.185018    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-textfile\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.186461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.186296    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7c99d57-417f-4d20-b110-d4af1bbdb080-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.186461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.186434    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-wtmp\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.187344 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.187302    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e7c99d57-417f-4d20-b110-d4af1bbdb080-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.189157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.189095    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.189567 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.189545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.190401 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.190381    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/67a13be3-bcd3-437d-bc37-131fc6ac12d2-node-exporter-tls\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.190674 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.190647    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.192584 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.192549    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4jhd\" (UniqueName: \"kubernetes.io/projected/e7c99d57-417f-4d20-b110-d4af1bbdb080-kube-api-access-v4jhd\") pod \"kube-state-metrics-57bbf8bfb5-dhsx4\" (UID: \"e7c99d57-417f-4d20-b110-d4af1bbdb080\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.192677 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.192604    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tjl7\" (UniqueName: \"kubernetes.io/projected/67a13be3-bcd3-437d-bc37-131fc6ac12d2-kube-api-access-6tjl7\") pod \"node-exporter-wzmxb\" (UID: \"67a13be3-bcd3-437d-bc37-131fc6ac12d2\") " pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.294771 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.294695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"
Jun 06 05:12:32.305340 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.305312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wzmxb"
Jun 06 05:12:32.320325 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:32.320287    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a13be3_bcd3_437d_bc37_131fc6ac12d2.slice/crio-dc7cee6b5c2060dd42ab8c4cf35ad89609e2bc9779ebd8f3b193c7bc848860c7 WatchSource:0}: Error finding container dc7cee6b5c2060dd42ab8c4cf35ad89609e2bc9779ebd8f3b193c7bc848860c7: Status 404 returned error can't find the container with id dc7cee6b5c2060dd42ab8c4cf35ad89609e2bc9779ebd8f3b193c7bc848860c7
Jun 06 05:12:32.342814 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.342708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzmxb" event={"ID":"67a13be3-bcd3-437d-bc37-131fc6ac12d2","Type":"ContainerStarted","Data":"dc7cee6b5c2060dd42ab8c4cf35ad89609e2bc9779ebd8f3b193c7bc848860c7"}
Jun 06 05:12:32.450401 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:32.450370    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4"]
Jun 06 05:12:32.452569 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:32.452538    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c99d57_417f_4d20_b110_d4af1bbdb080.slice/crio-d1efddd5e7c74e1f535c7c65e20bf1a676a63ef2b644b59b1be5064c8b2a473d WatchSource:0}: Error finding container d1efddd5e7c74e1f535c7c65e20bf1a676a63ef2b644b59b1be5064c8b2a473d: Status 404 returned error can't find the container with id d1efddd5e7c74e1f535c7c65e20bf1a676a63ef2b644b59b1be5064c8b2a473d
Jun 06 05:12:33.017749 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.017365    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:12:33.022049 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.022022    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.025235    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.025616    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.025793    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.025967    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.026349    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.026597    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.026816    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.027118    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.027363    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 06 05:12:33.028551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.027614    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wxwr5\""
Jun 06 05:12:33.035786 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.035764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-config-volume\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.196967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lnhk\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-kube-api-access-2lnhk\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.197004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.197033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-web-config\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.197079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.197115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-config-out\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.197292 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.197141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298407 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-config-volume\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298407 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298633 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lnhk\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-kube-api-access-2lnhk\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298633 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298633 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-web-config\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298633 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298633 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-config-out\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298633 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298913 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298913 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298913 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298913 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.298913 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.298814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.300718 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.300692    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.301721 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.301692    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.301897 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.301876    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.303669 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.303621    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.304243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.304198    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-config-out\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.305518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.305480    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.307019 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.306970    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-tls-assets\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.307303 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.307259    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.307779 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.307751    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.308313 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.308292    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-web-config\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.308753 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.308685    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.309472 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.309450    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-config-volume\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.310496 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.310477    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lnhk\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-kube-api-access-2lnhk\") pod \"alertmanager-main-0\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.343485 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.343282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:12:33.348126 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.348097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4" event={"ID":"e7c99d57-417f-4d20-b110-d4af1bbdb080","Type":"ContainerStarted","Data":"d1efddd5e7c74e1f535c7c65e20bf1a676a63ef2b644b59b1be5064c8b2a473d"}
Jun 06 05:12:33.906733 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:33.906562    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:12:33.915257 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:33.915219    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68621a03_f81e_4695_bae5_884621184426.slice/crio-59843c8af9c154016becdebacd58daac5e260e8c9250bc3c1e55efa958ea21dc WatchSource:0}: Error finding container 59843c8af9c154016becdebacd58daac5e260e8c9250bc3c1e55efa958ea21dc: Status 404 returned error can't find the container with id 59843c8af9c154016becdebacd58daac5e260e8c9250bc3c1e55efa958ea21dc
Jun 06 05:12:34.355114 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.355077    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4" event={"ID":"e7c99d57-417f-4d20-b110-d4af1bbdb080","Type":"ContainerStarted","Data":"9a6e93d1e6188e9af154d50cd73de7c3d6bcb9c8475cf0292d97e94ca005859e"}
Jun 06 05:12:34.355615 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.355142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4" event={"ID":"e7c99d57-417f-4d20-b110-d4af1bbdb080","Type":"ContainerStarted","Data":"e90a06947804696a7e4b6f1948681c1eabc3b15496d99ed855d053763a307d8a"}
Jun 06 05:12:34.355615 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.355167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4" event={"ID":"e7c99d57-417f-4d20-b110-d4af1bbdb080","Type":"ContainerStarted","Data":"bd51bf87193793c029eb01ca4d61ba04a47e136d989f40e868653f03e4c385f0"}
Jun 06 05:12:34.357598 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.357565    2582 generic.go:356] "Generic (PLEG): container finished" podID="67a13be3-bcd3-437d-bc37-131fc6ac12d2" containerID="3d92f53ba9b406fa3bb53609c47b08b21b05ab7d782398f747efc61633155274" exitCode=0
Jun 06 05:12:34.357736 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.357654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzmxb" event={"ID":"67a13be3-bcd3-437d-bc37-131fc6ac12d2","Type":"ContainerDied","Data":"3d92f53ba9b406fa3bb53609c47b08b21b05ab7d782398f747efc61633155274"}
Jun 06 05:12:34.359162 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.359086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerStarted","Data":"59843c8af9c154016becdebacd58daac5e260e8c9250bc3c1e55efa958ea21dc"}
Jun 06 05:12:34.374299 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.374227    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-dhsx4" podStartSLOduration=2.02834985 podStartE2EDuration="3.374212731s" totalImagesPullingTime="1.345862881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:34.372505266 +0000 UTC m=+237.231567443" watchObservedRunningTime="2026-06-06 05:12:34.374212731 +0000 UTC m=+237.233274908"
Jun 06 05:12:34.932489 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.932397    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-767999fc4b-76wtg"]
Jun 06 05:12:34.937876 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.937850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:34.940614 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.940575    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 06 05:12:34.940768 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.940737    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 06 05:12:34.940885 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.940833    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1v5tgq1d6bl8i\""
Jun 06 05:12:34.940940 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.940889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p5t2t\""
Jun 06 05:12:34.940940 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.940575    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 06 05:12:34.941694 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.941674    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 06 05:12:34.941805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.941678    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 06 05:12:34.947403 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:34.947323    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-767999fc4b-76wtg"]
Jun 06 05:12:35.018032 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.017991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.018217 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.018051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.018217 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.018087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrswx\" (UniqueName: \"kubernetes.io/projected/a7bea0d4-c87a-48a7-9aa2-1831e832871f-kube-api-access-qrswx\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.018217 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.018155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7bea0d4-c87a-48a7-9aa2-1831e832871f-metrics-client-ca\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.018394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.018214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-grpc-tls\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.018394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.018263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-tls\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.018394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.018373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.018536 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.018447    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.119319 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.119255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.119492 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.119360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.119492 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.119398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.120304 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.119803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.120304 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.119872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrswx\" (UniqueName: \"kubernetes.io/projected/a7bea0d4-c87a-48a7-9aa2-1831e832871f-kube-api-access-qrswx\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.120304 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.119952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7bea0d4-c87a-48a7-9aa2-1831e832871f-metrics-client-ca\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.120304 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.120255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-grpc-tls\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.120563 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.120338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-tls\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.121085 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.121018    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7bea0d4-c87a-48a7-9aa2-1831e832871f-metrics-client-ca\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.124048 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.123644    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.124048 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.124050    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.124296 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.124255    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.124535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.124494    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.124630 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.124535    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-thanos-querier-tls\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.126536 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.126515    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a7bea0d4-c87a-48a7-9aa2-1831e832871f-secret-grpc-tls\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.134821 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.134802    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrswx\" (UniqueName: \"kubernetes.io/projected/a7bea0d4-c87a-48a7-9aa2-1831e832871f-kube-api-access-qrswx\") pod \"thanos-querier-767999fc4b-76wtg\" (UID: \"a7bea0d4-c87a-48a7-9aa2-1831e832871f\") " pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:35.253385 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:35.253066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:36.749907 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.749868    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"]
Jun 06 05:12:36.753595 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.753572    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:36.756607 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.756583    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 06 05:12:36.756727 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.756712    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hmw8m\""
Jun 06 05:12:36.761398 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.761374    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"]
Jun 06 05:12:36.838566 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.838489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60dc47d3-96d3-494c-b247-e37721737c54-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-b68xg\" (UID: \"60dc47d3-96d3-494c-b247-e37721737c54\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:36.838728 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.838593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv8dj\" (UniqueName: \"kubernetes.io/projected/60dc47d3-96d3-494c-b247-e37721737c54-kube-api-access-sv8dj\") pod \"monitoring-plugin-76b68cc874-b68xg\" (UID: \"60dc47d3-96d3-494c-b247-e37721737c54\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:36.940042 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.939996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60dc47d3-96d3-494c-b247-e37721737c54-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-b68xg\" (UID: \"60dc47d3-96d3-494c-b247-e37721737c54\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:36.940202 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.940102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv8dj\" (UniqueName: \"kubernetes.io/projected/60dc47d3-96d3-494c-b247-e37721737c54-kube-api-access-sv8dj\") pod \"monitoring-plugin-76b68cc874-b68xg\" (UID: \"60dc47d3-96d3-494c-b247-e37721737c54\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:36.940202 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:36.940176    2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jun 06 05:12:36.940384 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:12:36.940249    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60dc47d3-96d3-494c-b247-e37721737c54-monitoring-plugin-cert podName:60dc47d3-96d3-494c-b247-e37721737c54 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:37.440229523 +0000 UTC m=+240.299291699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/60dc47d3-96d3-494c-b247-e37721737c54-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-b68xg" (UID: "60dc47d3-96d3-494c-b247-e37721737c54") : secret "monitoring-plugin-cert" not found
Jun 06 05:12:36.954976 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:36.954896    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv8dj\" (UniqueName: \"kubernetes.io/projected/60dc47d3-96d3-494c-b247-e37721737c54-kube-api-access-sv8dj\") pod \"monitoring-plugin-76b68cc874-b68xg\" (UID: \"60dc47d3-96d3-494c-b247-e37721737c54\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:37.446211 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.446168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60dc47d3-96d3-494c-b247-e37721737c54-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-b68xg\" (UID: \"60dc47d3-96d3-494c-b247-e37721737c54\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:37.448944 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.448918    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/60dc47d3-96d3-494c-b247-e37721737c54-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-b68xg\" (UID: \"60dc47d3-96d3-494c-b247-e37721737c54\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:37.471979 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.471946    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:37.472107 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.472043    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:12:37.473653 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.473622    2582 patch_prober.go:28] interesting pod/console-76b6dbb575-dwwjw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Jun 06 05:12:37.473774 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.473682    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76b6dbb575-dwwjw" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused"
Jun 06 05:12:37.669928 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.669896    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hmw8m\""
Jun 06 05:12:37.678017 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:37.677989    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:41.399229 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:41.399157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzmxb" event={"ID":"67a13be3-bcd3-437d-bc37-131fc6ac12d2","Type":"ContainerStarted","Data":"2a3b08a6f9c3f0b3c0bfbcc36184e43e5d6f1c1b35325a95b75d0b55a01e7e72"}
Jun 06 05:12:41.403776 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:41.403738    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"]
Jun 06 05:12:41.407742 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:41.407714    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60dc47d3_96d3_494c_b247_e37721737c54.slice/crio-13399defe66b32395493652b1d21fb102a1ae27de25c96e97298b539460a6f1d WatchSource:0}: Error finding container 13399defe66b32395493652b1d21fb102a1ae27de25c96e97298b539460a6f1d: Status 404 returned error can't find the container with id 13399defe66b32395493652b1d21fb102a1ae27de25c96e97298b539460a6f1d
Jun 06 05:12:41.429255 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:41.429231    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-767999fc4b-76wtg"]
Jun 06 05:12:41.433026 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:41.432708    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bea0d4_c87a_48a7_9aa2_1831e832871f.slice/crio-4f8cf7242f974cba20037f6c2f4c56420b6a4ea6048a50367d8f7c50afb93f15 WatchSource:0}: Error finding container 4f8cf7242f974cba20037f6c2f4c56420b6a4ea6048a50367d8f7c50afb93f15: Status 404 returned error can't find the container with id 4f8cf7242f974cba20037f6c2f4c56420b6a4ea6048a50367d8f7c50afb93f15
Jun 06 05:12:42.414049 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.414011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-pw8h6" event={"ID":"6f86cb5a-b428-490b-a095-268c383ec622","Type":"ContainerStarted","Data":"0646eb65df1babaf566b99ef102f8c24717fef6de01baf3b48a2f9351f1ddbe0"}
Jun 06 05:12:42.414539 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.414514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-pw8h6"
Jun 06 05:12:42.420042 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.419635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wzmxb" event={"ID":"67a13be3-bcd3-437d-bc37-131fc6ac12d2","Type":"ContainerStarted","Data":"a73cd0c6ca704fc53dee4a30ad6af39f29c87a373876b54d9f3662be8472f627"}
Jun 06 05:12:42.423679 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.423349    2582 generic.go:356] "Generic (PLEG): container finished" podID="68621a03-f81e-4695-bae5-884621184426" containerID="656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85" exitCode=0
Jun 06 05:12:42.423679 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.423420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85"}
Jun 06 05:12:42.426549 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.426387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-pw8h6"
Jun 06 05:12:42.427115 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.427089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" event={"ID":"a7bea0d4-c87a-48a7-9aa2-1831e832871f","Type":"ContainerStarted","Data":"4f8cf7242f974cba20037f6c2f4c56420b6a4ea6048a50367d8f7c50afb93f15"}
Jun 06 05:12:42.428429 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.428409    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg" event={"ID":"60dc47d3-96d3-494c-b247-e37721737c54","Type":"ContainerStarted","Data":"13399defe66b32395493652b1d21fb102a1ae27de25c96e97298b539460a6f1d"}
Jun 06 05:12:42.433168 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.432796    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-pw8h6" podStartSLOduration=1.780577885 podStartE2EDuration="19.432778533s" totalImagesPullingTime="17.652200648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:42.430753796 +0000 UTC m=+245.289815977" watchObservedRunningTime="2026-06-06 05:12:42.432778533 +0000 UTC m=+245.291840710"
Jun 06 05:12:42.450776 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:42.450707    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wzmxb" podStartSLOduration=9.934616408 podStartE2EDuration="11.450691681s" totalImagesPullingTime="1.419129832s" totalInitContainerRuntime="96.945441ms" isStatefulPod=true podCreationTimestamp="2026-06-06 05:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:42.450314364 +0000 UTC m=+245.309376544" watchObservedRunningTime="2026-06-06 05:12:42.450691681 +0000 UTC m=+245.309753877"
Jun 06 05:12:45.445054 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:45.445007    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg" event={"ID":"60dc47d3-96d3-494c-b247-e37721737c54","Type":"ContainerStarted","Data":"3cd7fc1d6016481391c05d24d8cf937e42e398de379f4e0ed11db81b84257da2"}
Jun 06 05:12:45.445495 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:45.445084    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:45.447062 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:45.447031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" event={"ID":"a7bea0d4-c87a-48a7-9aa2-1831e832871f","Type":"ContainerStarted","Data":"0764d758bc47ea2608a237b3904ba0e23ab3dd1c28e101743e3a2ba777e81afb"}
Jun 06 05:12:45.451748 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:45.451719    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg"
Jun 06 05:12:45.464378 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:45.462469    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-b68xg" podStartSLOduration=5.846894343 podStartE2EDuration="9.462451989s" totalImagesPullingTime="3.615557646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:45.462435893 +0000 UTC m=+248.321498071" watchObservedRunningTime="2026-06-06 05:12:45.462451989 +0000 UTC m=+248.321514167"
Jun 06 05:12:46.454914 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:46.454874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerStarted","Data":"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"}
Jun 06 05:12:46.455433 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:46.454955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerStarted","Data":"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"}
Jun 06 05:12:46.455433 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:46.454985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerStarted","Data":"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"}
Jun 06 05:12:46.455433 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:46.455026    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerStarted","Data":"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"}
Jun 06 05:12:46.455433 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:46.455065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerStarted","Data":"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"}
Jun 06 05:12:46.457334 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:46.457296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" event={"ID":"a7bea0d4-c87a-48a7-9aa2-1831e832871f","Type":"ContainerStarted","Data":"3eed2e510f5e0a0349cf5e1959145903c84675cca68630006cd40e0bf8a57663"}
Jun 06 05:12:46.457450 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:46.457377    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" event={"ID":"a7bea0d4-c87a-48a7-9aa2-1831e832871f","Type":"ContainerStarted","Data":"9418331c8264c3b8d300df2f1e7f4a6d80cb3dd14d2920ee49606f99ba5abbab"}
Jun 06 05:12:47.466258 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.466217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerStarted","Data":"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"}
Jun 06 05:12:47.469676 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.469646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" event={"ID":"a7bea0d4-c87a-48a7-9aa2-1831e832871f","Type":"ContainerStarted","Data":"dc897a68293a62c95ad70e7f9abab7ee713e463bd8ae07749445883254ded85e"}
Jun 06 05:12:47.469825 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.469809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" event={"ID":"a7bea0d4-c87a-48a7-9aa2-1831e832871f","Type":"ContainerStarted","Data":"00cb83e8b79bf50672e1bd822623aaba2b268d5b2d3ac3ec760a59662e8854fe"}
Jun 06 05:12:47.469902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.469855    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" event={"ID":"a7bea0d4-c87a-48a7-9aa2-1831e832871f","Type":"ContainerStarted","Data":"fa32ce2b11a3f8adba3f7b9e73a5fb69a249f0c89b03d58832424cf59ccdf518"}
Jun 06 05:12:47.471469 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.471434    2582 patch_prober.go:28] interesting pod/console-76b6dbb575-dwwjw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Jun 06 05:12:47.471598 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.471483    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76b6dbb575-dwwjw" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused"
Jun 06 05:12:47.492410 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.492226    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.720406584 podStartE2EDuration="15.492207665s" totalImagesPullingTime="11.754476626s" totalInitContainerRuntime="17.324455ms" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:47.490380767 +0000 UTC m=+250.349442944" watchObservedRunningTime="2026-06-06 05:12:47.492207665 +0000 UTC m=+250.351269843"
Jun 06 05:12:47.511581 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:47.511522    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg" podStartSLOduration=8.843286237000001 podStartE2EDuration="13.511502752s" totalImagesPullingTime="4.668216515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:47.509866617 +0000 UTC m=+250.368928808" watchObservedRunningTime="2026-06-06 05:12:47.511502752 +0000 UTC m=+250.370564931"
Jun 06 05:12:48.475980 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:48.475941    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:49.470707 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:49.470661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:12:49.473484 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:49.473449    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89665e91-1799-4a69-b55a-54c498846550-metrics-certs\") pod \"network-metrics-daemon-wv65h\" (UID: \"89665e91-1799-4a69-b55a-54c498846550\") " pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:12:49.497195 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:49.497165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l6jm8\""
Jun 06 05:12:49.505443 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:49.505415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wv65h"
Jun 06 05:12:49.745541 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:49.745513    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wv65h"]
Jun 06 05:12:49.748085 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:12:49.748052    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89665e91_1799_4a69_b55a_54c498846550.slice/crio-c33c2abef591f5f63be813ccf54d7b8141ac2c81296452d180a9ac10f99eee87 WatchSource:0}: Error finding container c33c2abef591f5f63be813ccf54d7b8141ac2c81296452d180a9ac10f99eee87: Status 404 returned error can't find the container with id c33c2abef591f5f63be813ccf54d7b8141ac2c81296452d180a9ac10f99eee87
Jun 06 05:12:50.486666 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:50.486624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wv65h" event={"ID":"89665e91-1799-4a69-b55a-54c498846550","Type":"ContainerStarted","Data":"c33c2abef591f5f63be813ccf54d7b8141ac2c81296452d180a9ac10f99eee87"}
Jun 06 05:12:51.492788 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:51.492757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wv65h" event={"ID":"89665e91-1799-4a69-b55a-54c498846550","Type":"ContainerStarted","Data":"2a17e13434126cc64b52d269ecbf4f5405cf87ebc394805b6b7b8b063b4a3a78"}
Jun 06 05:12:51.493176 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:51.492817    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wv65h" event={"ID":"89665e91-1799-4a69-b55a-54c498846550","Type":"ContainerStarted","Data":"b56204d47592c882a2191680db34c816fc7e9c2882876a9223d238badab972a2"}
Jun 06 05:12:51.508362 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:51.508314    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wv65h" podStartSLOduration=253.16519214 podStartE2EDuration="4m14.508299468s" totalImagesPullingTime="1.343107328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:51.507400217 +0000 UTC m=+254.366462404" watchObservedRunningTime="2026-06-06 05:12:51.508299468 +0000 UTC m=+254.367361645"
Jun 06 05:12:54.486830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:54.486801    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-767999fc4b-76wtg"
Jun 06 05:12:57.471751 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:57.471713    2582 patch_prober.go:28] interesting pod/console-76b6dbb575-dwwjw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Jun 06 05:12:57.472158 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:12:57.471767    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76b6dbb575-dwwjw" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused"
Jun 06 05:13:07.472350 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:07.472312    2582 patch_prober.go:28] interesting pod/console-76b6dbb575-dwwjw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Jun 06 05:13:07.472817 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:07.472366    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76b6dbb575-dwwjw" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused"
Jun 06 05:13:08.559551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:08.559518    2582 generic.go:356] "Generic (PLEG): container finished" podID="419fcb35-bfbc-47e2-95e9-a8cdbaaf799b" containerID="ae3aa127d60fd64c042c803b8f3ab02c239ca411bcc5a03156ed8db5278587a6" exitCode=0
Jun 06 05:13:08.559956 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:08.559586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z" event={"ID":"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b","Type":"ContainerDied","Data":"ae3aa127d60fd64c042c803b8f3ab02c239ca411bcc5a03156ed8db5278587a6"}
Jun 06 05:13:08.559956 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:08.559906    2582 scope.go:117] "RemoveContainer" containerID="ae3aa127d60fd64c042c803b8f3ab02c239ca411bcc5a03156ed8db5278587a6"
Jun 06 05:13:09.570503 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:09.570471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-jj47z" event={"ID":"419fcb35-bfbc-47e2-95e9-a8cdbaaf799b","Type":"ContainerStarted","Data":"c9ee5a4293b2057bbdb7efd79e12ef2acf6f3b4bb1cfb50c1d33ca76f71077d9"}
Jun 06 05:13:11.388564 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:11.388537    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68621a03-f81e-4695-bae5-884621184426/init-config-reloader/0.log"
Jun 06 05:13:11.588921 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:11.588891    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68621a03-f81e-4695-bae5-884621184426/alertmanager/0.log"
Jun 06 05:13:11.789564 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:11.789476    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68621a03-f81e-4695-bae5-884621184426/config-reloader/0.log"
Jun 06 05:13:11.988943 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:11.988915    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68621a03-f81e-4695-bae5-884621184426/kube-rbac-proxy-web/0.log"
Jun 06 05:13:12.189495 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:12.189460    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68621a03-f81e-4695-bae5-884621184426/kube-rbac-proxy/0.log"
Jun 06 05:13:12.389411 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:12.389374    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68621a03-f81e-4695-bae5-884621184426/kube-rbac-proxy-metric/0.log"
Jun 06 05:13:12.589185 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:12.589161    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_68621a03-f81e-4695-bae5-884621184426/prom-label-proxy/0.log"
Jun 06 05:13:12.791177 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:12.791149    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-7mcd8_997e6d4e-8f92-42a7-8330-072e5148ead7/cluster-monitoring-operator/0.log"
Jun 06 05:13:12.989594 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:12.989512    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dhsx4_e7c99d57-417f-4d20-b110-d4af1bbdb080/kube-state-metrics/0.log"
Jun 06 05:13:13.189020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:13.188991    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dhsx4_e7c99d57-417f-4d20-b110-d4af1bbdb080/kube-rbac-proxy-main/0.log"
Jun 06 05:13:13.388282 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:13.388248    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dhsx4_e7c99d57-417f-4d20-b110-d4af1bbdb080/kube-rbac-proxy-self/0.log"
Jun 06 05:13:13.788739 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:13.788654    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-b68xg_60dc47d3-96d3-494c-b247-e37721737c54/monitoring-plugin/0.log"
Jun 06 05:13:15.189260 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:15.189235    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzmxb_67a13be3-bcd3-437d-bc37-131fc6ac12d2/init-textfile/0.log"
Jun 06 05:13:15.390546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:15.390515    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzmxb_67a13be3-bcd3-437d-bc37-131fc6ac12d2/node-exporter/0.log"
Jun 06 05:13:15.588699 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:15.588676    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzmxb_67a13be3-bcd3-437d-bc37-131fc6ac12d2/kube-rbac-proxy/0.log"
Jun 06 05:13:17.471938 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:17.471905    2582 patch_prober.go:28] interesting pod/console-76b6dbb575-dwwjw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Jun 06 05:13:17.472358 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:17.471977    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76b6dbb575-dwwjw" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused"
Jun 06 05:13:18.085084 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:18.085041    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9bbql" podUID="ef7708bc-ab15-44a8-8399-5da9076c0fd2"
Jun 06 05:13:18.188941 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:18.188905    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-9bl7l_9154828d-1203-4b78-a1a8-604fa4664f52/prometheus-operator-admission-webhook/0.log"
Jun 06 05:13:18.388714 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:18.388622    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/thanos-query/0.log"
Jun 06 05:13:18.591030 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:18.591005    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy-web/0.log"
Jun 06 05:13:18.604307 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:18.604265    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9bbql"
Jun 06 05:13:18.788995 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:18.788889    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy/0.log"
Jun 06 05:13:18.988502 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:18.988477    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/prom-label-proxy/0.log"
Jun 06 05:13:19.189262 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:19.189235    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy-rules/0.log"
Jun 06 05:13:19.388694 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:19.388668    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy-metrics/0.log"
Jun 06 05:13:19.589020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:19.588990    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-bkwl8_19f77e19-1efe-4ed5-a9bb-b3e2b561c16b/networking-console-plugin/0.log"
Jun 06 05:13:20.388539 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:20.388498    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76b6dbb575-dwwjw_9e4193ce-d3da-4de1-924b-460ac425705c/console/0.log"
Jun 06 05:13:20.791205 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:20.791131    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-pw8h6_6f86cb5a-b428-490b-a095-268c383ec622/download-server/0.log"
Jun 06 05:13:22.066592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.066551    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:13:22.067087 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.066633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:13:22.068941 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.068914    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef7708bc-ab15-44a8-8399-5da9076c0fd2-metrics-tls\") pod \"dns-default-9bbql\" (UID: \"ef7708bc-ab15-44a8-8399-5da9076c0fd2\") " pod="openshift-dns/dns-default-9bbql"
Jun 06 05:13:22.069195 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.069173    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"image-registry-c9b496446-dgprz\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") " pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:13:22.196780 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.196745    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qthsg\""
Jun 06 05:13:22.204962 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.204935    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:13:22.207211 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.207194    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qbbkp\""
Jun 06 05:13:22.215415 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.215394    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9bbql"
Jun 06 05:13:22.372025 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.372002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9b496446-dgprz"]
Jun 06 05:13:22.374355 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:13:22.374328    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13314ee_5ca9_46e9_b13f_cb95c3519fca.slice/crio-c344531aea3a6b0763d762d897d0d703d0f311c8ce32e33701073b88961570c4 WatchSource:0}: Error finding container c344531aea3a6b0763d762d897d0d703d0f311c8ce32e33701073b88961570c4: Status 404 returned error can't find the container with id c344531aea3a6b0763d762d897d0d703d0f311c8ce32e33701073b88961570c4
Jun 06 05:13:22.387825 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.387799    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9bbql"]
Jun 06 05:13:22.389213 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.389196    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dhtw_85238ec9-ad65-4dcb-a789-d83c9861f21b/dns-node-resolver/0.log"
Jun 06 05:13:22.390043 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:13:22.390019    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7708bc_ab15_44a8_8399_5da9076c0fd2.slice/crio-45ee88d67fb563798a9aa9e57211a8f2fcf5918f0477d5c0507dab55866dc62d WatchSource:0}: Error finding container 45ee88d67fb563798a9aa9e57211a8f2fcf5918f0477d5c0507dab55866dc62d: Status 404 returned error can't find the container with id 45ee88d67fb563798a9aa9e57211a8f2fcf5918f0477d5c0507dab55866dc62d
Jun 06 05:13:22.621996 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.621887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9b496446-dgprz" event={"ID":"d13314ee-5ca9-46e9-b13f-cb95c3519fca","Type":"ContainerStarted","Data":"b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b"}
Jun 06 05:13:22.621996 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.621960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:13:22.621996 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.621982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9b496446-dgprz" event={"ID":"d13314ee-5ca9-46e9-b13f-cb95c3519fca","Type":"ContainerStarted","Data":"c344531aea3a6b0763d762d897d0d703d0f311c8ce32e33701073b88961570c4"}
Jun 06 05:13:22.623042 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.623015    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9bbql" event={"ID":"ef7708bc-ab15-44a8-8399-5da9076c0fd2","Type":"ContainerStarted","Data":"45ee88d67fb563798a9aa9e57211a8f2fcf5918f0477d5c0507dab55866dc62d"}
Jun 06 05:13:22.640871 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.640820    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c9b496446-dgprz" podStartSLOduration=284.640804893 podStartE2EDuration="4m44.640804893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:13:22.638721915 +0000 UTC m=+285.497784099" watchObservedRunningTime="2026-06-06 05:13:22.640804893 +0000 UTC m=+285.499867069"
Jun 06 05:13:22.989797 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:22.989719    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c9b496446-dgprz_d13314ee-5ca9-46e9-b13f-cb95c3519fca/registry/0.log"
Jun 06 05:13:23.188580 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:23.188547    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7k9lr_f040a8fe-109d-4355-abd6-5d1ee6101544/node-ca/0.log"
Jun 06 05:13:23.790541 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:23.790518    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c7d6c6877-lc882_c1d2a316-1671-45af-b0a6-6332a51da69d/router/0.log"
Jun 06 05:13:24.389578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:24.389542    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shh2l_a0b76e14-9df2-4368-a311-ec3991bc389c/serve-healthcheck-canary/0.log"
Jun 06 05:13:24.634499 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:24.634465    2582 generic.go:356] "Generic (PLEG): container finished" podID="b5e2c96a-5c24-4ce9-99fd-1afcff47a06b" containerID="323759b3e02bd44b0abc7f6593ca10dd3ced0d8920d6dbbfed0c33dd378d8a15" exitCode=0
Jun 06 05:13:24.634695 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:24.634540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn" event={"ID":"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b","Type":"ContainerDied","Data":"323759b3e02bd44b0abc7f6593ca10dd3ced0d8920d6dbbfed0c33dd378d8a15"}
Jun 06 05:13:24.634937 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:24.634921    2582 scope.go:117] "RemoveContainer" containerID="323759b3e02bd44b0abc7f6593ca10dd3ced0d8920d6dbbfed0c33dd378d8a15"
Jun 06 05:13:25.642248 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:25.642209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9bbql" event={"ID":"ef7708bc-ab15-44a8-8399-5da9076c0fd2","Type":"ContainerStarted","Data":"65990eedb4d8e9b9921d7d09abdd78176b85adfec40d92d8e0fe33f38dacbd25"}
Jun 06 05:13:25.642693 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:25.642292    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9bbql" event={"ID":"ef7708bc-ab15-44a8-8399-5da9076c0fd2","Type":"ContainerStarted","Data":"63ab7b3f9c0dbb11fd043c3437a1b78d43ca0241bb84944598f327d829d8dba4"}
Jun 06 05:13:25.642693 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:25.642350    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9bbql"
Jun 06 05:13:25.644256 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:25.644229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-b8rcn" event={"ID":"b5e2c96a-5c24-4ce9-99fd-1afcff47a06b","Type":"ContainerStarted","Data":"5c7cfd55fdfbf7f139147b8467d61920f5e51f9ca2f55505f4c5933e8ae8a59d"}
Jun 06 05:13:25.658825 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:25.658764    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9bbql" podStartSLOduration=251.155996602 podStartE2EDuration="4m13.658742299s" totalImagesPullingTime="2.502745697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:13:25.657844244 +0000 UTC m=+288.516906421" watchObservedRunningTime="2026-06-06 05:13:25.658742299 +0000 UTC m=+288.517804476"
Jun 06 05:13:27.471705 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:27.471673    2582 patch_prober.go:28] interesting pod/console-76b6dbb575-dwwjw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Jun 06 05:13:27.472073 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:27.471736    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-76b6dbb575-dwwjw" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused"
Jun 06 05:13:35.653856 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:35.653825    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9bbql"
Jun 06 05:13:37.475798 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:37.475768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:13:37.479525 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:37.479505    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:13:37.539662 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:37.539634    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:13:37.540776 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:37.540754    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:13:37.553587 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:37.553553    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jun 06 05:13:42.209906 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:42.209871    2582 patch_prober.go:28] interesting pod/image-registry-c9b496446-dgprz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 05:13:42.212306 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:42.209934    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c9b496446-dgprz" podUID="d13314ee-5ca9-46e9-b13f-cb95c3519fca" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 05:13:43.631845 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:43.631817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:13:47.145794 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:47.145761    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b6dbb575-dwwjw"]
Jun 06 05:13:51.771586 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:51.771553    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9b496446-dgprz"]
Jun 06 05:13:52.188373 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.188337    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:13:52.188652 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.188602    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="alertmanager" containerID="cri-o://9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53" gracePeriod=120
Jun 06 05:13:52.188804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.188688    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-metric" containerID="cri-o://a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173" gracePeriod=120
Jun 06 05:13:52.188804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.188689    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-web" containerID="cri-o://cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c" gracePeriod=120
Jun 06 05:13:52.188804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.188756    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="prom-label-proxy" containerID="cri-o://afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6" gracePeriod=120
Jun 06 05:13:52.188804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.188710    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="config-reloader" containerID="cri-o://d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809" gracePeriod=120
Jun 06 05:13:52.189010 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.188823    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy" containerID="cri-o://403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a" gracePeriod=120
Jun 06 05:13:52.760311 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760263    2582 generic.go:356] "Generic (PLEG): container finished" podID="68621a03-f81e-4695-bae5-884621184426" containerID="afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6" exitCode=0
Jun 06 05:13:52.760311 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760303    2582 generic.go:356] "Generic (PLEG): container finished" podID="68621a03-f81e-4695-bae5-884621184426" containerID="403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a" exitCode=0
Jun 06 05:13:52.760311 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760309    2582 generic.go:356] "Generic (PLEG): container finished" podID="68621a03-f81e-4695-bae5-884621184426" containerID="d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809" exitCode=0
Jun 06 05:13:52.760311 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760315    2582 generic.go:356] "Generic (PLEG): container finished" podID="68621a03-f81e-4695-bae5-884621184426" containerID="9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53" exitCode=0
Jun 06 05:13:52.760621 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"}
Jun 06 05:13:52.760621 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"}
Jun 06 05:13:52.760621 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"}
Jun 06 05:13:52.760621 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:52.760493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"}
Jun 06 05:13:53.441971 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.441946    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.446883 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.446858    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-cluster-tls-config\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.446896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-main-tls\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.446923    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-alertmanager-main-db\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447020 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.446983    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-config-volume\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447022    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-web-config\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447042    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-metrics-client-ca\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447090    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-metric\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-alertmanager-trusted-ca-bundle\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447169    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-tls-assets\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447447 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447206    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-config-out\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447447 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-web\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447447 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447281    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lnhk\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-kube-api-access-2lnhk\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.447447 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy\") pod \"68621a03-f81e-4695-bae5-884621184426\" (UID: \"68621a03-f81e-4695-bae5-884621184426\") "
Jun 06 05:13:53.448750 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447258    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:13:53.448750 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.447624    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:13:53.448750 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.448103    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:13:53.450433 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.450244    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:53.450433 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.450364    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:53.451757 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.451719    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:53.451876 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.451856    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-config-out" (OuterVolumeSpecName: "config-out") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:13:53.452146 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.452107    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:53.452248 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.452195    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-config-volume" (OuterVolumeSpecName: "config-volume") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:53.452338 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.452313    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-kube-api-access-2lnhk" (OuterVolumeSpecName: "kube-api-access-2lnhk") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "kube-api-access-2lnhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:13:53.452817 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.452798    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:13:53.455023 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.454996    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:53.462236 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.462217    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-web-config" (OuterVolumeSpecName: "web-config") pod "68621a03-f81e-4695-bae5-884621184426" (UID: "68621a03-f81e-4695-bae5-884621184426"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548151    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-main-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548183    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-alertmanager-main-db\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548194    2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-config-volume\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548202    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-web-config\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548211    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-metrics-client-ca\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548222    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548231    2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68621a03-f81e-4695-bae5-884621184426-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548235 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548240    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-tls-assets\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548249    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68621a03-f81e-4695-bae5-884621184426-config-out\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548256    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548287    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lnhk\" (UniqueName: \"kubernetes.io/projected/68621a03-f81e-4695-bae5-884621184426-kube-api-access-2lnhk\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548298    2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.548648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.548306    2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/68621a03-f81e-4695-bae5-884621184426-cluster-tls-config\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:13:53.767691 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.767656    2582 generic.go:356] "Generic (PLEG): container finished" podID="68621a03-f81e-4695-bae5-884621184426" containerID="a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173" exitCode=0
Jun 06 05:13:53.767691 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.767682    2582 generic.go:356] "Generic (PLEG): container finished" podID="68621a03-f81e-4695-bae5-884621184426" containerID="cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c" exitCode=0
Jun 06 05:13:53.767899 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.767748    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.767899 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.767746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"}
Jun 06 05:13:53.767899 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.767835    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"}
Jun 06 05:13:53.767899 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.767880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"68621a03-f81e-4695-bae5-884621184426","Type":"ContainerDied","Data":"59843c8af9c154016becdebacd58daac5e260e8c9250bc3c1e55efa958ea21dc"}
Jun 06 05:13:53.768035 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.767901    2582 scope.go:117] "RemoveContainer" containerID="afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"
Jun 06 05:13:53.776536 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.776518    2582 scope.go:117] "RemoveContainer" containerID="a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"
Jun 06 05:13:53.783857 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.783838    2582 scope.go:117] "RemoveContainer" containerID="403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"
Jun 06 05:13:53.788736 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.788707    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:13:53.792563 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.792545    2582 scope.go:117] "RemoveContainer" containerID="cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"
Jun 06 05:13:53.792964 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.792944    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:13:53.799767 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.799749    2582 scope.go:117] "RemoveContainer" containerID="d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"
Jun 06 05:13:53.807150 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.807128    2582 scope.go:117] "RemoveContainer" containerID="9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"
Jun 06 05:13:53.814865 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.814841    2582 scope.go:117] "RemoveContainer" containerID="656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85"
Jun 06 05:13:53.815593 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815570    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:13:53.815911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815898    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-metric"
Jun 06 05:13:53.815950 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815914    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-metric"
Jun 06 05:13:53.815950 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815926    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="alertmanager"
Jun 06 05:13:53.815950 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815932    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="alertmanager"
Jun 06 05:13:53.815950 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815941    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="prom-label-proxy"
Jun 06 05:13:53.815950 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815946    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="prom-label-proxy"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815955    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-web"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815961    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-web"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815980    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="config-reloader"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815985    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="config-reloader"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815991    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.815996    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816003    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="init-config-reloader"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816007    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="init-config-reloader"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816056    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-metric"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816066    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="alertmanager"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816072    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="prom-label-proxy"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816078    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="config-reloader"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816083    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy-web"
Jun 06 05:13:53.816096 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.816089    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68621a03-f81e-4695-bae5-884621184426" containerName="kube-rbac-proxy"
Jun 06 05:13:53.819458 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.819441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.821865 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.821823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 06 05:13:53.821865 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.821840    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 06 05:13:53.822119 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.821913    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 06 05:13:53.822394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822257    2582 scope.go:117] "RemoveContainer" containerID="afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"
Jun 06 05:13:53.822394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822379    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wxwr5\""
Jun 06 05:13:53.822394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822392    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 06 05:13:53.822549 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822391    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 06 05:13:53.822549 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822480    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 06 05:13:53.822750 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:53.822603    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6\": container with ID starting with afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6 not found: ID does not exist" containerID="afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"
Jun 06 05:13:53.822750 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822637    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"} err="failed to get container status \"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6\": rpc error: code = NotFound desc = could not find container \"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6\": container with ID starting with afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6 not found: ID does not exist"
Jun 06 05:13:53.822750 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822682    2582 scope.go:117] "RemoveContainer" containerID="a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"
Jun 06 05:13:53.822983 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822749    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 06 05:13:53.822983 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822749    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 06 05:13:53.822983 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:53.822955    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173\": container with ID starting with a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173 not found: ID does not exist" containerID="a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"
Jun 06 05:13:53.823084 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822978    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"} err="failed to get container status \"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173\": rpc error: code = NotFound desc = could not find container \"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173\": container with ID starting with a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173 not found: ID does not exist"
Jun 06 05:13:53.823084 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.822994    2582 scope.go:117] "RemoveContainer" containerID="403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"
Jun 06 05:13:53.823251 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:53.823235    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a\": container with ID starting with 403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a not found: ID does not exist" containerID="403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"
Jun 06 05:13:53.823414 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.823256    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"} err="failed to get container status \"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a\": rpc error: code = NotFound desc = could not find container \"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a\": container with ID starting with 403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a not found: ID does not exist"
Jun 06 05:13:53.823414 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.823291    2582 scope.go:117] "RemoveContainer" containerID="cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"
Jun 06 05:13:53.823625 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:53.823603    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c\": container with ID starting with cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c not found: ID does not exist" containerID="cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"
Jun 06 05:13:53.823717 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.823632    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"} err="failed to get container status \"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c\": rpc error: code = NotFound desc = could not find container \"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c\": container with ID starting with cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c not found: ID does not exist"
Jun 06 05:13:53.823717 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.823655    2582 scope.go:117] "RemoveContainer" containerID="d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"
Jun 06 05:13:53.823968 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:53.823929    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809\": container with ID starting with d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809 not found: ID does not exist" containerID="d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"
Jun 06 05:13:53.824090 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.823968    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"} err="failed to get container status \"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809\": rpc error: code = NotFound desc = could not find container \"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809\": container with ID starting with d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809 not found: ID does not exist"
Jun 06 05:13:53.824090 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.823996    2582 scope.go:117] "RemoveContainer" containerID="9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"
Jun 06 05:13:53.824334 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:53.824296    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53\": container with ID starting with 9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53 not found: ID does not exist" containerID="9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"
Jun 06 05:13:53.824334 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.824325    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"} err="failed to get container status \"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53\": rpc error: code = NotFound desc = could not find container \"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53\": container with ID starting with 9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53 not found: ID does not exist"
Jun 06 05:13:53.824500 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.824344    2582 scope.go:117] "RemoveContainer" containerID="656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85"
Jun 06 05:13:53.824634 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:13:53.824617    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85\": container with ID starting with 656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85 not found: ID does not exist" containerID="656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85"
Jun 06 05:13:53.824707 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.824636    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85"} err="failed to get container status \"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85\": rpc error: code = NotFound desc = could not find container \"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85\": container with ID starting with 656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85 not found: ID does not exist"
Jun 06 05:13:53.824707 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.824651    2582 scope.go:117] "RemoveContainer" containerID="afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"
Jun 06 05:13:53.824898 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.824874    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6"} err="failed to get container status \"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6\": rpc error: code = NotFound desc = could not find container \"afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6\": container with ID starting with afece09d1bd22dda4070fb6e5c86c313dfad36db3d137649be3320f97c2bbbb6 not found: ID does not exist"
Jun 06 05:13:53.825001 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.824899    2582 scope.go:117] "RemoveContainer" containerID="a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"
Jun 06 05:13:53.825212 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.825188    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173"} err="failed to get container status \"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173\": rpc error: code = NotFound desc = could not find container \"a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173\": container with ID starting with a0c8f3761f9fa499ab9b7777b611fe8a7bde61fff4162228fa69d54fa0155173 not found: ID does not exist"
Jun 06 05:13:53.825298 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.825224    2582 scope.go:117] "RemoveContainer" containerID="403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"
Jun 06 05:13:53.825514 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.825489    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a"} err="failed to get container status \"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a\": rpc error: code = NotFound desc = could not find container \"403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a\": container with ID starting with 403fe6718a5d76860da3ac7c8c68744e4ee4b663d7e1e8a485e9f4debe0c8c3a not found: ID does not exist"
Jun 06 05:13:53.825608 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.825514    2582 scope.go:117] "RemoveContainer" containerID="cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"
Jun 06 05:13:53.825857 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.825837    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c"} err="failed to get container status \"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c\": rpc error: code = NotFound desc = could not find container \"cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c\": container with ID starting with cc04c0f34f6ef44d20d65ea8324182cc24cff54c87810d1340135700f0a13c2c not found: ID does not exist"
Jun 06 05:13:53.825940 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.825857    2582 scope.go:117] "RemoveContainer" containerID="d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"
Jun 06 05:13:53.826087 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.826066    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809"} err="failed to get container status \"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809\": rpc error: code = NotFound desc = could not find container \"d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809\": container with ID starting with d63b7db5865f04766ab66e3a9a4dc85e42283d2f08a7ce195b4656bc01730809 not found: ID does not exist"
Jun 06 05:13:53.826158 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.826088    2582 scope.go:117] "RemoveContainer" containerID="9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"
Jun 06 05:13:53.826372 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.826347    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53"} err="failed to get container status \"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53\": rpc error: code = NotFound desc = could not find container \"9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53\": container with ID starting with 9bebde4a1d944d77b1a8e03da010042cbb03e77c005cb6c13eb12842e7aedc53 not found: ID does not exist"
Jun 06 05:13:53.826451 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.826374    2582 scope.go:117] "RemoveContainer" containerID="656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85"
Jun 06 05:13:53.826771 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.826637    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85"} err="failed to get container status \"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85\": rpc error: code = NotFound desc = could not find container \"656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85\": container with ID starting with 656f3833b70e4fd2a2a18c17fb1dd062ab28cb9edf94ae1180767b17e16f1d85 not found: ID does not exist"
Jun 06 05:13:53.827397 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.827381    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 06 05:13:53.832418 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.832398    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:13:53.851425 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5f2aff2-983b-4369-a8a1-e664eb79a496-config-out\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5f2aff2-983b-4369-a8a1-e664eb79a496-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851451    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5f2aff2-983b-4369-a8a1-e664eb79a496-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851695 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851695 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851695 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851695 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnwjr\" (UniqueName: \"kubernetes.io/projected/f5f2aff2-983b-4369-a8a1-e664eb79a496-kube-api-access-nnwjr\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851695 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-web-config\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851894 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5f2aff2-983b-4369-a8a1-e664eb79a496-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851894 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5f2aff2-983b-4369-a8a1-e664eb79a496-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.851894 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.851775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952485 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952449    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-web-config\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952485 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5f2aff2-983b-4369-a8a1-e664eb79a496-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5f2aff2-983b-4369-a8a1-e664eb79a496-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5f2aff2-983b-4369-a8a1-e664eb79a496-config-out\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952632    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5f2aff2-983b-4369-a8a1-e664eb79a496-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.952745 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5f2aff2-983b-4369-a8a1-e664eb79a496-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.953097 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952761    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.953097 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.953097 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.953097 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.952841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwjr\" (UniqueName: \"kubernetes.io/projected/f5f2aff2-983b-4369-a8a1-e664eb79a496-kube-api-access-nnwjr\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.953377 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.953352    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5f2aff2-983b-4369-a8a1-e664eb79a496-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.953823 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.953501    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5f2aff2-983b-4369-a8a1-e664eb79a496-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.954143 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.954089    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f5f2aff2-983b-4369-a8a1-e664eb79a496-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.955985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.955836    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-web-config\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.955985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.955909    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5f2aff2-983b-4369-a8a1-e664eb79a496-config-out\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.955985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.955949    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.956208 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.955996    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5f2aff2-983b-4369-a8a1-e664eb79a496-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.956258 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.956206    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-config-volume\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.956258 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.956224    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.956349 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.956328    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.957209 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.957194    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.957425 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.957410    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f5f2aff2-983b-4369-a8a1-e664eb79a496-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:53.960129 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:53.960109    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnwjr\" (UniqueName: \"kubernetes.io/projected/f5f2aff2-983b-4369-a8a1-e664eb79a496-kube-api-access-nnwjr\") pod \"alertmanager-main-0\" (UID: \"f5f2aff2-983b-4369-a8a1-e664eb79a496\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:54.129955 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:54.129923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 06 05:13:54.267989 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:54.267964    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 06 05:13:54.269781 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:13:54.269754    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f2aff2_983b_4369_a8a1_e664eb79a496.slice/crio-25eb4966e21e9a43e55a8343a75810e71908b9c51db0c5e86d359e37b6e20c2e WatchSource:0}: Error finding container 25eb4966e21e9a43e55a8343a75810e71908b9c51db0c5e86d359e37b6e20c2e: Status 404 returned error can't find the container with id 25eb4966e21e9a43e55a8343a75810e71908b9c51db0c5e86d359e37b6e20c2e
Jun 06 05:13:54.773656 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:54.773625    2582 generic.go:356] "Generic (PLEG): container finished" podID="f5f2aff2-983b-4369-a8a1-e664eb79a496" containerID="a52f561a9765cea26312db168a8e549a93400f25ec0f392f0cc8ad06b036ddaf" exitCode=0
Jun 06 05:13:54.774087 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:54.773703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerDied","Data":"a52f561a9765cea26312db168a8e549a93400f25ec0f392f0cc8ad06b036ddaf"}
Jun 06 05:13:54.774087 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:54.773775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerStarted","Data":"25eb4966e21e9a43e55a8343a75810e71908b9c51db0c5e86d359e37b6e20c2e"}
Jun 06 05:13:55.598955 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.598915    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68621a03-f81e-4695-bae5-884621184426" path="/var/lib/kubelet/pods/68621a03-f81e-4695-bae5-884621184426/volumes"
Jun 06 05:13:55.783058 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.783023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerStarted","Data":"0f7f2b14755937ad107ee7bb90c68648f2f30227a623f3fc9870a202463cae79"}
Jun 06 05:13:55.783440 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.783085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerStarted","Data":"7dc8231b1491cdb277605f09ef5aaf3d090c0da6863879a5a20769cb24583974"}
Jun 06 05:13:55.783440 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.783111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerStarted","Data":"2ad4bed5d7b904e45beb8997c6147f83e9d9cec92e9733329e39b2a22005d248"}
Jun 06 05:13:55.783440 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.783136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerStarted","Data":"f87f71bfb9defc8402b22524f103739e6906a9e7e3119265da33bbef6a49dcac"}
Jun 06 05:13:55.783440 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.783162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerStarted","Data":"6c40610f68ff32834214dc467c1966ec5216197ff02d166ca5cbd9ca3f1f2724"}
Jun 06 05:13:55.783440 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.783186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f5f2aff2-983b-4369-a8a1-e664eb79a496","Type":"ContainerStarted","Data":"56ad11670f5a4cc46c6172f1d59e9c96b7070c1b9bb05729888f0efbd3cc40e3"}
Jun 06 05:13:55.809284 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:55.809213    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7939459429999998 podStartE2EDuration="2.809194989s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.249046ms" isStatefulPod=false podCreationTimestamp="2026-06-06 05:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:13:55.806651338 +0000 UTC m=+318.665713517" watchObservedRunningTime="2026-06-06 05:13:55.809194989 +0000 UTC m=+318.668257165"
Jun 06 05:13:56.202000 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.201963    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"]
Jun 06 05:13:56.206587 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.206562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.209247 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.209218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 06 05:13:56.209247 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.209238    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 06 05:13:56.209560 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.209279    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 06 05:13:56.209560 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.209295    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 06 05:13:56.209560 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.209299    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-d5dhd\""
Jun 06 05:13:56.209560 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.209279    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 06 05:13:56.214262 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.214242    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 06 05:13:56.217426 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.217407    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"]
Jun 06 05:13:56.270190 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.270371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270196    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-telemeter-client-tls\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.270371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.270371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqfwk\" (UniqueName: \"kubernetes.io/projected/d83f6c72-13fb-43d1-a251-d10d7635149d-kube-api-access-xqfwk\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.270371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-federate-client-tls\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.270371 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-serving-certs-ca-bundle\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.270548 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-secret-telemeter-client\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.270548 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.270428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-metrics-client-ca\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.370920 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.370866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.371099 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.370975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-telemeter-client-tls\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.371099 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.371099 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqfwk\" (UniqueName: \"kubernetes.io/projected/d83f6c72-13fb-43d1-a251-d10d7635149d-kube-api-access-xqfwk\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.371099 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-federate-client-tls\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.371322 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-serving-certs-ca-bundle\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.371322 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-secret-telemeter-client\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.371322 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-metrics-client-ca\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.372008 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371979    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.372132 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.371992    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-metrics-client-ca\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.372132 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.372017    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83f6c72-13fb-43d1-a251-d10d7635149d-serving-certs-ca-bundle\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.373721 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.373691    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-telemeter-client-tls\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.373805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.373701    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.374125 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.374018    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-secret-telemeter-client\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.374410 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.374024    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d83f6c72-13fb-43d1-a251-d10d7635149d-federate-client-tls\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.381560 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.381533    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqfwk\" (UniqueName: \"kubernetes.io/projected/d83f6c72-13fb-43d1-a251-d10d7635149d-kube-api-access-xqfwk\") pod \"telemeter-client-7c86c57c4-8cmkl\" (UID: \"d83f6c72-13fb-43d1-a251-d10d7635149d\") " pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.518416 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.518329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"
Jun 06 05:13:56.654100 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.654032    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c86c57c4-8cmkl"]
Jun 06 05:13:56.656613 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:13:56.656584    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83f6c72_13fb_43d1_a251_d10d7635149d.slice/crio-393b78dce970f52bd9620cf3e2315546007dbcf4ef8d7782b465ae0c3d583baf WatchSource:0}: Error finding container 393b78dce970f52bd9620cf3e2315546007dbcf4ef8d7782b465ae0c3d583baf: Status 404 returned error can't find the container with id 393b78dce970f52bd9620cf3e2315546007dbcf4ef8d7782b465ae0c3d583baf
Jun 06 05:13:56.658656 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.658638    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:13:56.789387 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:56.789308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl" event={"ID":"d83f6c72-13fb-43d1-a251-d10d7635149d","Type":"ContainerStarted","Data":"393b78dce970f52bd9620cf3e2315546007dbcf4ef8d7782b465ae0c3d583baf"}
Jun 06 05:13:58.802024 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:58.801984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl" event={"ID":"d83f6c72-13fb-43d1-a251-d10d7635149d","Type":"ContainerStarted","Data":"364e3f43f13725dfba6c7cfad64fc9a5f4af9095862a99c184ebcc99e0f9655f"}
Jun 06 05:13:58.802478 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:58.802043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl" event={"ID":"d83f6c72-13fb-43d1-a251-d10d7635149d","Type":"ContainerStarted","Data":"9328611bb1bf23b0af9d8eefc1c716c7d4c0c219c9ef6d29e42ff07a391d5371"}
Jun 06 05:13:58.802478 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:58.802066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl" event={"ID":"d83f6c72-13fb-43d1-a251-d10d7635149d","Type":"ContainerStarted","Data":"ab075a6e6926933ba866a10f80ed3af9cf3fe8860ac07cce6e431bc3050a33ac"}
Jun 06 05:13:58.822546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:13:58.822496    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c86c57c4-8cmkl" podStartSLOduration=1.384510841 podStartE2EDuration="2.82248077s" totalImagesPullingTime="1.437969929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:13:58.821095867 +0000 UTC m=+321.680158065" watchObservedRunningTime="2026-06-06 05:13:58.82248077 +0000 UTC m=+321.681542946"
Jun 06 05:14:12.168197 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.168152    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76b6dbb575-dwwjw" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console" containerID="cri-o://22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3" gracePeriod=15
Jun 06 05:14:12.411969 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.411941    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:14:12.511805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.511706    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-service-ca\") pod \"9e4193ce-d3da-4de1-924b-460ac425705c\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") "
Jun 06 05:14:12.511805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.511757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-serving-cert\") pod \"9e4193ce-d3da-4de1-924b-460ac425705c\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") "
Jun 06 05:14:12.511805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.511795    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7npcf\" (UniqueName: \"kubernetes.io/projected/9e4193ce-d3da-4de1-924b-460ac425705c-kube-api-access-7npcf\") pod \"9e4193ce-d3da-4de1-924b-460ac425705c\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") "
Jun 06 05:14:12.512094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.511825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-oauth-serving-cert\") pod \"9e4193ce-d3da-4de1-924b-460ac425705c\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") "
Jun 06 05:14:12.512094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.511863    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-oauth-config\") pod \"9e4193ce-d3da-4de1-924b-460ac425705c\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") "
Jun 06 05:14:12.512094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.511969    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-trusted-ca-bundle\") pod \"9e4193ce-d3da-4de1-924b-460ac425705c\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") "
Jun 06 05:14:12.512094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.511991    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-console-config\") pod \"9e4193ce-d3da-4de1-924b-460ac425705c\" (UID: \"9e4193ce-d3da-4de1-924b-460ac425705c\") "
Jun 06 05:14:12.512321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512241    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e4193ce-d3da-4de1-924b-460ac425705c" (UID: "9e4193ce-d3da-4de1-924b-460ac425705c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:14:12.512392 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512252    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e4193ce-d3da-4de1-924b-460ac425705c" (UID: "9e4193ce-d3da-4de1-924b-460ac425705c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:14:12.512449 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512420    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9e4193ce-d3da-4de1-924b-460ac425705c" (UID: "9e4193ce-d3da-4de1-924b-460ac425705c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:14:12.512503 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512465    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-console-config" (OuterVolumeSpecName: "console-config") pod "9e4193ce-d3da-4de1-924b-460ac425705c" (UID: "9e4193ce-d3da-4de1-924b-460ac425705c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:14:12.512711 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512694    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-trusted-ca-bundle\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:12.512778 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512715    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-console-config\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:12.512778 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512728    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-service-ca\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:12.512778 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.512740    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e4193ce-d3da-4de1-924b-460ac425705c-oauth-serving-cert\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:12.514186 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.514153    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e4193ce-d3da-4de1-924b-460ac425705c" (UID: "9e4193ce-d3da-4de1-924b-460ac425705c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:14:12.514308 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.514192    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e4193ce-d3da-4de1-924b-460ac425705c" (UID: "9e4193ce-d3da-4de1-924b-460ac425705c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:14:12.514308 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.514220    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e4193ce-d3da-4de1-924b-460ac425705c-kube-api-access-7npcf" (OuterVolumeSpecName: "kube-api-access-7npcf") pod "9e4193ce-d3da-4de1-924b-460ac425705c" (UID: "9e4193ce-d3da-4de1-924b-460ac425705c"). InnerVolumeSpecName "kube-api-access-7npcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:14:12.613524 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.613491    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-serving-cert\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:12.613524 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.613518    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7npcf\" (UniqueName: \"kubernetes.io/projected/9e4193ce-d3da-4de1-924b-460ac425705c-kube-api-access-7npcf\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:12.613524 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.613526    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e4193ce-d3da-4de1-924b-460ac425705c-console-oauth-config\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:12.867290 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.867232    2582 generic.go:356] "Generic (PLEG): container finished" podID="9e4193ce-d3da-4de1-924b-460ac425705c" containerID="22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3" exitCode=0
Jun 06 05:14:12.867464 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.867294    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76b6dbb575-dwwjw"
Jun 06 05:14:12.867464 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.867321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b6dbb575-dwwjw" event={"ID":"9e4193ce-d3da-4de1-924b-460ac425705c","Type":"ContainerDied","Data":"22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3"}
Jun 06 05:14:12.867464 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.867371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76b6dbb575-dwwjw" event={"ID":"9e4193ce-d3da-4de1-924b-460ac425705c","Type":"ContainerDied","Data":"88f8f75a5d3b27b8e45b7e9d5e6405f7c2682da44af7be75ef567f00d8355aae"}
Jun 06 05:14:12.867464 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.867392    2582 scope.go:117] "RemoveContainer" containerID="22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3"
Jun 06 05:14:12.878455 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.878249    2582 scope.go:117] "RemoveContainer" containerID="22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3"
Jun 06 05:14:12.879204 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:14:12.879174    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3\": container with ID starting with 22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3 not found: ID does not exist" containerID="22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3"
Jun 06 05:14:12.879319 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.879213    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3"} err="failed to get container status \"22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3\": rpc error: code = NotFound desc = could not find container \"22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3\": container with ID starting with 22c83204a44ac6c7d686b05028b391a529379e7c0102dc4cfbfae380bf29a6f3 not found: ID does not exist"
Jun 06 05:14:12.888470 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.888448    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76b6dbb575-dwwjw"]
Jun 06 05:14:12.890772 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:12.890751    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76b6dbb575-dwwjw"]
Jun 06 05:14:13.596226 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:13.596183    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" path="/var/lib/kubelet/pods/9e4193ce-d3da-4de1-924b-460ac425705c/volumes"
Jun 06 05:14:16.791440 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:16.791353    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c9b496446-dgprz" podUID="d13314ee-5ca9-46e9-b13f-cb95c3519fca" containerName="registry" containerID="cri-o://b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b" gracePeriod=30
Jun 06 05:14:17.046752 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.046687    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:14:17.150207 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150174    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-trusted-ca\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150207 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150209    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d13314ee-5ca9-46e9-b13f-cb95c3519fca-ca-trust-extracted\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150255    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-bound-sa-token\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150362    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-image-registry-private-configuration\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150408    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-installation-pull-secrets\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150626 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150469    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-certificates\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150626 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150499    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n2np\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-kube-api-access-9n2np\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150626 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") pod \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\" (UID: \"d13314ee-5ca9-46e9-b13f-cb95c3519fca\") "
Jun 06 05:14:17.150793 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.150764    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:14:17.151127 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.151094    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:14:17.152920 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.152885    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-kube-api-access-9n2np" (OuterVolumeSpecName: "kube-api-access-9n2np") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "kube-api-access-9n2np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:14:17.153022 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.152999    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:14:17.153091 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.153053    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:14:17.153091 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.153065    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:14:17.153164 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.153096    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:14:17.161130 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.161107    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d13314ee-5ca9-46e9-b13f-cb95c3519fca-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d13314ee-5ca9-46e9-b13f-cb95c3519fca" (UID: "d13314ee-5ca9-46e9-b13f-cb95c3519fca"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:14:17.251675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251639    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-image-registry-private-configuration\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.251675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251669    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d13314ee-5ca9-46e9-b13f-cb95c3519fca-installation-pull-secrets\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.251675 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251682    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-certificates\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.251911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251690    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n2np\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-kube-api-access-9n2np\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.251911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251699    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-registry-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.251911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251707    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d13314ee-5ca9-46e9-b13f-cb95c3519fca-trusted-ca\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.251911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251715    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d13314ee-5ca9-46e9-b13f-cb95c3519fca-ca-trust-extracted\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.251911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.251725    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13314ee-5ca9-46e9-b13f-cb95c3519fca-bound-sa-token\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:14:17.890856 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.890769    2582 generic.go:356] "Generic (PLEG): container finished" podID="d13314ee-5ca9-46e9-b13f-cb95c3519fca" containerID="b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b" exitCode=0
Jun 06 05:14:17.890856 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.890811    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9b496446-dgprz"
Jun 06 05:14:17.891378 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.890855    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9b496446-dgprz" event={"ID":"d13314ee-5ca9-46e9-b13f-cb95c3519fca","Type":"ContainerDied","Data":"b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b"}
Jun 06 05:14:17.891378 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.890908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9b496446-dgprz" event={"ID":"d13314ee-5ca9-46e9-b13f-cb95c3519fca","Type":"ContainerDied","Data":"c344531aea3a6b0763d762d897d0d703d0f311c8ce32e33701073b88961570c4"}
Jun 06 05:14:17.891378 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.890935    2582 scope.go:117] "RemoveContainer" containerID="b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b"
Jun 06 05:14:17.899289 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.899261    2582 scope.go:117] "RemoveContainer" containerID="b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b"
Jun 06 05:14:17.899549 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:14:17.899528    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b\": container with ID starting with b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b not found: ID does not exist" containerID="b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b"
Jun 06 05:14:17.899632 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.899554    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b"} err="failed to get container status \"b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b\": rpc error: code = NotFound desc = could not find container \"b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b\": container with ID starting with b3e76242ee5f9cbc62af0865fbe2eeb3b517b636a4a35347a32ea69686090d2b not found: ID does not exist"
Jun 06 05:14:17.908112 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.908089    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9b496446-dgprz"]
Jun 06 05:14:17.911145 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:17.911120    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c9b496446-dgprz"]
Jun 06 05:14:19.596132 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:14:19.596096    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d13314ee-5ca9-46e9-b13f-cb95c3519fca" path="/var/lib/kubelet/pods/d13314ee-5ca9-46e9-b13f-cb95c3519fca/volumes"
Jun 06 05:15:16.454238 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.454154    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f667c4fdc-9hl8l"]
Jun 06 05:15:16.454638 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.454577    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d13314ee-5ca9-46e9-b13f-cb95c3519fca" containerName="registry"
Jun 06 05:15:16.454638 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.454591    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d13314ee-5ca9-46e9-b13f-cb95c3519fca" containerName="registry"
Jun 06 05:15:16.454638 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.454606    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console"
Jun 06 05:15:16.454638 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.454611    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console"
Jun 06 05:15:16.454762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.454693    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d13314ee-5ca9-46e9-b13f-cb95c3519fca" containerName="registry"
Jun 06 05:15:16.454762 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.454703    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e4193ce-d3da-4de1-924b-460ac425705c" containerName="console"
Jun 06 05:15:16.458835 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.458816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.462614 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.462590    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 06 05:15:16.462614 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.462604    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 06 05:15:16.462802 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.462592    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 06 05:15:16.462802 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.462648    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvmzr\""
Jun 06 05:15:16.462802 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.462766    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 06 05:15:16.462933 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.462834    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 06 05:15:16.467982 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.467962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 06 05:15:16.468866 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.468849    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f667c4fdc-9hl8l"]
Jun 06 05:15:16.549012 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.548978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-config\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.549183 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.549021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg4zl\" (UniqueName: \"kubernetes.io/projected/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-kube-api-access-jg4zl\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.549183 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.549049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-serving-cert\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.549183 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.549136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-oauth-config\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.549183 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.549169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-service-ca\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.549360 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.549192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-trusted-ca-bundle\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.549360 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.549214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-oauth-serving-cert\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.650638 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.650603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-oauth-config\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.650804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.650642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-service-ca\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.650804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.650673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-trusted-ca-bundle\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.650804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.650703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-oauth-serving-cert\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.650804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.650756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-config\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.650804 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.650793    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg4zl\" (UniqueName: \"kubernetes.io/projected/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-kube-api-access-jg4zl\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.651028 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.650818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-serving-cert\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.651617 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.651581    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-oauth-serving-cert\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.651617 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.651609    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-service-ca\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.651821 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.651640    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-config\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.651821 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.651682    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-trusted-ca-bundle\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.653118 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.653087    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-serving-cert\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.653210 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.653151    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-oauth-config\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.658525 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.658508    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg4zl\" (UniqueName: \"kubernetes.io/projected/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-kube-api-access-jg4zl\") pod \"console-6f667c4fdc-9hl8l\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") " pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.769825 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.769732    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:16.896692 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:16.896647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f667c4fdc-9hl8l"]
Jun 06 05:15:16.899280 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:15:16.899240    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49aacfd6_8f2e_4697_a9c4_f4b7269d103d.slice/crio-dcb01026ec2cccb165eb89a695be672fe4b447783bc37062b012093e388c82e5 WatchSource:0}: Error finding container dcb01026ec2cccb165eb89a695be672fe4b447783bc37062b012093e388c82e5: Status 404 returned error can't find the container with id dcb01026ec2cccb165eb89a695be672fe4b447783bc37062b012093e388c82e5
Jun 06 05:15:17.144733 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:17.144688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f667c4fdc-9hl8l" event={"ID":"49aacfd6-8f2e-4697-a9c4-f4b7269d103d","Type":"ContainerStarted","Data":"40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e"}
Jun 06 05:15:17.144947 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:17.144818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f667c4fdc-9hl8l" event={"ID":"49aacfd6-8f2e-4697-a9c4-f4b7269d103d","Type":"ContainerStarted","Data":"dcb01026ec2cccb165eb89a695be672fe4b447783bc37062b012093e388c82e5"}
Jun 06 05:15:17.162472 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:17.162422    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f667c4fdc-9hl8l" podStartSLOduration=1.162407084 podStartE2EDuration="1.162407084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:15:17.160961733 +0000 UTC m=+400.020023913" watchObservedRunningTime="2026-06-06 05:15:17.162407084 +0000 UTC m=+400.021469261"
Jun 06 05:15:26.770157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:26.770118    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:26.770646 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:26.770172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:26.774973 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:26.774951    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:15:27.189932 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:15:27.189901    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:17:08.944558 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:08.944523    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"]
Jun 06 05:17:08.947899 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:08.947883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:17:08.950331 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:08.950308    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 06 05:17:08.950331 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:08.950327    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 06 05:17:08.951463 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:08.951445    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-vgfxn\""
Jun 06 05:17:08.956173 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:08.956152    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"]
Jun 06 05:17:09.112558 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:09.112524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg44t\" (UniqueName: \"kubernetes.io/projected/05928c59-4e8c-4414-a8b1-f4fd814652de-kube-api-access-jg44t\") pod \"feast-operator-controller-manager-59b4bcb6d8-llxkl\" (UID: \"05928c59-4e8c-4414-a8b1-f4fd814652de\") " pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:17:09.213812 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:09.213712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg44t\" (UniqueName: \"kubernetes.io/projected/05928c59-4e8c-4414-a8b1-f4fd814652de-kube-api-access-jg44t\") pod \"feast-operator-controller-manager-59b4bcb6d8-llxkl\" (UID: \"05928c59-4e8c-4414-a8b1-f4fd814652de\") " pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:17:09.222445 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:09.222422    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg44t\" (UniqueName: \"kubernetes.io/projected/05928c59-4e8c-4414-a8b1-f4fd814652de-kube-api-access-jg44t\") pod \"feast-operator-controller-manager-59b4bcb6d8-llxkl\" (UID: \"05928c59-4e8c-4414-a8b1-f4fd814652de\") " pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:17:09.259030 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:09.258994    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:17:09.385422 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:09.385399    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"]
Jun 06 05:17:09.388031 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:17:09.388000    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05928c59_4e8c_4414_a8b1_f4fd814652de.slice/crio-c94371b63aad829b8e7a24ed3c8200f461c2455ffbda2b3650590f53e03fca31 WatchSource:0}: Error finding container c94371b63aad829b8e7a24ed3c8200f461c2455ffbda2b3650590f53e03fca31: Status 404 returned error can't find the container with id c94371b63aad829b8e7a24ed3c8200f461c2455ffbda2b3650590f53e03fca31
Jun 06 05:17:09.604166 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:09.604133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl" event={"ID":"05928c59-4e8c-4414-a8b1-f4fd814652de","Type":"ContainerStarted","Data":"c94371b63aad829b8e7a24ed3c8200f461c2455ffbda2b3650590f53e03fca31"}
Jun 06 05:17:13.624494 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:13.624457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl" event={"ID":"05928c59-4e8c-4414-a8b1-f4fd814652de","Type":"ContainerStarted","Data":"8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61"}
Jun 06 05:17:13.624886 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:13.624546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:17:13.641333 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:13.641260    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl" podStartSLOduration=2.2462650379999998 podStartE2EDuration="5.641245772s" totalImagesPullingTime="3.394980734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:17:13.638903951 +0000 UTC m=+516.497966133" watchObservedRunningTime="2026-06-06 05:17:13.641245772 +0000 UTC m=+516.500307995"
Jun 06 05:17:24.632367 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:24.632332    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:17:52.054897 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.054858    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"]
Jun 06 05:17:52.059712 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.059694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.062498 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.062474    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 06 05:17:52.062722 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.062701    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 06 05:17:52.062902 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.062649    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 06 05:17:52.062984 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.062532    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 06 05:17:52.063041 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.063011    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 06 05:17:52.063109 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.063092    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8thrr\""
Jun 06 05:17:52.063312 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.063292    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 06 05:17:52.063414 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.063190    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 06 05:17:52.070512 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.070493    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"]
Jun 06 05:17:52.180408 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.180370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4873858a-5e1c-4ab2-a108-b38b9282ea58-feast-data\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.180578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.180427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.180578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.180462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.180578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.180495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-offline-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.180578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.180522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-online-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.180746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.180584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddqc\" (UniqueName: \"kubernetes.io/projected/4873858a-5e1c-4ab2-a108-b38b9282ea58-kube-api-access-wddqc\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.281278 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.281241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4873858a-5e1c-4ab2-a108-b38b9282ea58-feast-data\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.281478 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.281309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.281478 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.281340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.281478 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.281372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-offline-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.281478 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.281396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-online-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.281478 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:17:52.281437    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 06 05:17:52.281757 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:17:52.281520    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls podName:4873858a-5e1c-4ab2-a108-b38b9282ea58 nodeName:}" failed. No retries permitted until 2026-06-06 05:17:52.781496726 +0000 UTC m=+555.640558889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls") pod "feast-simple-feast-setup-849fffb958-mj2gf" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 06 05:17:52.281757 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:17:52.281524    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:17:52.281757 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:17:52.281582    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls podName:4873858a-5e1c-4ab2-a108-b38b9282ea58 nodeName:}" failed. No retries permitted until 2026-06-06 05:17:52.781565211 +0000 UTC m=+555.640627371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls") pod "feast-simple-feast-setup-849fffb958-mj2gf" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:17:52.281757 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.281558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddqc\" (UniqueName: \"kubernetes.io/projected/4873858a-5e1c-4ab2-a108-b38b9282ea58-kube-api-access-wddqc\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.281757 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.281724    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4873858a-5e1c-4ab2-a108-b38b9282ea58-feast-data\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.283911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.283889    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-offline-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.284027 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.284013    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-online-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.289156 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.289139    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddqc\" (UniqueName: \"kubernetes.io/projected/4873858a-5e1c-4ab2-a108-b38b9282ea58-kube-api-access-wddqc\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.785326 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.785294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.785502 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.785419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.787678 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.787654    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.787678 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.787678    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-mj2gf\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:52.981786 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:52.981755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:17:53.113090 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:53.113057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"]
Jun 06 05:17:53.113559 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:17:53.113533    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4873858a_5e1c_4ab2_a108_b38b9282ea58.slice/crio-96dd8a4bf47ce83bee726691a8d11015db513d4d1bcb27a067cef4c38f91ffd4 WatchSource:0}: Error finding container 96dd8a4bf47ce83bee726691a8d11015db513d4d1bcb27a067cef4c38f91ffd4: Status 404 returned error can't find the container with id 96dd8a4bf47ce83bee726691a8d11015db513d4d1bcb27a067cef4c38f91ffd4
Jun 06 05:17:53.805258 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:17:53.805167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerStarted","Data":"96dd8a4bf47ce83bee726691a8d11015db513d4d1bcb27a067cef4c38f91ffd4"}
Jun 06 05:18:25.971208 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:25.971161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerStarted","Data":"a4d074306826ad30851af1342dc9604518d40191b0eae29f6846f513f3787a63"}
Jun 06 05:18:29.993930 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:29.993895    2582 generic.go:356] "Generic (PLEG): container finished" podID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerID="a4d074306826ad30851af1342dc9604518d40191b0eae29f6846f513f3787a63" exitCode=0
Jun 06 05:18:29.994380 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:29.993953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerDied","Data":"a4d074306826ad30851af1342dc9604518d40191b0eae29f6846f513f3787a63"}
Jun 06 05:18:30.999947 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:30.999917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerStarted","Data":"54aab6207c874d16dad142b2de00165073b9086a9fafcb0a3f7004211a7d132a"}
Jun 06 05:18:36.024699 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:36.024664    2582 generic.go:356] "Generic (PLEG): container finished" podID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerID="54aab6207c874d16dad142b2de00165073b9086a9fafcb0a3f7004211a7d132a" exitCode=0
Jun 06 05:18:36.025068 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:36.024732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerDied","Data":"54aab6207c874d16dad142b2de00165073b9086a9fafcb0a3f7004211a7d132a"}
Jun 06 05:18:37.036085 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.036033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerStarted","Data":"d348ec7ac2d8a5ffc513c57adbcdb9391b64c0a0438db3c0de1ab1f73bd0b060"}
Jun 06 05:18:37.036085 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.036092    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerStarted","Data":"f6e4f0a070e61e42efb982a9e9d02a8148a1528963975c5de2af1113224f0285"}
Jun 06 05:18:37.036628 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.036111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerStarted","Data":"94bb10bc267fb693270b7adec913ebe3083c8803c3166d6cf9b61456a05d4a87"}
Jun 06 05:18:37.036628 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.036129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerStarted","Data":"a2109c4622d2cc4805b84a06955357efeea55b48add6fe10e4a29ab51eba0cd3"}
Jun 06 05:18:37.062086 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.062017    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podStartSLOduration=13.274524874 podStartE2EDuration="45.06199313s" totalImagesPullingTime="31.787468256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:18:37.06036493 +0000 UTC m=+599.919427108" watchObservedRunningTime="2026-06-06 05:18:37.06199313 +0000 UTC m=+599.921055308"
Jun 06 05:18:37.595691 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.595657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:18:37.596441 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.596414    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:18:37.982555 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.982432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:37.982797 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.982773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:37.982936 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.982808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:37.982936 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.982828    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:37.985005 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.984872    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jun 06 05:18:37.985005 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.984901    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Jun 06 05:18:37.985005 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.984952    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jun 06 05:18:37.985005 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:37.984893    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Jun 06 05:18:40.982547 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:40.982504    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused"
Jun 06 05:18:40.983330 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:40.982502    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jun 06 05:18:40.983466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:40.982504    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Jun 06 05:18:40.983466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:40.982514    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jun 06 05:18:42.982423 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:42.982365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:42.984873 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:42.982441    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:42.984873 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:42.982456    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:42.984873 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:42.982466    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:43.982563 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:43.982528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:43.983050 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:43.982821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:43.983115 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:43.983051    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:43.983329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:43.983313    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:43.983410 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:43.983367    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:43.987109 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:43.987093    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:44.078703 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:44.078680    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:18:44.080731 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:18:44.080717    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:19:13.488014 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:13.487931    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f667c4fdc-9hl8l"]
Jun 06 05:19:38.510520 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.510449    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f667c4fdc-9hl8l" podUID="49aacfd6-8f2e-4697-a9c4-f4b7269d103d" containerName="console" containerID="cri-o://40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e" gracePeriod=15
Jun 06 05:19:38.758958 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.758933    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:19:38.924715 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.924671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-config\") pod \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") "
Jun 06 05:19:38.924715 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.924724    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-serving-cert\") pod \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") "
Jun 06 05:19:38.924997 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.924774    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-oauth-config\") pod \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") "
Jun 06 05:19:38.924997 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.924808    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-oauth-serving-cert\") pod \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") "
Jun 06 05:19:38.924997 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.924825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-trusted-ca-bundle\") pod \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") "
Jun 06 05:19:38.924997 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.924847    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg4zl\" (UniqueName: \"kubernetes.io/projected/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-kube-api-access-jg4zl\") pod \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") "
Jun 06 05:19:38.924997 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.924963    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-service-ca\") pod \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\" (UID: \"49aacfd6-8f2e-4697-a9c4-f4b7269d103d\") "
Jun 06 05:19:38.925256 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.925129    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-config" (OuterVolumeSpecName: "console-config") pod "49aacfd6-8f2e-4697-a9c4-f4b7269d103d" (UID: "49aacfd6-8f2e-4697-a9c4-f4b7269d103d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:19:38.925346 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.925305    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-config\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:19:38.925588 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.925561    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-service-ca" (OuterVolumeSpecName: "service-ca") pod "49aacfd6-8f2e-4697-a9c4-f4b7269d103d" (UID: "49aacfd6-8f2e-4697-a9c4-f4b7269d103d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:19:38.925658 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.925571    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "49aacfd6-8f2e-4697-a9c4-f4b7269d103d" (UID: "49aacfd6-8f2e-4697-a9c4-f4b7269d103d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:19:38.925862 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.925840    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "49aacfd6-8f2e-4697-a9c4-f4b7269d103d" (UID: "49aacfd6-8f2e-4697-a9c4-f4b7269d103d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:19:38.927118 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.927098    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "49aacfd6-8f2e-4697-a9c4-f4b7269d103d" (UID: "49aacfd6-8f2e-4697-a9c4-f4b7269d103d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:19:38.927516 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.927488    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-kube-api-access-jg4zl" (OuterVolumeSpecName: "kube-api-access-jg4zl") pod "49aacfd6-8f2e-4697-a9c4-f4b7269d103d" (UID: "49aacfd6-8f2e-4697-a9c4-f4b7269d103d"). InnerVolumeSpecName "kube-api-access-jg4zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:19:38.927516 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:38.927491    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "49aacfd6-8f2e-4697-a9c4-f4b7269d103d" (UID: "49aacfd6-8f2e-4697-a9c4-f4b7269d103d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:19:39.026498 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.026451    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-oauth-config\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:19:39.026498 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.026492    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-oauth-serving-cert\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:19:39.026498 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.026503    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-trusted-ca-bundle\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:19:39.026498 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.026511    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg4zl\" (UniqueName: \"kubernetes.io/projected/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-kube-api-access-jg4zl\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:19:39.026811 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.026521    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-service-ca\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:19:39.026811 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.026530    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49aacfd6-8f2e-4697-a9c4-f4b7269d103d-console-serving-cert\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:19:39.331807 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.331722    2582 generic.go:356] "Generic (PLEG): container finished" podID="49aacfd6-8f2e-4697-a9c4-f4b7269d103d" containerID="40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e" exitCode=0
Jun 06 05:19:39.331807 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.331764    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f667c4fdc-9hl8l"
Jun 06 05:19:39.331989 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.331805    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f667c4fdc-9hl8l" event={"ID":"49aacfd6-8f2e-4697-a9c4-f4b7269d103d","Type":"ContainerDied","Data":"40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e"}
Jun 06 05:19:39.331989 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.331874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f667c4fdc-9hl8l" event={"ID":"49aacfd6-8f2e-4697-a9c4-f4b7269d103d","Type":"ContainerDied","Data":"dcb01026ec2cccb165eb89a695be672fe4b447783bc37062b012093e388c82e5"}
Jun 06 05:19:39.331989 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.331894    2582 scope.go:117] "RemoveContainer" containerID="40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e"
Jun 06 05:19:39.340844 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.340827    2582 scope.go:117] "RemoveContainer" containerID="40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e"
Jun 06 05:19:39.341087 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:19:39.341069    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e\": container with ID starting with 40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e not found: ID does not exist" containerID="40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e"
Jun 06 05:19:39.341134 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.341095    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e"} err="failed to get container status \"40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e\": rpc error: code = NotFound desc = could not find container \"40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e\": container with ID starting with 40976e11feb6ac9f107b4ecc5ef503dd0c517e23527474a4487f37765c0bc35e not found: ID does not exist"
Jun 06 05:19:39.353145 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.353099    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f667c4fdc-9hl8l"]
Jun 06 05:19:39.354725 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.354695    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f667c4fdc-9hl8l"]
Jun 06 05:19:39.596277 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:39.596233    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49aacfd6-8f2e-4697-a9c4-f4b7269d103d" path="/var/lib/kubelet/pods/49aacfd6-8f2e-4697-a9c4-f4b7269d103d/volumes"
Jun 06 05:19:45.239964 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.239928    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"]
Jun 06 05:19:45.240600 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.240215    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="registry" containerID="cri-o://a2109c4622d2cc4805b84a06955357efeea55b48add6fe10e4a29ab51eba0cd3" gracePeriod=30
Jun 06 05:19:45.240600 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.240571    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui" containerID="cri-o://d348ec7ac2d8a5ffc513c57adbcdb9391b64c0a0438db3c0de1ab1f73bd0b060" gracePeriod=30
Jun 06 05:19:45.240714 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.240611    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="offline" containerID="cri-o://f6e4f0a070e61e42efb982a9e9d02a8148a1528963975c5de2af1113224f0285" gracePeriod=30
Jun 06 05:19:45.240714 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.240696    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online" containerID="cri-o://94bb10bc267fb693270b7adec913ebe3083c8803c3166d6cf9b61456a05d4a87" gracePeriod=30
Jun 06 05:19:45.496987 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.496887    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"]
Jun 06 05:19:45.497493 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.497470    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49aacfd6-8f2e-4697-a9c4-f4b7269d103d" containerName="console"
Jun 06 05:19:45.497579 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.497496    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="49aacfd6-8f2e-4697-a9c4-f4b7269d103d" containerName="console"
Jun 06 05:19:45.497656 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.497642    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="49aacfd6-8f2e-4697-a9c4-f4b7269d103d" containerName="console"
Jun 06 05:19:45.503510 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.503488    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.506340 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.506288    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-6zgt2\""
Jun 06 05:19:45.512741 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.512715    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"]
Jun 06 05:19:45.684678 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.684646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-registry-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.684815 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.684711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zztx7\" (UniqueName: \"kubernetes.io/projected/2cd7d57e-3596-4bd9-b063-ed6645245857-kube-api-access-zztx7\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.685007 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.684984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-online-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.685142 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.685116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-offline-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.685219 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.685194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.685335 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.685231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd7d57e-3596-4bd9-b063-ed6645245857-feast-data\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.786383 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.786339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-registry-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.786582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.786420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zztx7\" (UniqueName: \"kubernetes.io/projected/2cd7d57e-3596-4bd9-b063-ed6645245857-kube-api-access-zztx7\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.786582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.786454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-online-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.786712 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.786491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-offline-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.786712 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.786667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.786712 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.786704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd7d57e-3596-4bd9-b063-ed6645245857-feast-data\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.786874 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:19:45.786847    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 06 05:19:45.786936 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:19:45.786925    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls podName:2cd7d57e-3596-4bd9-b063-ed6645245857 nodeName:}" failed. No retries permitted until 2026-06-06 05:19:46.286904151 +0000 UTC m=+669.145966310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls") pod "feast-simple-feast-setup-849fffb958-s72b4" (UID: "2cd7d57e-3596-4bd9-b063-ed6645245857") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 06 05:19:45.787155 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.787129    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd7d57e-3596-4bd9-b063-ed6645245857-feast-data\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.789462 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.789436    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-online-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.789662 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.789640    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-offline-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.789751 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.789687    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-registry-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:45.794701 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:45.794670    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zztx7\" (UniqueName: \"kubernetes.io/projected/2cd7d57e-3596-4bd9-b063-ed6645245857-kube-api-access-zztx7\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:46.291430 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.291390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:46.293771 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.293752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls\") pod \"feast-simple-feast-setup-849fffb958-s72b4\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") " pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:46.369080 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.369046    2582 generic.go:356] "Generic (PLEG): container finished" podID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerID="d348ec7ac2d8a5ffc513c57adbcdb9391b64c0a0438db3c0de1ab1f73bd0b060" exitCode=0
Jun 06 05:19:46.369080 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.369071    2582 generic.go:356] "Generic (PLEG): container finished" podID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerID="94bb10bc267fb693270b7adec913ebe3083c8803c3166d6cf9b61456a05d4a87" exitCode=0
Jun 06 05:19:46.369264 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.369119    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerDied","Data":"d348ec7ac2d8a5ffc513c57adbcdb9391b64c0a0438db3c0de1ab1f73bd0b060"}
Jun 06 05:19:46.369264 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.369156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerDied","Data":"94bb10bc267fb693270b7adec913ebe3083c8803c3166d6cf9b61456a05d4a87"}
Jun 06 05:19:46.417791 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.417755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:19:46.552824 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:46.552798    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"]
Jun 06 05:19:46.553319 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:19:46.553295    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cd7d57e_3596_4bd9_b063_ed6645245857.slice/crio-37531d69162a599553b92b4149ef76ee7de06d001b174d18ccd316f0106dd5e2 WatchSource:0}: Error finding container 37531d69162a599553b92b4149ef76ee7de06d001b174d18ccd316f0106dd5e2: Status 404 returned error can't find the container with id 37531d69162a599553b92b4149ef76ee7de06d001b174d18ccd316f0106dd5e2
Jun 06 05:19:47.376315 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:47.376264    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerStarted","Data":"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"}
Jun 06 05:19:47.376774 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:47.376330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerStarted","Data":"37531d69162a599553b92b4149ef76ee7de06d001b174d18ccd316f0106dd5e2"}
Jun 06 05:19:51.395898 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:51.395855    2582 generic.go:356] "Generic (PLEG): container finished" podID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerID="b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c" exitCode=0
Jun 06 05:19:51.396298 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:51.395938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerDied","Data":"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"}
Jun 06 05:19:52.402782 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:52.402748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerStarted","Data":"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"}
Jun 06 05:19:54.078680 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:54.078635    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jun 06 05:19:54.079121 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:54.078744    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jun 06 05:19:57.428559 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:57.428525    2582 generic.go:356] "Generic (PLEG): container finished" podID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerID="6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216" exitCode=0
Jun 06 05:19:57.428559 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:57.428563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerDied","Data":"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"}
Jun 06 05:19:58.439845 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:58.439805    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerStarted","Data":"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"}
Jun 06 05:19:58.440353 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:58.439873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerStarted","Data":"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"}
Jun 06 05:19:58.440353 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:58.439895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerStarted","Data":"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"}
Jun 06 05:19:58.440353 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:58.439913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerStarted","Data":"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"}
Jun 06 05:19:58.467174 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:19:58.467103    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podStartSLOduration=13.467080373 podStartE2EDuration="13.467080373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:19:58.464080333 +0000 UTC m=+681.323142521" watchObservedRunningTime="2026-06-06 05:19:58.467080373 +0000 UTC m=+681.326142552"
Jun 06 05:20:01.418009 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.417968    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:01.418582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.418564    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:01.418693 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.418683    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:01.419062 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.419047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:01.420704 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.420408    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jun 06 05:20:01.420704 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.420474    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Jun 06 05:20:01.420704 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.420481    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Jun 06 05:20:01.420704 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:01.420630    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 06 05:20:04.078440 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.078399    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jun 06 05:20:04.078884 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.078465    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jun 06 05:20:04.419493 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.419461    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.419666 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.419646    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.419907 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.419884    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.420226 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.420206    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.420352 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.420238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.420352 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.420256    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.420481 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.420460    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.420749 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.420732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.420832 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.420796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.424223 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.424201    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.476546 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.476515    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:04.479587 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:04.479568    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:20:14.079323 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:14.079257    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Jun 06 05:20:14.079718 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:14.079249    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused"
Jun 06 05:20:14.079718 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:14.079410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:20:14.079718 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:14.079478    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:20:15.533466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:15.533380    2582 generic.go:356] "Generic (PLEG): container finished" podID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerID="f6e4f0a070e61e42efb982a9e9d02a8148a1528963975c5de2af1113224f0285" exitCode=137
Jun 06 05:20:15.533466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:15.533407    2582 generic.go:356] "Generic (PLEG): container finished" podID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerID="a2109c4622d2cc4805b84a06955357efeea55b48add6fe10e4a29ab51eba0cd3" exitCode=137
Jun 06 05:20:15.533466 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:15.533449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerDied","Data":"f6e4f0a070e61e42efb982a9e9d02a8148a1528963975c5de2af1113224f0285"}
Jun 06 05:20:15.533880 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:15.533492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerDied","Data":"a2109c4622d2cc4805b84a06955357efeea55b48add6fe10e4a29ab51eba0cd3"}
Jun 06 05:20:15.898801 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:15.898775    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:20:16.074363 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.074262    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls\") pod \"4873858a-5e1c-4ab2-a108-b38b9282ea58\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") "
Jun 06 05:20:16.074363 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.074344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-offline-tls\") pod \"4873858a-5e1c-4ab2-a108-b38b9282ea58\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") "
Jun 06 05:20:16.074363 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.074363    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wddqc\" (UniqueName: \"kubernetes.io/projected/4873858a-5e1c-4ab2-a108-b38b9282ea58-kube-api-access-wddqc\") pod \"4873858a-5e1c-4ab2-a108-b38b9282ea58\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") "
Jun 06 05:20:16.074603 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.074405    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls\") pod \"4873858a-5e1c-4ab2-a108-b38b9282ea58\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") "
Jun 06 05:20:16.074603 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.074433    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4873858a-5e1c-4ab2-a108-b38b9282ea58-feast-data\") pod \"4873858a-5e1c-4ab2-a108-b38b9282ea58\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") "
Jun 06 05:20:16.074603 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.074546    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-online-tls\") pod \"4873858a-5e1c-4ab2-a108-b38b9282ea58\" (UID: \"4873858a-5e1c-4ab2-a108-b38b9282ea58\") "
Jun 06 05:20:16.074997 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.074966    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4873858a-5e1c-4ab2-a108-b38b9282ea58-feast-data" (OuterVolumeSpecName: "feast-data") pod "4873858a-5e1c-4ab2-a108-b38b9282ea58" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:20:16.076898 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.076873    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-online-tls" (OuterVolumeSpecName: "online-tls") pod "4873858a-5e1c-4ab2-a108-b38b9282ea58" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:20:16.077068 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.077002    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4873858a-5e1c-4ab2-a108-b38b9282ea58-kube-api-access-wddqc" (OuterVolumeSpecName: "kube-api-access-wddqc") pod "4873858a-5e1c-4ab2-a108-b38b9282ea58" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58"). InnerVolumeSpecName "kube-api-access-wddqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:20:16.077121 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.077065    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4873858a-5e1c-4ab2-a108-b38b9282ea58" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:20:16.077121 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.077091    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4873858a-5e1c-4ab2-a108-b38b9282ea58" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:20:16.077121 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.077107    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4873858a-5e1c-4ab2-a108-b38b9282ea58" (UID: "4873858a-5e1c-4ab2-a108-b38b9282ea58"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:20:16.175551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.175515    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-ui-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:20:16.175551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.175544    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-offline-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:20:16.175551 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.175556    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wddqc\" (UniqueName: \"kubernetes.io/projected/4873858a-5e1c-4ab2-a108-b38b9282ea58-kube-api-access-wddqc\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:20:16.175794 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.175565    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-registry-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:20:16.175794 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.175576    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4873858a-5e1c-4ab2-a108-b38b9282ea58-feast-data\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:20:16.175794 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.175584    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4873858a-5e1c-4ab2-a108-b38b9282ea58-online-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:20:16.540911 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.540878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf" event={"ID":"4873858a-5e1c-4ab2-a108-b38b9282ea58","Type":"ContainerDied","Data":"96dd8a4bf47ce83bee726691a8d11015db513d4d1bcb27a067cef4c38f91ffd4"}
Jun 06 05:20:16.541319 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.540930    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"
Jun 06 05:20:16.541319 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.540934    2582 scope.go:117] "RemoveContainer" containerID="d348ec7ac2d8a5ffc513c57adbcdb9391b64c0a0438db3c0de1ab1f73bd0b060"
Jun 06 05:20:16.550682 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.550664    2582 scope.go:117] "RemoveContainer" containerID="f6e4f0a070e61e42efb982a9e9d02a8148a1528963975c5de2af1113224f0285"
Jun 06 05:20:16.558738 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.558719    2582 scope.go:117] "RemoveContainer" containerID="94bb10bc267fb693270b7adec913ebe3083c8803c3166d6cf9b61456a05d4a87"
Jun 06 05:20:16.562018 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.561997    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"]
Jun 06 05:20:16.567050 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.567028    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-mj2gf"]
Jun 06 05:20:16.567197 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.567179    2582 scope.go:117] "RemoveContainer" containerID="a2109c4622d2cc4805b84a06955357efeea55b48add6fe10e4a29ab51eba0cd3"
Jun 06 05:20:16.574515 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.574498    2582 scope.go:117] "RemoveContainer" containerID="54aab6207c874d16dad142b2de00165073b9086a9fafcb0a3f7004211a7d132a"
Jun 06 05:20:16.583492 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:16.583474    2582 scope.go:117] "RemoveContainer" containerID="a4d074306826ad30851af1342dc9604518d40191b0eae29f6846f513f3787a63"
Jun 06 05:20:17.601581 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:20:17.601546    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" path="/var/lib/kubelet/pods/4873858a-5e1c-4ab2-a108-b38b9282ea58/volumes"
Jun 06 05:21:07.167516 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167479    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"]
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167830    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="registry"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167841    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="registry"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167849    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167855    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167863    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="feast-apply"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167869    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="feast-apply"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167887    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="feast-init"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167894    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="feast-init"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167900    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167905    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167914    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="offline"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167919    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="offline"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167974    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="online"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167984    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="registry"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167989    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="offline"
Jun 06 05:21:07.168038 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.167995    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4873858a-5e1c-4ab2-a108-b38b9282ea58" containerName="ui"
Jun 06 05:21:07.171608 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.171589    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.174468 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174295    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 06 05:21:07.174468 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174307    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 06 05:21:07.174468 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174327    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 06 05:21:07.174719 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174474    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 06 05:21:07.174719 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 06 05:21:07.174719 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174662    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 06 05:21:07.174923 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174739    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 06 05:21:07.174923 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.174819    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-w89nk\""
Jun 06 05:21:07.183742 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.183715    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"]
Jun 06 05:21:07.318757 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.318724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6560804-73a6-489b-850e-6ba12cb91f00-registry-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.318757 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.318761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-offline-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.319030 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.318791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2mns\" (UniqueName: \"kubernetes.io/projected/f6560804-73a6-489b-850e-6ba12cb91f00-kube-api-access-p2mns\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.319030 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.318809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-ui-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.319030 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.318962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-online-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.319030 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.319005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6560804-73a6-489b-850e-6ba12cb91f00-feast-data\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.420518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.420429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-online-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.420518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.420464    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6560804-73a6-489b-850e-6ba12cb91f00-feast-data\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.420518 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.420506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6560804-73a6-489b-850e-6ba12cb91f00-registry-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.420805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.420522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-offline-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.420805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.420549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2mns\" (UniqueName: \"kubernetes.io/projected/f6560804-73a6-489b-850e-6ba12cb91f00-kube-api-access-p2mns\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.420805 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.420573    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-ui-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.421001 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.420978    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6560804-73a6-489b-850e-6ba12cb91f00-feast-data\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.421382 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.421355    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6560804-73a6-489b-850e-6ba12cb91f00-registry-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.423118 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.423088    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-ui-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.423517 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.423493    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-offline-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.423683 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.423653    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-online-tls\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.428606 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.428585    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2mns\" (UniqueName: \"kubernetes.io/projected/f6560804-73a6-489b-850e-6ba12cb91f00-kube-api-access-p2mns\") pod \"feast-simple-feast-remote-setup-874df7c98-q9d9v\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.483919 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.483881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:07.619986 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.619961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"]
Jun 06 05:21:07.622540 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:21:07.622504    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6560804_73a6_489b_850e_6ba12cb91f00.slice/crio-1344567a502257b562afcc7ec9384bf66b202001eade761f111403c4b9b0db37 WatchSource:0}: Error finding container 1344567a502257b562afcc7ec9384bf66b202001eade761f111403c4b9b0db37: Status 404 returned error can't find the container with id 1344567a502257b562afcc7ec9384bf66b202001eade761f111403c4b9b0db37
Jun 06 05:21:07.770502 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.770425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerStarted","Data":"676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc"}
Jun 06 05:21:07.770502 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:07.770478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerStarted","Data":"1344567a502257b562afcc7ec9384bf66b202001eade761f111403c4b9b0db37"}
Jun 06 05:21:12.794540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:12.794502    2582 generic.go:356] "Generic (PLEG): container finished" podID="f6560804-73a6-489b-850e-6ba12cb91f00" containerID="676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc" exitCode=0
Jun 06 05:21:12.794959 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:12.794559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerDied","Data":"676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc"}
Jun 06 05:21:13.801244 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:13.801211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerStarted","Data":"f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a"}
Jun 06 05:21:18.826912 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:18.826878    2582 generic.go:356] "Generic (PLEG): container finished" podID="f6560804-73a6-489b-850e-6ba12cb91f00" containerID="f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a" exitCode=0
Jun 06 05:21:18.827328 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:18.826930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerDied","Data":"f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a"}
Jun 06 05:21:19.836749 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:19.836702    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerStarted","Data":"b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d"}
Jun 06 05:21:19.837137 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:19.836777    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerStarted","Data":"b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5"}
Jun 06 05:21:19.837137 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:19.836800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerStarted","Data":"6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1"}
Jun 06 05:21:19.860676 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:19.860615    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podStartSLOduration=12.860593853 podStartE2EDuration="12.860593853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:21:19.857977003 +0000 UTC m=+762.717039180" watchObservedRunningTime="2026-06-06 05:21:19.860593853 +0000 UTC m=+762.719656032"
Jun 06 05:21:22.484062 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:22.484025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:22.484557 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:22.484088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:22.484557 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:22.484105    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:22.485978 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:22.485950    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Jun 06 05:21:22.486094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:22.486030    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 06 05:21:22.486094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:22.485950    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jun 06 05:21:25.485855 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.485826    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.486232 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.486028    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.486308 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.486252    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.486376 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.486307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.486591 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.486573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.486724 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.486709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.489780 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.489762    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.867702 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.867664    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:21:25.870700 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:21:25.870681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:22:28.420049 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.420016    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"]
Jun 06 05:22:28.420570 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.420287    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online" containerID="cri-o://6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1" gracePeriod=30
Jun 06 05:22:28.420570 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.420366    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui" containerID="cri-o://b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d" gracePeriod=30
Jun 06 05:22:28.420570 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.420377    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="offline" containerID="cri-o://b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5" gracePeriod=30
Jun 06 05:22:28.536640 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.536610    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"]
Jun 06 05:22:28.536949 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.536861    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="registry" containerID="cri-o://e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889" gracePeriod=30
Jun 06 05:22:28.536949 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.536929    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online" containerID="cri-o://b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512" gracePeriod=30
Jun 06 05:22:28.537107 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.536927    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="offline" containerID="cri-o://bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103" gracePeriod=30
Jun 06 05:22:28.537166 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:28.536927    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui" containerID="cri-o://2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61" gracePeriod=30
Jun 06 05:22:29.176846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:29.176813    2582 generic.go:356] "Generic (PLEG): container finished" podID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerID="2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61" exitCode=0
Jun 06 05:22:29.177007 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:29.176884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerDied","Data":"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"}
Jun 06 05:22:29.179582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:29.179560    2582 generic.go:356] "Generic (PLEG): container finished" podID="f6560804-73a6-489b-850e-6ba12cb91f00" containerID="b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d" exitCode=0
Jun 06 05:22:29.179582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:29.179578    2582 generic.go:356] "Generic (PLEG): container finished" podID="f6560804-73a6-489b-850e-6ba12cb91f00" containerID="6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1" exitCode=0
Jun 06 05:22:29.179723 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:29.179616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerDied","Data":"b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d"}
Jun 06 05:22:29.179723 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:29.179640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerDied","Data":"6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1"}
Jun 06 05:22:30.187811 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:30.187780    2582 generic.go:356] "Generic (PLEG): container finished" podID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerID="b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512" exitCode=0
Jun 06 05:22:30.188175 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:30.187851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerDied","Data":"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"}
Jun 06 05:22:34.421196 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:34.421154    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jun 06 05:22:34.477481 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:34.477436    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 06 05:22:35.486630 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:35.486588    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jun 06 05:22:35.868503 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:35.868464    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 06 05:22:44.420560 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:44.420498    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jun 06 05:22:44.477627 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:44.477588    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 06 05:22:45.486961 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:45.486914    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jun 06 05:22:45.868035 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:45.867997    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 06 05:22:54.420548 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:54.420500    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Jun 06 05:22:54.421101 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:54.420640    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:22:54.477622 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:54.477570    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Jun 06 05:22:54.477790 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:54.477698    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:22:55.486775 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:55.486725    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Jun 06 05:22:55.487197 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:55.486857    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:22:55.868888 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:55.868844    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Jun 06 05:22:55.869068 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:55.868970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:22:59.074532 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.074505    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:22:59.182651 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.182618    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-online-tls\") pod \"f6560804-73a6-489b-850e-6ba12cb91f00\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") "
Jun 06 05:22:59.182821 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.182670    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6560804-73a6-489b-850e-6ba12cb91f00-registry-tls\") pod \"f6560804-73a6-489b-850e-6ba12cb91f00\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") "
Jun 06 05:22:59.182821 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.182749    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2mns\" (UniqueName: \"kubernetes.io/projected/f6560804-73a6-489b-850e-6ba12cb91f00-kube-api-access-p2mns\") pod \"f6560804-73a6-489b-850e-6ba12cb91f00\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") "
Jun 06 05:22:59.182821 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.182776    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-offline-tls\") pod \"f6560804-73a6-489b-850e-6ba12cb91f00\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") "
Jun 06 05:22:59.182978 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.182830    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-ui-tls\") pod \"f6560804-73a6-489b-850e-6ba12cb91f00\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") "
Jun 06 05:22:59.182978 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.182871    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6560804-73a6-489b-850e-6ba12cb91f00-feast-data\") pod \"f6560804-73a6-489b-850e-6ba12cb91f00\" (UID: \"f6560804-73a6-489b-850e-6ba12cb91f00\") "
Jun 06 05:22:59.183082 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.183061    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6560804-73a6-489b-850e-6ba12cb91f00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f6560804-73a6-489b-850e-6ba12cb91f00" (UID: "f6560804-73a6-489b-850e-6ba12cb91f00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:22:59.183557 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.183511    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6560804-73a6-489b-850e-6ba12cb91f00-feast-data" (OuterVolumeSpecName: "feast-data") pod "f6560804-73a6-489b-850e-6ba12cb91f00" (UID: "f6560804-73a6-489b-850e-6ba12cb91f00"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:22:59.185103 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.185071    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-online-tls" (OuterVolumeSpecName: "online-tls") pod "f6560804-73a6-489b-850e-6ba12cb91f00" (UID: "f6560804-73a6-489b-850e-6ba12cb91f00"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:22:59.185103 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.185089    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6560804-73a6-489b-850e-6ba12cb91f00-kube-api-access-p2mns" (OuterVolumeSpecName: "kube-api-access-p2mns") pod "f6560804-73a6-489b-850e-6ba12cb91f00" (UID: "f6560804-73a6-489b-850e-6ba12cb91f00"). InnerVolumeSpecName "kube-api-access-p2mns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:22:59.185415 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.185305    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f6560804-73a6-489b-850e-6ba12cb91f00" (UID: "f6560804-73a6-489b-850e-6ba12cb91f00"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:22:59.185415 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.185387    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f6560804-73a6-489b-850e-6ba12cb91f00" (UID: "f6560804-73a6-489b-850e-6ba12cb91f00"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:22:59.195681 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.195662    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:22:59.283985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.283956    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-ui-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.283985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.283979    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f6560804-73a6-489b-850e-6ba12cb91f00-feast-data\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.283985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.283988    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-online-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.283985 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.283996    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f6560804-73a6-489b-850e-6ba12cb91f00-registry-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.284243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.284004    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2mns\" (UniqueName: \"kubernetes.io/projected/f6560804-73a6-489b-850e-6ba12cb91f00-kube-api-access-p2mns\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.284243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.284013    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f6560804-73a6-489b-850e-6ba12cb91f00-offline-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.325536 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.325500    2582 generic.go:356] "Generic (PLEG): container finished" podID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerID="bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103" exitCode=137
Jun 06 05:22:59.325536 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.325525    2582 generic.go:356] "Generic (PLEG): container finished" podID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerID="e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889" exitCode=137
Jun 06 05:22:59.325739 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.325579    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"
Jun 06 05:22:59.325739 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.325573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerDied","Data":"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"}
Jun 06 05:22:59.325739 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.325623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerDied","Data":"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"}
Jun 06 05:22:59.325739 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.325643    2582 scope.go:117] "RemoveContainer" containerID="2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"
Jun 06 05:22:59.325739 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.325643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4" event={"ID":"2cd7d57e-3596-4bd9-b063-ed6645245857","Type":"ContainerDied","Data":"37531d69162a599553b92b4149ef76ee7de06d001b174d18ccd316f0106dd5e2"}
Jun 06 05:22:59.328071 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.328052    2582 generic.go:356] "Generic (PLEG): container finished" podID="f6560804-73a6-489b-850e-6ba12cb91f00" containerID="b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5" exitCode=137
Jun 06 05:22:59.328167 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.328107    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"
Jun 06 05:22:59.328167 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.328137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerDied","Data":"b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5"}
Jun 06 05:22:59.328249 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.328178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v" event={"ID":"f6560804-73a6-489b-850e-6ba12cb91f00","Type":"ContainerDied","Data":"1344567a502257b562afcc7ec9384bf66b202001eade761f111403c4b9b0db37"}
Jun 06 05:22:59.336488 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.336472    2582 scope.go:117] "RemoveContainer" containerID="bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"
Jun 06 05:22:59.344499 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.344472    2582 scope.go:117] "RemoveContainer" containerID="b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"
Jun 06 05:22:59.352213 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.352183    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"]
Jun 06 05:22:59.353966 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.353941    2582 scope.go:117] "RemoveContainer" containerID="e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"
Jun 06 05:22:59.355577 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.355555    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-874df7c98-q9d9v"]
Jun 06 05:22:59.361954 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.361929    2582 scope.go:117] "RemoveContainer" containerID="6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"
Jun 06 05:22:59.369160 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.369142    2582 scope.go:117] "RemoveContainer" containerID="b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"
Jun 06 05:22:59.379066 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.379048    2582 scope.go:117] "RemoveContainer" containerID="2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"
Jun 06 05:22:59.379363 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.379343    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61\": container with ID starting with 2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61 not found: ID does not exist" containerID="2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"
Jun 06 05:22:59.379419 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.379374    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"} err="failed to get container status \"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61\": rpc error: code = NotFound desc = could not find container \"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61\": container with ID starting with 2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61 not found: ID does not exist"
Jun 06 05:22:59.379419 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.379394    2582 scope.go:117] "RemoveContainer" containerID="bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"
Jun 06 05:22:59.379596 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.379581    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103\": container with ID starting with bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103 not found: ID does not exist" containerID="bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"
Jun 06 05:22:59.379636 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.379601    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"} err="failed to get container status \"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103\": rpc error: code = NotFound desc = could not find container \"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103\": container with ID starting with bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103 not found: ID does not exist"
Jun 06 05:22:59.379636 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.379613    2582 scope.go:117] "RemoveContainer" containerID="b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"
Jun 06 05:22:59.379854 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.379831    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512\": container with ID starting with b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512 not found: ID does not exist" containerID="b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"
Jun 06 05:22:59.379932 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.379865    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"} err="failed to get container status \"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512\": rpc error: code = NotFound desc = could not find container \"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512\": container with ID starting with b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512 not found: ID does not exist"
Jun 06 05:22:59.379932 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.379888    2582 scope.go:117] "RemoveContainer" containerID="e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"
Jun 06 05:22:59.380142 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.380120    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889\": container with ID starting with e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889 not found: ID does not exist" containerID="e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"
Jun 06 05:22:59.380321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380146    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"} err="failed to get container status \"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889\": rpc error: code = NotFound desc = could not find container \"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889\": container with ID starting with e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889 not found: ID does not exist"
Jun 06 05:22:59.380321 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380160    2582 scope.go:117] "RemoveContainer" containerID="6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"
Jun 06 05:22:59.380454 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.380379    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216\": container with ID starting with 6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216 not found: ID does not exist" containerID="6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"
Jun 06 05:22:59.380454 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380400    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"} err="failed to get container status \"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216\": rpc error: code = NotFound desc = could not find container \"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216\": container with ID starting with 6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216 not found: ID does not exist"
Jun 06 05:22:59.380454 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380413    2582 scope.go:117] "RemoveContainer" containerID="b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"
Jun 06 05:22:59.380624 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.380609    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c\": container with ID starting with b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c not found: ID does not exist" containerID="b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"
Jun 06 05:22:59.380663 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380627    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"} err="failed to get container status \"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c\": rpc error: code = NotFound desc = could not find container \"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c\": container with ID starting with b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c not found: ID does not exist"
Jun 06 05:22:59.380663 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380638    2582 scope.go:117] "RemoveContainer" containerID="2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"
Jun 06 05:22:59.380816 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380800    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61"} err="failed to get container status \"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61\": rpc error: code = NotFound desc = could not find container \"2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61\": container with ID starting with 2d2f8fb4752043b01f3c763263b75fa1ca8f4a30198b6ded1a97279684892c61 not found: ID does not exist"
Jun 06 05:22:59.380862 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380816    2582 scope.go:117] "RemoveContainer" containerID="bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"
Jun 06 05:22:59.381014 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.380984    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103"} err="failed to get container status \"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103\": rpc error: code = NotFound desc = could not find container \"bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103\": container with ID starting with bba287866dcbbef26b2f4c32c6e15b96f9f5b578872c3632097cc23a8bbd1103 not found: ID does not exist"
Jun 06 05:22:59.381086 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381016    2582 scope.go:117] "RemoveContainer" containerID="b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"
Jun 06 05:22:59.381202 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381186    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512"} err="failed to get container status \"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512\": rpc error: code = NotFound desc = could not find container \"b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512\": container with ID starting with b4491e3c5a2e1d1205da32141322dafb5429b1f447bb72622b93224ef0d7b512 not found: ID does not exist"
Jun 06 05:22:59.381259 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381202    2582 scope.go:117] "RemoveContainer" containerID="e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"
Jun 06 05:22:59.381429 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381410    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889"} err="failed to get container status \"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889\": rpc error: code = NotFound desc = could not find container \"e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889\": container with ID starting with e170eac3c01e762132e53188bd3cec974363ff3f0eb0162c099e2d5d2bfe8889 not found: ID does not exist"
Jun 06 05:22:59.381500 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381430    2582 scope.go:117] "RemoveContainer" containerID="6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"
Jun 06 05:22:59.381667 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381649    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216"} err="failed to get container status \"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216\": rpc error: code = NotFound desc = could not find container \"6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216\": container with ID starting with 6cb225c725fc8b5dd5184d629a95b4bcb6e6089bc119b50bf761ff3d1fad7216 not found: ID does not exist"
Jun 06 05:22:59.381714 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381670    2582 scope.go:117] "RemoveContainer" containerID="b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"
Jun 06 05:22:59.381868 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381853    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c"} err="failed to get container status \"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c\": rpc error: code = NotFound desc = could not find container \"b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c\": container with ID starting with b62ac62b896501dd9cb06278951d280532feba5caa15d2fd50fce3d59f0e4f6c not found: ID does not exist"
Jun 06 05:22:59.381915 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.381868    2582 scope.go:117] "RemoveContainer" containerID="b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d"
Jun 06 05:22:59.384915 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.384895    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-registry-tls\") pod \"2cd7d57e-3596-4bd9-b063-ed6645245857\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") "
Jun 06 05:22:59.385001 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.384986    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-offline-tls\") pod \"2cd7d57e-3596-4bd9-b063-ed6645245857\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") "
Jun 06 05:22:59.385042 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.385012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls\") pod \"2cd7d57e-3596-4bd9-b063-ed6645245857\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") "
Jun 06 05:22:59.385093 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.385048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zztx7\" (UniqueName: \"kubernetes.io/projected/2cd7d57e-3596-4bd9-b063-ed6645245857-kube-api-access-zztx7\") pod \"2cd7d57e-3596-4bd9-b063-ed6645245857\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") "
Jun 06 05:22:59.385149 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.385101    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-online-tls\") pod \"2cd7d57e-3596-4bd9-b063-ed6645245857\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") "
Jun 06 05:22:59.385149 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.385124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd7d57e-3596-4bd9-b063-ed6645245857-feast-data\") pod \"2cd7d57e-3596-4bd9-b063-ed6645245857\" (UID: \"2cd7d57e-3596-4bd9-b063-ed6645245857\") "
Jun 06 05:22:59.385818 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.385776    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cd7d57e-3596-4bd9-b063-ed6645245857-feast-data" (OuterVolumeSpecName: "feast-data") pod "2cd7d57e-3596-4bd9-b063-ed6645245857" (UID: "2cd7d57e-3596-4bd9-b063-ed6645245857"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:22:59.387262 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.387233    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2cd7d57e-3596-4bd9-b063-ed6645245857" (UID: "2cd7d57e-3596-4bd9-b063-ed6645245857"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:22:59.387380 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.387355    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2cd7d57e-3596-4bd9-b063-ed6645245857" (UID: "2cd7d57e-3596-4bd9-b063-ed6645245857"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:22:59.387436 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.387372    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2cd7d57e-3596-4bd9-b063-ed6645245857" (UID: "2cd7d57e-3596-4bd9-b063-ed6645245857"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:22:59.387490 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.387469    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-online-tls" (OuterVolumeSpecName: "online-tls") pod "2cd7d57e-3596-4bd9-b063-ed6645245857" (UID: "2cd7d57e-3596-4bd9-b063-ed6645245857"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:22:59.387582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.387565    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd7d57e-3596-4bd9-b063-ed6645245857-kube-api-access-zztx7" (OuterVolumeSpecName: "kube-api-access-zztx7") pod "2cd7d57e-3596-4bd9-b063-ed6645245857" (UID: "2cd7d57e-3596-4bd9-b063-ed6645245857"). InnerVolumeSpecName "kube-api-access-zztx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:22:59.390596 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.390580    2582 scope.go:117] "RemoveContainer" containerID="b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5"
Jun 06 05:22:59.398134 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.398118    2582 scope.go:117] "RemoveContainer" containerID="6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1"
Jun 06 05:22:59.405256 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.405227    2582 scope.go:117] "RemoveContainer" containerID="f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a"
Jun 06 05:22:59.412183 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.412167    2582 scope.go:117] "RemoveContainer" containerID="676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc"
Jun 06 05:22:59.419057 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.419037    2582 scope.go:117] "RemoveContainer" containerID="b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d"
Jun 06 05:22:59.419355 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.419333    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d\": container with ID starting with b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d not found: ID does not exist" containerID="b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d"
Jun 06 05:22:59.419423 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.419369    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d"} err="failed to get container status \"b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d\": rpc error: code = NotFound desc = could not find container \"b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d\": container with ID starting with b0055352b7e7e3d72b0b22a18bc9cdfaec762a9c24cde52b032fcec638418a9d not found: ID does not exist"
Jun 06 05:22:59.419423 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.419389    2582 scope.go:117] "RemoveContainer" containerID="b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5"
Jun 06 05:22:59.419643 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.419622    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5\": container with ID starting with b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5 not found: ID does not exist" containerID="b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5"
Jun 06 05:22:59.419682 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.419649    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5"} err="failed to get container status \"b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5\": rpc error: code = NotFound desc = could not find container \"b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5\": container with ID starting with b6dfc448076710e83e19a2bd0d3e1f8a3d5387d9a34b57d460d89531a6e325f5 not found: ID does not exist"
Jun 06 05:22:59.419682 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.419666    2582 scope.go:117] "RemoveContainer" containerID="6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1"
Jun 06 05:22:59.419893 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.419875    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1\": container with ID starting with 6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1 not found: ID does not exist" containerID="6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1"
Jun 06 05:22:59.419959 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.419900    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1"} err="failed to get container status \"6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1\": rpc error: code = NotFound desc = could not find container \"6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1\": container with ID starting with 6dfb264f3c2d97f7d71a043e95fc26c257b81c5cf9f997a40a244d675e29c6d1 not found: ID does not exist"
Jun 06 05:22:59.419959 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.419923    2582 scope.go:117] "RemoveContainer" containerID="f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a"
Jun 06 05:22:59.420146 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.420124    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a\": container with ID starting with f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a not found: ID does not exist" containerID="f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a"
Jun 06 05:22:59.420239 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.420151    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a"} err="failed to get container status \"f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a\": rpc error: code = NotFound desc = could not find container \"f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a\": container with ID starting with f96f7bf6ceb89ea2cce5faf84823ce93486db45b63737fe06f333862a368b64a not found: ID does not exist"
Jun 06 05:22:59.420239 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.420169    2582 scope.go:117] "RemoveContainer" containerID="676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc"
Jun 06 05:22:59.420442 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:22:59.420421    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc\": container with ID starting with 676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc not found: ID does not exist" containerID="676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc"
Jun 06 05:22:59.420489 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.420448    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc"} err="failed to get container status \"676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc\": rpc error: code = NotFound desc = could not find container \"676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc\": container with ID starting with 676139bfb18efc9718b0407549b0d2f45eee6676f99e5f32620b311c4a9d79dc not found: ID does not exist"
Jun 06 05:22:59.485925 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.485840    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cd7d57e-3596-4bd9-b063-ed6645245857-feast-data\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.485925 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.485865    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-registry-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.485925 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.485874    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-offline-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.485925 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.485881    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-ui-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.485925 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.485890    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zztx7\" (UniqueName: \"kubernetes.io/projected/2cd7d57e-3596-4bd9-b063-ed6645245857-kube-api-access-zztx7\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.485925 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.485898    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cd7d57e-3596-4bd9-b063-ed6645245857-online-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:22:59.596590 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.596561    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" path="/var/lib/kubelet/pods/f6560804-73a6-489b-850e-6ba12cb91f00/volumes"
Jun 06 05:22:59.642350 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.642319    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"]
Jun 06 05:22:59.645511 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:22:59.645486    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-849fffb958-s72b4"]
Jun 06 05:23:01.597137 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:01.597098    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" path="/var/lib/kubelet/pods/2cd7d57e-3596-4bd9-b063-ed6645245857/volumes"
Jun 06 05:23:11.283161 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283128    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-52dls"]
Jun 06 05:23:11.283574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283518    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online"
Jun 06 05:23:11.283574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283535    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online"
Jun 06 05:23:11.283574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283544    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui"
Jun 06 05:23:11.283574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283550    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui"
Jun 06 05:23:11.283574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283561    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="feast-init"
Jun 06 05:23:11.283574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283566    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="feast-init"
Jun 06 05:23:11.283574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283573    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283581    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283592    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283598    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283607    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="registry"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283613    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="registry"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283619    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="offline"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283624    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="offline"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283629    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="feast-apply"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283634    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="feast-apply"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283641    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="feast-init"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283647    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="feast-init"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283653    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="offline"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283658    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="offline"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283674    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="feast-apply"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283679    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="feast-apply"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283735    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="ui"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283747    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="online"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283753    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="registry"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283759    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="offline"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283764    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="online"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283772    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6560804-73a6-489b-850e-6ba12cb91f00" containerName="ui"
Jun 06 05:23:11.283830 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.283777    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd7d57e-3596-4bd9-b063-ed6645245857" containerName="offline"
Jun 06 05:23:11.288884 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.288862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-52dls"
Jun 06 05:23:11.291354 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.291330    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 06 05:23:11.291583 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.291416    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 06 05:23:11.291918 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.291481    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-bhqtj\""
Jun 06 05:23:11.293175 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.293150    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-52dls"]
Jun 06 05:23:11.382724 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.382695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5kwm\" (UniqueName: \"kubernetes.io/projected/7d0065f3-ffc8-4054-a837-8fe6f6e20be5-kube-api-access-l5kwm\") pod \"redis-69bbd798b6-52dls\" (UID: \"7d0065f3-ffc8-4054-a837-8fe6f6e20be5\") " pod="test-ns-feast/redis-69bbd798b6-52dls"
Jun 06 05:23:11.483876 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.483838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5kwm\" (UniqueName: \"kubernetes.io/projected/7d0065f3-ffc8-4054-a837-8fe6f6e20be5-kube-api-access-l5kwm\") pod \"redis-69bbd798b6-52dls\" (UID: \"7d0065f3-ffc8-4054-a837-8fe6f6e20be5\") " pod="test-ns-feast/redis-69bbd798b6-52dls"
Jun 06 05:23:11.491441 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.491417    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5kwm\" (UniqueName: \"kubernetes.io/projected/7d0065f3-ffc8-4054-a837-8fe6f6e20be5-kube-api-access-l5kwm\") pod \"redis-69bbd798b6-52dls\" (UID: \"7d0065f3-ffc8-4054-a837-8fe6f6e20be5\") " pod="test-ns-feast/redis-69bbd798b6-52dls"
Jun 06 05:23:11.636833 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.636801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-52dls"
Jun 06 05:23:11.760648 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.760624    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-52dls"]
Jun 06 05:23:11.762781 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:23:11.762751    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d0065f3_ffc8_4054_a837_8fe6f6e20be5.slice/crio-29eda19d308b6875a121487bdb6d9a29bf3521c4db6912db701b7a302c1ded6c WatchSource:0}: Error finding container 29eda19d308b6875a121487bdb6d9a29bf3521c4db6912db701b7a302c1ded6c: Status 404 returned error can't find the container with id 29eda19d308b6875a121487bdb6d9a29bf3521c4db6912db701b7a302c1ded6c
Jun 06 05:23:11.764460 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:11.764444    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:23:12.390723 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:12.390683    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-52dls" event={"ID":"7d0065f3-ffc8-4054-a837-8fe6f6e20be5","Type":"ContainerStarted","Data":"29eda19d308b6875a121487bdb6d9a29bf3521c4db6912db701b7a302c1ded6c"}
Jun 06 05:23:13.396891 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:13.396855    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-52dls" event={"ID":"7d0065f3-ffc8-4054-a837-8fe6f6e20be5","Type":"ContainerStarted","Data":"6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623"}
Jun 06 05:23:13.410508 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:13.410462    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-52dls" podStartSLOduration=0.982437898 podStartE2EDuration="2.410446504s" totalImagesPullingTime="1.428008606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:23:13.409211238 +0000 UTC m=+876.268273411" watchObservedRunningTime="2026-06-06 05:23:13.410446504 +0000 UTC m=+876.269508683"
Jun 06 05:23:21.932947 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.932913    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"]
Jun 06 05:23:21.943935 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.943901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:21.946191 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.946164    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"]
Jun 06 05:23:21.946547 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.946523    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 06 05:23:21.946754 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.946528    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-7fhlw\""
Jun 06 05:23:21.946864 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.946814    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 06 05:23:21.947027 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.946658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jun 06 05:23:21.947112 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.946607    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jun 06 05:23:21.947474 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.947451    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jun 06 05:23:21.969362 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.969337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/774f0e6d-4000-464d-b7b4-d58a85f77630-feast-data\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:21.969461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.969393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wqnf\" (UniqueName: \"kubernetes.io/projected/774f0e6d-4000-464d-b7b4-d58a85f77630-kube-api-access-9wqnf\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:21.969517 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.969467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-online-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:21.969562 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.969512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-registry-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:21.969562 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:21.969546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-offline-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.070252 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.070217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/774f0e6d-4000-464d-b7b4-d58a85f77630-feast-data\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.070429 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.070283    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wqnf\" (UniqueName: \"kubernetes.io/projected/774f0e6d-4000-464d-b7b4-d58a85f77630-kube-api-access-9wqnf\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.070429 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.070322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-online-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.070429 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.070344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-registry-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.070429 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.070372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-offline-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.070672 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.070647    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/774f0e6d-4000-464d-b7b4-d58a85f77630-feast-data\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.072806 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.072783    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-registry-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.072916 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.072843    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-offline-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.072916 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.072844    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-online-tls\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.086917 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.086894    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wqnf\" (UniqueName: \"kubernetes.io/projected/774f0e6d-4000-464d-b7b4-d58a85f77630-kube-api-access-9wqnf\") pod \"feast-credit-scoring-55464f8679-f6fw2\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") " pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.256233 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.256150    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:22.391678 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.391651    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"]
Jun 06 05:23:22.393479 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:23:22.393451    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774f0e6d_4000_464d_b7b4_d58a85f77630.slice/crio-6606225f4945505b1e7b9b11d6713f3996f548db5669385ce4fab392b23af318 WatchSource:0}: Error finding container 6606225f4945505b1e7b9b11d6713f3996f548db5669385ce4fab392b23af318: Status 404 returned error can't find the container with id 6606225f4945505b1e7b9b11d6713f3996f548db5669385ce4fab392b23af318
Jun 06 05:23:22.438330 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:22.438297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerStarted","Data":"6606225f4945505b1e7b9b11d6713f3996f548db5669385ce4fab392b23af318"}
Jun 06 05:23:23.444638 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:23.444601    2582 generic.go:356] "Generic (PLEG): container finished" podID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerID="75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51" exitCode=0
Jun 06 05:23:23.445013 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:23.444688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerDied","Data":"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51"}
Jun 06 05:23:24.451118 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:24.451084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerStarted","Data":"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"}
Jun 06 05:23:30.482238 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:30.482200    2582 generic.go:356] "Generic (PLEG): container finished" podID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerID="7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a" exitCode=0
Jun 06 05:23:30.482670 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:30.482289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerDied","Data":"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"}
Jun 06 05:23:31.491309 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:31.491239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerStarted","Data":"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"}
Jun 06 05:23:31.491761 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:31.491344    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerStarted","Data":"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"}
Jun 06 05:23:31.491761 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:31.491374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerStarted","Data":"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"}
Jun 06 05:23:31.516343 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:31.516261    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podStartSLOduration=10.516239725 podStartE2EDuration="10.516239725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:23:31.513654616 +0000 UTC m=+894.372716794" watchObservedRunningTime="2026-06-06 05:23:31.516239725 +0000 UTC m=+894.375301902"
Jun 06 05:23:32.256615 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:32.256579    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:32.256888 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:32.256663    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:32.256888 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:32.256694    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:34.256574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:34.256502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:34.257034 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:34.256622    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:34.257034 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:34.256649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:34.258679 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:34.258642    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jun 06 05:23:34.258831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:34.258671    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Jun 06 05:23:34.258831 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:34.258685    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 06 05:23:37.256973 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:37.256928    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jun 06 05:23:37.257624 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:37.257600    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:37.258452 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:37.258427    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:37.262487 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:37.262460    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:37.529325 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:37.529217    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:37.645407 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:37.645380    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:23:37.647234 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:37.647212    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:23:40.256854 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:40.256810    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Jun 06 05:23:43.257856 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:43.257829    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:23:43.260205 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:23:43.258471    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:24:45.201796 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.201759    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"]
Jun 06 05:24:45.202318 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.202051    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="registry" containerID="cri-o://e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be" gracePeriod=30
Jun 06 05:24:45.202318 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.202083    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="offline" containerID="cri-o://ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9" gracePeriod=30
Jun 06 05:24:45.202318 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.202087    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online" containerID="cri-o://f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27" gracePeriod=30
Jun 06 05:24:45.227117 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.227082    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-52dls"]
Jun 06 05:24:45.227279 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.227243    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-52dls" podUID="7d0065f3-ffc8-4054-a837-8fe6f6e20be5" containerName="redis" containerID="cri-o://6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623" gracePeriod=30
Jun 06 05:24:45.475310 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.475262    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-52dls"
Jun 06 05:24:45.600873 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.600840    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5kwm\" (UniqueName: \"kubernetes.io/projected/7d0065f3-ffc8-4054-a837-8fe6f6e20be5-kube-api-access-l5kwm\") pod \"7d0065f3-ffc8-4054-a837-8fe6f6e20be5\" (UID: \"7d0065f3-ffc8-4054-a837-8fe6f6e20be5\") "
Jun 06 05:24:45.602801 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.602778    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d0065f3-ffc8-4054-a837-8fe6f6e20be5-kube-api-access-l5kwm" (OuterVolumeSpecName: "kube-api-access-l5kwm") pod "7d0065f3-ffc8-4054-a837-8fe6f6e20be5" (UID: "7d0065f3-ffc8-4054-a837-8fe6f6e20be5"). InnerVolumeSpecName "kube-api-access-l5kwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:24:45.702432 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.702393    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5kwm\" (UniqueName: \"kubernetes.io/projected/7d0065f3-ffc8-4054-a837-8fe6f6e20be5-kube-api-access-l5kwm\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:24:45.848506 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.848472    2582 generic.go:356] "Generic (PLEG): container finished" podID="7d0065f3-ffc8-4054-a837-8fe6f6e20be5" containerID="6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623" exitCode=0
Jun 06 05:24:45.848698 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.848521    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-52dls"
Jun 06 05:24:45.848698 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.848536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-52dls" event={"ID":"7d0065f3-ffc8-4054-a837-8fe6f6e20be5","Type":"ContainerDied","Data":"6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623"}
Jun 06 05:24:45.848698 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.848566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-52dls" event={"ID":"7d0065f3-ffc8-4054-a837-8fe6f6e20be5","Type":"ContainerDied","Data":"29eda19d308b6875a121487bdb6d9a29bf3521c4db6912db701b7a302c1ded6c"}
Jun 06 05:24:45.848698 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.848582    2582 scope.go:117] "RemoveContainer" containerID="6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623"
Jun 06 05:24:45.857963 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.857941    2582 scope.go:117] "RemoveContainer" containerID="6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623"
Jun 06 05:24:45.858236 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:24:45.858217    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623\": container with ID starting with 6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623 not found: ID does not exist" containerID="6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623"
Jun 06 05:24:45.858296 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.858245    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623"} err="failed to get container status \"6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623\": rpc error: code = NotFound desc = could not find container \"6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623\": container with ID starting with 6a6aa2960914718e9cd3c8e372817f7ff43d44259b5c22d152fc6be88c47e623 not found: ID does not exist"
Jun 06 05:24:45.868642 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.868616    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-52dls"]
Jun 06 05:24:45.871703 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:45.871681    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-52dls"]
Jun 06 05:24:46.856413 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:46.856330    2582 generic.go:356] "Generic (PLEG): container finished" podID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerID="f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27" exitCode=0
Jun 06 05:24:46.856413 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:46.856376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerDied","Data":"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"}
Jun 06 05:24:47.526704 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:47.526661    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 06 05:24:47.596044 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:47.596011    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d0065f3-ffc8-4054-a837-8fe6f6e20be5" path="/var/lib/kubelet/pods/7d0065f3-ffc8-4054-a837-8fe6f6e20be5/volumes"
Jun 06 05:24:57.526151 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:24:57.526110    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 06 05:25:07.526674 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:07.526631    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Jun 06 05:25:07.527071 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:07.526751    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:25:15.865972 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.865946    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:25:15.943055 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.943021    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-registry-tls\") pod \"774f0e6d-4000-464d-b7b4-d58a85f77630\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") "
Jun 06 05:25:15.943237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.943063    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wqnf\" (UniqueName: \"kubernetes.io/projected/774f0e6d-4000-464d-b7b4-d58a85f77630-kube-api-access-9wqnf\") pod \"774f0e6d-4000-464d-b7b4-d58a85f77630\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") "
Jun 06 05:25:15.943237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.943108    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-online-tls\") pod \"774f0e6d-4000-464d-b7b4-d58a85f77630\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") "
Jun 06 05:25:15.943237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.943143    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/774f0e6d-4000-464d-b7b4-d58a85f77630-feast-data\") pod \"774f0e6d-4000-464d-b7b4-d58a85f77630\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") "
Jun 06 05:25:15.943237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.943171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-offline-tls\") pod \"774f0e6d-4000-464d-b7b4-d58a85f77630\" (UID: \"774f0e6d-4000-464d-b7b4-d58a85f77630\") "
Jun 06 05:25:15.945374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.945326    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "774f0e6d-4000-464d-b7b4-d58a85f77630" (UID: "774f0e6d-4000-464d-b7b4-d58a85f77630"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:25:15.945374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.945350    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774f0e6d-4000-464d-b7b4-d58a85f77630-kube-api-access-9wqnf" (OuterVolumeSpecName: "kube-api-access-9wqnf") pod "774f0e6d-4000-464d-b7b4-d58a85f77630" (UID: "774f0e6d-4000-464d-b7b4-d58a85f77630"). InnerVolumeSpecName "kube-api-access-9wqnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:25:15.945642 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.945621    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-online-tls" (OuterVolumeSpecName: "online-tls") pod "774f0e6d-4000-464d-b7b4-d58a85f77630" (UID: "774f0e6d-4000-464d-b7b4-d58a85f77630"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:25:15.945746 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.945644    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "774f0e6d-4000-464d-b7b4-d58a85f77630" (UID: "774f0e6d-4000-464d-b7b4-d58a85f77630"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:25:15.951963 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.951936    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/774f0e6d-4000-464d-b7b4-d58a85f77630-feast-data" (OuterVolumeSpecName: "feast-data") pod "774f0e6d-4000-464d-b7b4-d58a85f77630" (UID: "774f0e6d-4000-464d-b7b4-d58a85f77630"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:25:15.988094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.988014    2582 generic.go:356] "Generic (PLEG): container finished" podID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerID="ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9" exitCode=137
Jun 06 05:25:15.988094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.988037    2582 generic.go:356] "Generic (PLEG): container finished" podID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerID="e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be" exitCode=137
Jun 06 05:25:15.988094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.988074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerDied","Data":"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"}
Jun 06 05:25:15.988094 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.988084    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"
Jun 06 05:25:15.988452 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.988117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerDied","Data":"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"}
Jun 06 05:25:15.988452 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.988136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-55464f8679-f6fw2" event={"ID":"774f0e6d-4000-464d-b7b4-d58a85f77630","Type":"ContainerDied","Data":"6606225f4945505b1e7b9b11d6713f3996f548db5669385ce4fab392b23af318"}
Jun 06 05:25:15.988452 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.988156    2582 scope.go:117] "RemoveContainer" containerID="ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"
Jun 06 05:25:15.996894 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:15.996872    2582 scope.go:117] "RemoveContainer" containerID="f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"
Jun 06 05:25:16.005034 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.005011    2582 scope.go:117] "RemoveContainer" containerID="e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"
Jun 06 05:25:16.009485 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.009462    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"]
Jun 06 05:25:16.012543 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.012523    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-55464f8679-f6fw2"]
Jun 06 05:25:16.013630 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.013615    2582 scope.go:117] "RemoveContainer" containerID="7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"
Jun 06 05:25:16.020728 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.020710    2582 scope.go:117] "RemoveContainer" containerID="75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51"
Jun 06 05:25:16.027780 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.027763    2582 scope.go:117] "RemoveContainer" containerID="ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"
Jun 06 05:25:16.028045 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:25:16.028026    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9\": container with ID starting with ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9 not found: ID does not exist" containerID="ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"
Jun 06 05:25:16.028093 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028052    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"} err="failed to get container status \"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9\": rpc error: code = NotFound desc = could not find container \"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9\": container with ID starting with ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9 not found: ID does not exist"
Jun 06 05:25:16.028093 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028070    2582 scope.go:117] "RemoveContainer" containerID="f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"
Jun 06 05:25:16.028301 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:25:16.028286    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27\": container with ID starting with f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27 not found: ID does not exist" containerID="f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"
Jun 06 05:25:16.028342 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028304    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"} err="failed to get container status \"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27\": rpc error: code = NotFound desc = could not find container \"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27\": container with ID starting with f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27 not found: ID does not exist"
Jun 06 05:25:16.028342 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028318    2582 scope.go:117] "RemoveContainer" containerID="e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"
Jun 06 05:25:16.028531 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:25:16.028512    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be\": container with ID starting with e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be not found: ID does not exist" containerID="e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"
Jun 06 05:25:16.028568 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028539    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"} err="failed to get container status \"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be\": rpc error: code = NotFound desc = could not find container \"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be\": container with ID starting with e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be not found: ID does not exist"
Jun 06 05:25:16.028568 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028558    2582 scope.go:117] "RemoveContainer" containerID="7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"
Jun 06 05:25:16.028774 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:25:16.028757    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a\": container with ID starting with 7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a not found: ID does not exist" containerID="7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"
Jun 06 05:25:16.028811 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028780    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"} err="failed to get container status \"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a\": rpc error: code = NotFound desc = could not find container \"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a\": container with ID starting with 7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a not found: ID does not exist"
Jun 06 05:25:16.028811 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.028793    2582 scope.go:117] "RemoveContainer" containerID="75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51"
Jun 06 05:25:16.029001 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:25:16.028986    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51\": container with ID starting with 75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51 not found: ID does not exist" containerID="75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51"
Jun 06 05:25:16.029037 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029006    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51"} err="failed to get container status \"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51\": rpc error: code = NotFound desc = could not find container \"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51\": container with ID starting with 75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51 not found: ID does not exist"
Jun 06 05:25:16.029037 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029018    2582 scope.go:117] "RemoveContainer" containerID="ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"
Jun 06 05:25:16.029194 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029180    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9"} err="failed to get container status \"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9\": rpc error: code = NotFound desc = could not find container \"ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9\": container with ID starting with ffa42442fa112b3a334f0a0ed9fcfa57f11aca43000e41509b96abb682ddbcc9 not found: ID does not exist"
Jun 06 05:25:16.029232 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029195    2582 scope.go:117] "RemoveContainer" containerID="f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"
Jun 06 05:25:16.029446 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029424    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27"} err="failed to get container status \"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27\": rpc error: code = NotFound desc = could not find container \"f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27\": container with ID starting with f5adfd5f8a07bcc6928a8a8758d8d1254864ce5cf62c054d6ee1a7e6cf44ec27 not found: ID does not exist"
Jun 06 05:25:16.029490 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029450    2582 scope.go:117] "RemoveContainer" containerID="e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"
Jun 06 05:25:16.029643 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029627    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be"} err="failed to get container status \"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be\": rpc error: code = NotFound desc = could not find container \"e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be\": container with ID starting with e3d8d66c3261bbcc9f91b077c97e1786a61d44df6720b2164632ce56100723be not found: ID does not exist"
Jun 06 05:25:16.029699 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029644    2582 scope.go:117] "RemoveContainer" containerID="7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"
Jun 06 05:25:16.029858 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029842    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a"} err="failed to get container status \"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a\": rpc error: code = NotFound desc = could not find container \"7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a\": container with ID starting with 7e437ac671dee5afa32064b7588ef6b6589d0f03608f9fb1de0bdc5c3da9504a not found: ID does not exist"
Jun 06 05:25:16.029858 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.029857    2582 scope.go:117] "RemoveContainer" containerID="75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51"
Jun 06 05:25:16.030039 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.030024    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51"} err="failed to get container status \"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51\": rpc error: code = NotFound desc = could not find container \"75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51\": container with ID starting with 75e4f0111e7f9794e5ccf38edec24ce4a7af7467c6e61e3102dced2f2b4b9d51 not found: ID does not exist"
Jun 06 05:25:16.044479 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.044459    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-offline-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:25:16.044479 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.044480    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-registry-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:25:16.044588 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.044488    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wqnf\" (UniqueName: \"kubernetes.io/projected/774f0e6d-4000-464d-b7b4-d58a85f77630-kube-api-access-9wqnf\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:25:16.044588 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.044497    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/774f0e6d-4000-464d-b7b4-d58a85f77630-online-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:25:16.044588 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:16.044505    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/774f0e6d-4000-464d-b7b4-d58a85f77630-feast-data\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:25:17.597461 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:25:17.597431    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" path="/var/lib/kubelet/pods/774f0e6d-4000-464d-b7b4-d58a85f77630/volumes"
Jun 06 05:26:52.575107 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575071    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"]
Jun 06 05:26:52.575618 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575603    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0065f3-ffc8-4054-a837-8fe6f6e20be5" containerName="redis"
Jun 06 05:26:52.575667 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575621    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0065f3-ffc8-4054-a837-8fe6f6e20be5" containerName="redis"
Jun 06 05:26:52.575667 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575652    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="registry"
Jun 06 05:26:52.575667 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="registry"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575683    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="feast-init"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575691    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="feast-init"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575710    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575718    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575730    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="offline"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575738    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="offline"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575753    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="feast-apply"
Jun 06 05:26:52.575764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575761    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="feast-apply"
Jun 06 05:26:52.576006 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575828    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="offline"
Jun 06 05:26:52.576006 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575842    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="online"
Jun 06 05:26:52.576006 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575851    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d0065f3-ffc8-4054-a837-8fe6f6e20be5" containerName="redis"
Jun 06 05:26:52.576006 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.575863    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="774f0e6d-4000-464d-b7b4-d58a85f77630" containerName="registry"
Jun 06 05:26:52.579571 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.579554    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.582076 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.582053    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jun 06 05:26:52.582204 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.582077    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 06 05:26:52.582204 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.582093    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 06 05:26:52.582476 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.582459    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jun 06 05:26:52.583015 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.582994    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 06 05:26:52.583369 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.583347    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-2whjg\""
Jun 06 05:26:52.583503 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.583000    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 06 05:26:52.595343 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.595313    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"]
Jun 06 05:26:52.737935 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.737905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-online-tls\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.738137 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.737941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xtzr\" (UniqueName: \"kubernetes.io/projected/eefe4650-00af-4ce9-aa67-ef49237a5434-kube-api-access-7xtzr\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.738137 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.737967    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eefe4650-00af-4ce9-aa67-ef49237a5434-feast-data\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.738137 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.738081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-registry-tls\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.839002 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.838965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-registry-tls\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.839188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.839011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-online-tls\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.839188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.839032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xtzr\" (UniqueName: \"kubernetes.io/projected/eefe4650-00af-4ce9-aa67-ef49237a5434-kube-api-access-7xtzr\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.839188 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.839056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eefe4650-00af-4ce9-aa67-ef49237a5434-feast-data\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.839500 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.839480    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eefe4650-00af-4ce9-aa67-ef49237a5434-feast-data\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.841534 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.841508    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-online-tls\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.841666 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.841643    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-registry-tls\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.846655 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.846631    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xtzr\" (UniqueName: \"kubernetes.io/projected/eefe4650-00af-4ce9-aa67-ef49237a5434-kube-api-access-7xtzr\") pod \"feast-credit-scoring-69945f8ff7-l5j6p\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") " pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:52.895670 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:52.895643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:26:53.029394 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:53.029363    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"]
Jun 06 05:26:53.031136 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:26:53.031110    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefe4650_00af_4ce9_aa67_ef49237a5434.slice/crio-e9442ed9f25b822cdfba24c9e4672560aba2fc36e2b88f43ecdcffb13d082c77 WatchSource:0}: Error finding container e9442ed9f25b822cdfba24c9e4672560aba2fc36e2b88f43ecdcffb13d082c77: Status 404 returned error can't find the container with id e9442ed9f25b822cdfba24c9e4672560aba2fc36e2b88f43ecdcffb13d082c77
Jun 06 05:26:53.396731 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:53.396552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerStarted","Data":"621d6b8116da733def1fd14acf4bf85b84325b38b7e8fec172e3d7eb90d35f55"}
Jun 06 05:26:53.396731 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:53.396627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerStarted","Data":"e9442ed9f25b822cdfba24c9e4672560aba2fc36e2b88f43ecdcffb13d082c77"}
Jun 06 05:26:54.402076 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:54.402041    2582 generic.go:356] "Generic (PLEG): container finished" podID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerID="621d6b8116da733def1fd14acf4bf85b84325b38b7e8fec172e3d7eb90d35f55" exitCode=0
Jun 06 05:26:54.402526 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:54.402128    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerDied","Data":"621d6b8116da733def1fd14acf4bf85b84325b38b7e8fec172e3d7eb90d35f55"}
Jun 06 05:26:55.409579 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:26:55.409535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerStarted","Data":"03034d553840547badf419fffef841fcfb64679254d1eacaeef8d635e85b04c7"}
Jun 06 05:27:02.439865 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:02.439831    2582 generic.go:356] "Generic (PLEG): container finished" podID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerID="03034d553840547badf419fffef841fcfb64679254d1eacaeef8d635e85b04c7" exitCode=0
Jun 06 05:27:02.440257 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:02.439902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerDied","Data":"03034d553840547badf419fffef841fcfb64679254d1eacaeef8d635e85b04c7"}
Jun 06 05:27:03.447320 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:03.447284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerStarted","Data":"4f46f0b6064b5853a73f2ec90db51b74b315e55cb51232f0aebc2756ffbfc968"}
Jun 06 05:27:03.447801 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:03.447344    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerStarted","Data":"a904d9083221acab85eaa5902d0a20fc638d565d2acfb3d579ad76f5c09b3dd1"}
Jun 06 05:27:03.469240 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:03.469182    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podStartSLOduration=11.469158549 podStartE2EDuration="11.469158549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:27:03.466939592 +0000 UTC m=+1106.326001794" watchObservedRunningTime="2026-06-06 05:27:03.469158549 +0000 UTC m=+1106.328220730"
Jun 06 05:27:04.896558 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:04.896503    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:04.897042 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:04.896586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:04.898053 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:04.898018    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 06 05:27:04.898198 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:04.898058    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 06 05:27:07.896476 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:07.896428    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 06 05:27:07.896961 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:07.896518    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 06 05:27:10.896982 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:10.896932    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Jun 06 05:27:10.902372 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:10.902341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:10.902822 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:10.902795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:10.905820 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:10.905798    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:12.896312 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:12.896254    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:13.897329 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:13.897294    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:14.501705 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:14.501675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:27:18.447540 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.447505    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"]
Jun 06 05:27:18.452154 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.452133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.455297 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.455250    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 06 05:27:18.455297 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.455285    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jun 06 05:27:18.455471 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.455308    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-6glrx\""
Jun 06 05:27:18.455471 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.455374    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jun 06 05:27:18.461242 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.461202    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"]
Jun 06 05:27:18.562893 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.562853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.562893 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.562899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-online-tls\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.563157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.562960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2fffd8-e9ad-4211-ba07-41cd73081833-feast-data\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.563157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.562995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d65g\" (UniqueName: \"kubernetes.io/projected/0a2fffd8-e9ad-4211-ba07-41cd73081833-kube-api-access-5d65g\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.664166 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.664130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d65g\" (UniqueName: \"kubernetes.io/projected/0a2fffd8-e9ad-4211-ba07-41cd73081833-kube-api-access-5d65g\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.664398 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.664191    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.664398 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.664222    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-online-tls\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.664398 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.664256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2fffd8-e9ad-4211-ba07-41cd73081833-feast-data\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.664398 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:27:18.664381    2582 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
Jun 06 05:27:18.664589 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:27:18.664458    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls podName:0a2fffd8-e9ad-4211-ba07-41cd73081833 nodeName:}" failed. No retries permitted until 2026-06-06 05:27:19.164438864 +0000 UTC m=+1122.023501033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls") pod "feast-driver-ranking-5597dbf8fd-p7kbl" (UID: "0a2fffd8-e9ad-4211-ba07-41cd73081833") : secret "feast-driver-ranking-registry-tls" not found
Jun 06 05:27:18.664720 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.664701    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2fffd8-e9ad-4211-ba07-41cd73081833-feast-data\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.666766 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.666741    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-online-tls\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:18.672068 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:18.672048    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d65g\" (UniqueName: \"kubernetes.io/projected/0a2fffd8-e9ad-4211-ba07-41cd73081833-kube-api-access-5d65g\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:19.168069 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:19.167984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:19.170388 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:19.170363    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls\") pod \"feast-driver-ranking-5597dbf8fd-p7kbl\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") " pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:19.364541 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:19.364505    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:19.496715 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:19.496687    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"]
Jun 06 05:27:19.497900 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:27:19.497871    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2fffd8_e9ad_4211_ba07_41cd73081833.slice/crio-6a81352b1908521bb2d09a691f4e9e813089e01b62e5aaac913581be72959706 WatchSource:0}: Error finding container 6a81352b1908521bb2d09a691f4e9e813089e01b62e5aaac913581be72959706: Status 404 returned error can't find the container with id 6a81352b1908521bb2d09a691f4e9e813089e01b62e5aaac913581be72959706
Jun 06 05:27:19.530574 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:19.530540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerStarted","Data":"6a81352b1908521bb2d09a691f4e9e813089e01b62e5aaac913581be72959706"}
Jun 06 05:27:20.536794 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:20.536763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerStarted","Data":"5fc4b51df5fd625d18bd4da768fc4fc9b09d445923560af38a8efa74e2648426"}
Jun 06 05:27:24.563061 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:24.563027    2582 generic.go:356] "Generic (PLEG): container finished" podID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerID="5fc4b51df5fd625d18bd4da768fc4fc9b09d445923560af38a8efa74e2648426" exitCode=0
Jun 06 05:27:24.563516 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:24.563077    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerDied","Data":"5fc4b51df5fd625d18bd4da768fc4fc9b09d445923560af38a8efa74e2648426"}
Jun 06 05:27:25.569991 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:25.569953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerStarted","Data":"c95274636ac0403055a85dd9c2c4436229a34a7306c32daaacfe1b77bf23472f"}
Jun 06 05:27:32.608493 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:32.608461    2582 generic.go:356] "Generic (PLEG): container finished" podID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerID="c95274636ac0403055a85dd9c2c4436229a34a7306c32daaacfe1b77bf23472f" exitCode=0
Jun 06 05:27:32.608873 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:32.608536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerDied","Data":"c95274636ac0403055a85dd9c2c4436229a34a7306c32daaacfe1b77bf23472f"}
Jun 06 05:27:33.617065 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:33.617028    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerStarted","Data":"9259f4c0533fc6e464f4bbc6e6e70ce74793a54ac321d3947e972bee7d6a1d0b"}
Jun 06 05:27:33.617599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:33.617089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerStarted","Data":"a802ef7de17057bf8401e13de047cd5835827e8f93429902c3090e4c747b1c85"}
Jun 06 05:27:33.639524 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:33.639463    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podStartSLOduration=15.639446678 podStartE2EDuration="15.639446678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:27:33.63700239 +0000 UTC m=+1136.496064560" watchObservedRunningTime="2026-06-06 05:27:33.639446678 +0000 UTC m=+1136.498508854"
Jun 06 05:27:34.365410 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:34.365371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:34.365599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:34.365431    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:34.367114 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:34.367080    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jun 06 05:27:34.367290 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:34.367124    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 06 05:27:37.365176 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:37.365130    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jun 06 05:27:37.365720 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:37.365253    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 06 05:27:39.365099 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:39.365051    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:39.365515 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:39.365177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:40.365640 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:40.365591    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jun 06 05:27:40.371102 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:40.371074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:40.374141 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:40.374117    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:43.365848 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:43.365800    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused"
Jun 06 05:27:46.366372 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:46.366337    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:27:46.367078 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:27:46.367060    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:28:37.680864 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:28:37.680833    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:28:37.684319 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:28:37.684298    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:29:02.511499 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.511459    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"]
Jun 06 05:29:02.513956 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.511658    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl" podUID="05928c59-4e8c-4414-a8b1-f4fd814652de" containerName="manager" containerID="cri-o://8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61" gracePeriod=10
Jun 06 05:29:02.737589 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.737129    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"]
Jun 06 05:29:02.737589 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.737540    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="registry" containerID="cri-o://a904d9083221acab85eaa5902d0a20fc638d565d2acfb3d579ad76f5c09b3dd1" gracePeriod=30
Jun 06 05:29:02.737959 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.737927    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online" containerID="cri-o://4f46f0b6064b5853a73f2ec90db51b74b315e55cb51232f0aebc2756ffbfc968" gracePeriod=30
Jun 06 05:29:02.744870 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.743944    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"]
Jun 06 05:29:02.744870 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.744332    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry" containerID="cri-o://a802ef7de17057bf8401e13de047cd5835827e8f93429902c3090e4c747b1c85" gracePeriod=30
Jun 06 05:29:02.744870 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.744532    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online" containerID="cri-o://9259f4c0533fc6e464f4bbc6e6e70ce74793a54ac321d3947e972bee7d6a1d0b" gracePeriod=30
Jun 06 05:29:02.810157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.810132    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:29:02.860537 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.860507    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg44t\" (UniqueName: \"kubernetes.io/projected/05928c59-4e8c-4414-a8b1-f4fd814652de-kube-api-access-jg44t\") pod \"05928c59-4e8c-4414-a8b1-f4fd814652de\" (UID: \"05928c59-4e8c-4414-a8b1-f4fd814652de\") "
Jun 06 05:29:02.862645 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.862619    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05928c59-4e8c-4414-a8b1-f4fd814652de-kube-api-access-jg44t" (OuterVolumeSpecName: "kube-api-access-jg44t") pod "05928c59-4e8c-4414-a8b1-f4fd814652de" (UID: "05928c59-4e8c-4414-a8b1-f4fd814652de"). InnerVolumeSpecName "kube-api-access-jg44t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:29:02.962028 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:02.961992    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg44t\" (UniqueName: \"kubernetes.io/projected/05928c59-4e8c-4414-a8b1-f4fd814652de-kube-api-access-jg44t\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:03.043237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.043138    2582 generic.go:356] "Generic (PLEG): container finished" podID="05928c59-4e8c-4414-a8b1-f4fd814652de" containerID="8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61" exitCode=0
Jun 06 05:29:03.043237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.043187    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"
Jun 06 05:29:03.043237 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.043220    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl" event={"ID":"05928c59-4e8c-4414-a8b1-f4fd814652de","Type":"ContainerDied","Data":"8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61"}
Jun 06 05:29:03.043506 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.043292    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl" event={"ID":"05928c59-4e8c-4414-a8b1-f4fd814652de","Type":"ContainerDied","Data":"c94371b63aad829b8e7a24ed3c8200f461c2455ffbda2b3650590f53e03fca31"}
Jun 06 05:29:03.043506 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.043314    2582 scope.go:117] "RemoveContainer" containerID="8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61"
Jun 06 05:29:03.051780 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.051751    2582 scope.go:117] "RemoveContainer" containerID="8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61"
Jun 06 05:29:03.052056 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:29:03.052036    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61\": container with ID starting with 8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61 not found: ID does not exist" containerID="8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61"
Jun 06 05:29:03.052109 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.052065    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61"} err="failed to get container status \"8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61\": rpc error: code = NotFound desc = could not find container \"8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61\": container with ID starting with 8568d9e04c74357dfd965333492f0e93c482eccc23274333092f1677134fcc61 not found: ID does not exist"
Jun 06 05:29:03.062781 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.062751    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"]
Jun 06 05:29:03.066243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.066217    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-59b4bcb6d8-llxkl"]
Jun 06 05:29:03.595759 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:03.595729    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05928c59-4e8c-4414-a8b1-f4fd814652de" path="/var/lib/kubelet/pods/05928c59-4e8c-4414-a8b1-f4fd814652de/volumes"
Jun 06 05:29:04.050477 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:04.050440    2582 generic.go:356] "Generic (PLEG): container finished" podID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerID="4f46f0b6064b5853a73f2ec90db51b74b315e55cb51232f0aebc2756ffbfc968" exitCode=0
Jun 06 05:29:04.050643 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:04.050514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerDied","Data":"4f46f0b6064b5853a73f2ec90db51b74b315e55cb51232f0aebc2756ffbfc968"}
Jun 06 05:29:04.052581 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:04.052559    2582 generic.go:356] "Generic (PLEG): container finished" podID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerID="9259f4c0533fc6e464f4bbc6e6e70ce74793a54ac321d3947e972bee7d6a1d0b" exitCode=0
Jun 06 05:29:04.052697 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:04.052601    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerDied","Data":"9259f4c0533fc6e464f4bbc6e6e70ce74793a54ac321d3947e972bee7d6a1d0b"}
Jun 06 05:29:10.372139 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:10.372095    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 06 05:29:10.903255 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:10.903213    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 06 05:29:20.372166 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:20.372114    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 06 05:29:20.903366 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:20.903316    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 06 05:29:30.372163 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:30.372120    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Jun 06 05:29:30.372593 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:30.372257    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:29:30.903175 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:30.903129    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Jun 06 05:29:30.903375 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:30.903315    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:29:33.190770 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.190737    2582 generic.go:356] "Generic (PLEG): container finished" podID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerID="a904d9083221acab85eaa5902d0a20fc638d565d2acfb3d579ad76f5c09b3dd1" exitCode=137
Jun 06 05:29:33.191207 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.190813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerDied","Data":"a904d9083221acab85eaa5902d0a20fc638d565d2acfb3d579ad76f5c09b3dd1"}
Jun 06 05:29:33.193142 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.193119    2582 generic.go:356] "Generic (PLEG): container finished" podID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerID="a802ef7de17057bf8401e13de047cd5835827e8f93429902c3090e4c747b1c85" exitCode=137
Jun 06 05:29:33.193217 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.193187    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerDied","Data":"a802ef7de17057bf8401e13de047cd5835827e8f93429902c3090e4c747b1c85"}
Jun 06 05:29:33.431702 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.431679    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:29:33.434072 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.434051    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:29:33.540220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eefe4650-00af-4ce9-aa67-ef49237a5434-feast-data\") pod \"eefe4650-00af-4ce9-aa67-ef49237a5434\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") "
Jun 06 05:29:33.540220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540188    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-online-tls\") pod \"0a2fffd8-e9ad-4211-ba07-41cd73081833\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") "
Jun 06 05:29:33.540220 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540219    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-online-tls\") pod \"eefe4650-00af-4ce9-aa67-ef49237a5434\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") "
Jun 06 05:29:33.540535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540237    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xtzr\" (UniqueName: \"kubernetes.io/projected/eefe4650-00af-4ce9-aa67-ef49237a5434-kube-api-access-7xtzr\") pod \"eefe4650-00af-4ce9-aa67-ef49237a5434\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") "
Jun 06 05:29:33.540535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls\") pod \"0a2fffd8-e9ad-4211-ba07-41cd73081833\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") "
Jun 06 05:29:33.540535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540330    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2fffd8-e9ad-4211-ba07-41cd73081833-feast-data\") pod \"0a2fffd8-e9ad-4211-ba07-41cd73081833\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") "
Jun 06 05:29:33.540535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540371    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d65g\" (UniqueName: \"kubernetes.io/projected/0a2fffd8-e9ad-4211-ba07-41cd73081833-kube-api-access-5d65g\") pod \"0a2fffd8-e9ad-4211-ba07-41cd73081833\" (UID: \"0a2fffd8-e9ad-4211-ba07-41cd73081833\") "
Jun 06 05:29:33.540535 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540434    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-registry-tls\") pod \"eefe4650-00af-4ce9-aa67-ef49237a5434\" (UID: \"eefe4650-00af-4ce9-aa67-ef49237a5434\") "
Jun 06 05:29:33.540814 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.540794    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a2fffd8-e9ad-4211-ba07-41cd73081833-feast-data" (OuterVolumeSpecName: "feast-data") pod "0a2fffd8-e9ad-4211-ba07-41cd73081833" (UID: "0a2fffd8-e9ad-4211-ba07-41cd73081833"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:29:33.542629 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.542592    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-online-tls" (OuterVolumeSpecName: "online-tls") pod "eefe4650-00af-4ce9-aa67-ef49237a5434" (UID: "eefe4650-00af-4ce9-aa67-ef49237a5434"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:29:33.542782 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.542753    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0a2fffd8-e9ad-4211-ba07-41cd73081833" (UID: "0a2fffd8-e9ad-4211-ba07-41cd73081833"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:29:33.542842 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.542792    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-online-tls" (OuterVolumeSpecName: "online-tls") pod "0a2fffd8-e9ad-4211-ba07-41cd73081833" (UID: "0a2fffd8-e9ad-4211-ba07-41cd73081833"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:29:33.543029 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.543003    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eefe4650-00af-4ce9-aa67-ef49237a5434-kube-api-access-7xtzr" (OuterVolumeSpecName: "kube-api-access-7xtzr") pod "eefe4650-00af-4ce9-aa67-ef49237a5434" (UID: "eefe4650-00af-4ce9-aa67-ef49237a5434"). InnerVolumeSpecName "kube-api-access-7xtzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:29:33.543120 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.543029    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eefe4650-00af-4ce9-aa67-ef49237a5434" (UID: "eefe4650-00af-4ce9-aa67-ef49237a5434"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:29:33.543120 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.543040    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2fffd8-e9ad-4211-ba07-41cd73081833-kube-api-access-5d65g" (OuterVolumeSpecName: "kube-api-access-5d65g") pod "0a2fffd8-e9ad-4211-ba07-41cd73081833" (UID: "0a2fffd8-e9ad-4211-ba07-41cd73081833"). InnerVolumeSpecName "kube-api-access-5d65g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:29:33.550348 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.550327    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eefe4650-00af-4ce9-aa67-ef49237a5434-feast-data" (OuterVolumeSpecName: "feast-data") pod "eefe4650-00af-4ce9-aa67-ef49237a5434" (UID: "eefe4650-00af-4ce9-aa67-ef49237a5434"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:29:33.642058 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642022    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eefe4650-00af-4ce9-aa67-ef49237a5434-feast-data\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:33.642058 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642055    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-online-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:33.642058 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642063    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-online-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:33.642320 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642073    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xtzr\" (UniqueName: \"kubernetes.io/projected/eefe4650-00af-4ce9-aa67-ef49237a5434-kube-api-access-7xtzr\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:33.642320 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642082    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a2fffd8-e9ad-4211-ba07-41cd73081833-registry-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:33.642320 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642092    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a2fffd8-e9ad-4211-ba07-41cd73081833-feast-data\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:33.642320 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642106    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d65g\" (UniqueName: \"kubernetes.io/projected/0a2fffd8-e9ad-4211-ba07-41cd73081833-kube-api-access-5d65g\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:33.642320 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:33.642116    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eefe4650-00af-4ce9-aa67-ef49237a5434-registry-tls\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:29:34.200083 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.200045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p" event={"ID":"eefe4650-00af-4ce9-aa67-ef49237a5434","Type":"ContainerDied","Data":"e9442ed9f25b822cdfba24c9e4672560aba2fc36e2b88f43ecdcffb13d082c77"}
Jun 06 05:29:34.200083 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.200058    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"
Jun 06 05:29:34.200699 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.200100    2582 scope.go:117] "RemoveContainer" containerID="4f46f0b6064b5853a73f2ec90db51b74b315e55cb51232f0aebc2756ffbfc968"
Jun 06 05:29:34.202620 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.202590    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl" event={"ID":"0a2fffd8-e9ad-4211-ba07-41cd73081833","Type":"ContainerDied","Data":"6a81352b1908521bb2d09a691f4e9e813089e01b62e5aaac913581be72959706"}
Jun 06 05:29:34.202749 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.202620    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"
Jun 06 05:29:34.209362 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.209346    2582 scope.go:117] "RemoveContainer" containerID="a904d9083221acab85eaa5902d0a20fc638d565d2acfb3d579ad76f5c09b3dd1"
Jun 06 05:29:34.217757 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.217669    2582 scope.go:117] "RemoveContainer" containerID="03034d553840547badf419fffef841fcfb64679254d1eacaeef8d635e85b04c7"
Jun 06 05:29:34.218318 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.218296    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"]
Jun 06 05:29:34.219976 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.219955    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69945f8ff7-l5j6p"]
Jun 06 05:29:34.225137 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.225120    2582 scope.go:117] "RemoveContainer" containerID="621d6b8116da733def1fd14acf4bf85b84325b38b7e8fec172e3d7eb90d35f55"
Jun 06 05:29:34.230444 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.230422    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"]
Jun 06 05:29:34.235079 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.235060    2582 scope.go:117] "RemoveContainer" containerID="9259f4c0533fc6e464f4bbc6e6e70ce74793a54ac321d3947e972bee7d6a1d0b"
Jun 06 05:29:34.235728 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.235712    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5597dbf8fd-p7kbl"]
Jun 06 05:29:34.242436 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.242418    2582 scope.go:117] "RemoveContainer" containerID="a802ef7de17057bf8401e13de047cd5835827e8f93429902c3090e4c747b1c85"
Jun 06 05:29:34.249703 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.249687    2582 scope.go:117] "RemoveContainer" containerID="c95274636ac0403055a85dd9c2c4436229a34a7306c32daaacfe1b77bf23472f"
Jun 06 05:29:34.256803 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:34.256781    2582 scope.go:117] "RemoveContainer" containerID="5fc4b51df5fd625d18bd4da768fc4fc9b09d445923560af38a8efa74e2648426"
Jun 06 05:29:35.596091 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:35.596054    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" path="/var/lib/kubelet/pods/0a2fffd8-e9ad-4211-ba07-41cd73081833/volumes"
Jun 06 05:29:35.596578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:29:35.596564    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" path="/var/lib/kubelet/pods/eefe4650-00af-4ce9-aa67-ef49237a5434/volumes"
Jun 06 05:33:37.708186 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:33:37.708157    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:33:37.712083 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:33:37.712052    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:38:37.735522 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:38:37.735489    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:38:37.739360 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:38:37.739342    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:39:55.848125 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848045    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2j6rn/must-gather-v6p8x"]
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848386    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="feast-apply"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848399    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="feast-apply"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848408    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="feast-init"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848414    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="feast-init"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848422    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="registry"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848427    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="registry"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848434    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="feast-apply"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848440    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="feast-apply"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848447    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05928c59-4e8c-4414-a8b1-f4fd814652de" containerName="manager"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848452    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="05928c59-4e8c-4414-a8b1-f4fd814652de" containerName="manager"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848458    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848463    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848470    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="feast-init"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848475    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="feast-init"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848485    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848490    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848499    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848505    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848573    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="registry"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848581    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="online"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848588    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eefe4650-00af-4ce9-aa67-ef49237a5434" containerName="online"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848594    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="05928c59-4e8c-4414-a8b1-f4fd814652de" containerName="manager"
Jun 06 05:39:55.848592 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.848600    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2fffd8-e9ad-4211-ba07-41cd73081833" containerName="registry"
Jun 06 05:39:55.850400 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.850384    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:55.852946 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.852924    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2j6rn\"/\"default-dockercfg-9fkqv\""
Jun 06 05:39:55.853173 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.853158    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2j6rn\"/\"openshift-service-ca.crt\""
Jun 06 05:39:55.853223 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.853207    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2j6rn\"/\"kube-root-ca.crt\""
Jun 06 05:39:55.858820 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.858800    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2j6rn/must-gather-v6p8x"]
Jun 06 05:39:55.924846 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.924804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4a2ed6e-7118-4477-a719-5c3806649b6b-must-gather-output\") pod \"must-gather-v6p8x\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") " pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:55.925027 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:55.924858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6q8x\" (UniqueName: \"kubernetes.io/projected/a4a2ed6e-7118-4477-a719-5c3806649b6b-kube-api-access-l6q8x\") pod \"must-gather-v6p8x\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") " pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:56.025450 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.025415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4a2ed6e-7118-4477-a719-5c3806649b6b-must-gather-output\") pod \"must-gather-v6p8x\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") " pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:56.025589 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.025457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6q8x\" (UniqueName: \"kubernetes.io/projected/a4a2ed6e-7118-4477-a719-5c3806649b6b-kube-api-access-l6q8x\") pod \"must-gather-v6p8x\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") " pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:56.025766 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.025748    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4a2ed6e-7118-4477-a719-5c3806649b6b-must-gather-output\") pod \"must-gather-v6p8x\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") " pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:56.033709 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.033686    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6q8x\" (UniqueName: \"kubernetes.io/projected/a4a2ed6e-7118-4477-a719-5c3806649b6b-kube-api-access-l6q8x\") pod \"must-gather-v6p8x\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") " pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:56.167605 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.167516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:39:56.289486 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.289459    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2j6rn/must-gather-v6p8x"]
Jun 06 05:39:56.291321 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:39:56.291289    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4a2ed6e_7118_4477_a719_5c3806649b6b.slice/crio-d49f8b01bd9a8968e9cab87c1494157d205d56a4092e013c47324e7182b64dfd WatchSource:0}: Error finding container d49f8b01bd9a8968e9cab87c1494157d205d56a4092e013c47324e7182b64dfd: Status 404 returned error can't find the container with id d49f8b01bd9a8968e9cab87c1494157d205d56a4092e013c47324e7182b64dfd
Jun 06 05:39:56.292995 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.292979    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:39:56.751704 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:39:56.751665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j6rn/must-gather-v6p8x" event={"ID":"a4a2ed6e-7118-4477-a719-5c3806649b6b","Type":"ContainerStarted","Data":"d49f8b01bd9a8968e9cab87c1494157d205d56a4092e013c47324e7182b64dfd"}
Jun 06 05:40:02.784722 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:02.784687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j6rn/must-gather-v6p8x" event={"ID":"a4a2ed6e-7118-4477-a719-5c3806649b6b","Type":"ContainerStarted","Data":"cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b"}
Jun 06 05:40:02.785133 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:02.784734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j6rn/must-gather-v6p8x" event={"ID":"a4a2ed6e-7118-4477-a719-5c3806649b6b","Type":"ContainerStarted","Data":"b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347"}
Jun 06 05:40:02.800635 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:02.800582    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2j6rn/must-gather-v6p8x" podStartSLOduration=1.877254322 podStartE2EDuration="7.800567328s" totalImagesPullingTime="5.923313006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:40:02.799884449 +0000 UTC m=+1885.658946627" watchObservedRunningTime="2026-06-06 05:40:02.800567328 +0000 UTC m=+1885.659629543"
Jun 06 05:40:11.825483 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:11.825449    2582 generic.go:356] "Generic (PLEG): container finished" podID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerID="b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347" exitCode=0
Jun 06 05:40:11.825881 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:11.825520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j6rn/must-gather-v6p8x" event={"ID":"a4a2ed6e-7118-4477-a719-5c3806649b6b","Type":"ContainerDied","Data":"b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347"}
Jun 06 05:40:11.825881 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:11.825830    2582 scope.go:117] "RemoveContainer" containerID="b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347"
Jun 06 05:40:12.752062 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:12.752033    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2j6rn_must-gather-v6p8x_a4a2ed6e-7118-4477-a719-5c3806649b6b/gather/0.log"
Jun 06 05:40:15.791980 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:15.791951    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4h6kg_1ec17605-be56-4a99-baa7-65fd72731055/global-pull-secret-syncer/0.log"
Jun 06 05:40:15.982908 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:15.982875    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nz87r_5f4f23c5-3994-4b56-9502-dc371024ea36/konnectivity-agent/0.log"
Jun 06 05:40:16.048879 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:16.048795    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-193.ec2.internal_060bae564ec193646c7c0fa2a1f6170e/haproxy/0.log"
Jun 06 05:40:18.067789 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.067751    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2j6rn/must-gather-v6p8x"]
Jun 06 05:40:18.068622 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.067918    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-2j6rn/must-gather-v6p8x" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerName="copy" containerID="cri-o://cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b" gracePeriod=2
Jun 06 05:40:18.070047 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:40:18.070009    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-v6p8x\" is forbidden: User \"system:node:ip-10-0-142-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2j6rn\": no relationship found between node 'ip-10-0-142-193.ec2.internal' and this object" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:40:18.070722 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.070700    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2j6rn/must-gather-v6p8x"]
Jun 06 05:40:18.307361 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.307338    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2j6rn_must-gather-v6p8x_a4a2ed6e-7118-4477-a719-5c3806649b6b/copy/0.log"
Jun 06 05:40:18.308690 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.308674    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:40:18.310733 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:40:18.310710    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-v6p8x\" is forbidden: User \"system:node:ip-10-0-142-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2j6rn\": no relationship found between node 'ip-10-0-142-193.ec2.internal' and this object" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:40:18.421406 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.421373    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6q8x\" (UniqueName: \"kubernetes.io/projected/a4a2ed6e-7118-4477-a719-5c3806649b6b-kube-api-access-l6q8x\") pod \"a4a2ed6e-7118-4477-a719-5c3806649b6b\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") "
Jun 06 05:40:18.421582 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.421443    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4a2ed6e-7118-4477-a719-5c3806649b6b-must-gather-output\") pod \"a4a2ed6e-7118-4477-a719-5c3806649b6b\" (UID: \"a4a2ed6e-7118-4477-a719-5c3806649b6b\") "
Jun 06 05:40:18.421808 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.421787    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4a2ed6e-7118-4477-a719-5c3806649b6b-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a4a2ed6e-7118-4477-a719-5c3806649b6b" (UID: "a4a2ed6e-7118-4477-a719-5c3806649b6b"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:40:18.423598 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.423575    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a2ed6e-7118-4477-a719-5c3806649b6b-kube-api-access-l6q8x" (OuterVolumeSpecName: "kube-api-access-l6q8x") pod "a4a2ed6e-7118-4477-a719-5c3806649b6b" (UID: "a4a2ed6e-7118-4477-a719-5c3806649b6b"). InnerVolumeSpecName "kube-api-access-l6q8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:40:18.522603 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.522563    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6q8x\" (UniqueName: \"kubernetes.io/projected/a4a2ed6e-7118-4477-a719-5c3806649b6b-kube-api-access-l6q8x\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:40:18.522603 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.522596    2582 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a4a2ed6e-7118-4477-a719-5c3806649b6b-must-gather-output\") on node \"ip-10-0-142-193.ec2.internal\" DevicePath \"\""
Jun 06 05:40:18.853028 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.853001    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2j6rn_must-gather-v6p8x_a4a2ed6e-7118-4477-a719-5c3806649b6b/copy/0.log"
Jun 06 05:40:18.853376 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.853353    2582 generic.go:356] "Generic (PLEG): container finished" podID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerID="cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b" exitCode=143
Jun 06 05:40:18.853447 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.853400    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:40:18.853510 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.853469    2582 scope.go:117] "RemoveContainer" containerID="cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b"
Jun 06 05:40:18.855750 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:40:18.855724    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-v6p8x\" is forbidden: User \"system:node:ip-10-0-142-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2j6rn\": no relationship found between node 'ip-10-0-142-193.ec2.internal' and this object" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:40:18.861432 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.861412    2582 scope.go:117] "RemoveContainer" containerID="b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347"
Jun 06 05:40:18.863335 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:40:18.863308    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-v6p8x\" is forbidden: User \"system:node:ip-10-0-142-193.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2j6rn\": no relationship found between node 'ip-10-0-142-193.ec2.internal' and this object" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" pod="openshift-must-gather-2j6rn/must-gather-v6p8x"
Jun 06 05:40:18.872476 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.872457    2582 scope.go:117] "RemoveContainer" containerID="cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b"
Jun 06 05:40:18.872751 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:40:18.872733    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b\": container with ID starting with cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b not found: ID does not exist" containerID="cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b"
Jun 06 05:40:18.872817 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.872757    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b"} err="failed to get container status \"cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b\": rpc error: code = NotFound desc = could not find container \"cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b\": container with ID starting with cb5592618ddf92159732f33542e56ab53eea4505f8b3e963fa43814cc77ace8b not found: ID does not exist"
Jun 06 05:40:18.872817 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.872773    2582 scope.go:117] "RemoveContainer" containerID="b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347"
Jun 06 05:40:18.873002 ip-10-0-142-193 kubenswrapper[2582]: E0606 05:40:18.872984    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347\": container with ID starting with b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347 not found: ID does not exist" containerID="b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347"
Jun 06 05:40:18.873043 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:18.873010    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347"} err="failed to get container status \"b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347\": rpc error: code = NotFound desc = could not find container \"b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347\": container with ID starting with b19a3235c83ada173c18c04360789500323ae694d3788eb679145b4ca5dd2347 not found: ID does not exist"
Jun 06 05:40:19.596181 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.596145    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" path="/var/lib/kubelet/pods/a4a2ed6e-7118-4477-a719-5c3806649b6b/volumes"
Jun 06 05:40:19.759578 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.759545    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5f2aff2-983b-4369-a8a1-e664eb79a496/alertmanager/0.log"
Jun 06 05:40:19.793251 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.793218    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5f2aff2-983b-4369-a8a1-e664eb79a496/config-reloader/0.log"
Jun 06 05:40:19.820602 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.820577    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5f2aff2-983b-4369-a8a1-e664eb79a496/kube-rbac-proxy-web/0.log"
Jun 06 05:40:19.843324 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.843292    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5f2aff2-983b-4369-a8a1-e664eb79a496/kube-rbac-proxy/0.log"
Jun 06 05:40:19.877712 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.877639    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5f2aff2-983b-4369-a8a1-e664eb79a496/kube-rbac-proxy-metric/0.log"
Jun 06 05:40:19.901053 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.901027    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5f2aff2-983b-4369-a8a1-e664eb79a496/prom-label-proxy/0.log"
Jun 06 05:40:19.922763 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.922738    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f5f2aff2-983b-4369-a8a1-e664eb79a496/init-config-reloader/0.log"
Jun 06 05:40:19.957970 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.957942    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-7mcd8_997e6d4e-8f92-42a7-8330-072e5148ead7/cluster-monitoring-operator/0.log"
Jun 06 05:40:19.982077 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:19.982050    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dhsx4_e7c99d57-417f-4d20-b110-d4af1bbdb080/kube-state-metrics/0.log"
Jun 06 05:40:20.006915 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.006886    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dhsx4_e7c99d57-417f-4d20-b110-d4af1bbdb080/kube-rbac-proxy-main/0.log"
Jun 06 05:40:20.033923 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.033900    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-dhsx4_e7c99d57-417f-4d20-b110-d4af1bbdb080/kube-rbac-proxy-self/0.log"
Jun 06 05:40:20.091604 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.091575    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-b68xg_60dc47d3-96d3-494c-b247-e37721737c54/monitoring-plugin/0.log"
Jun 06 05:40:20.277785 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.277701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzmxb_67a13be3-bcd3-437d-bc37-131fc6ac12d2/node-exporter/0.log"
Jun 06 05:40:20.299332 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.299306    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzmxb_67a13be3-bcd3-437d-bc37-131fc6ac12d2/kube-rbac-proxy/0.log"
Jun 06 05:40:20.322727 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.322706    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wzmxb_67a13be3-bcd3-437d-bc37-131fc6ac12d2/init-textfile/0.log"
Jun 06 05:40:20.692243 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.692214    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-9bl7l_9154828d-1203-4b78-a1a8-604fa4664f52/prometheus-operator-admission-webhook/0.log"
Jun 06 05:40:20.721557 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.721530    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c86c57c4-8cmkl_d83f6c72-13fb-43d1-a251-d10d7635149d/telemeter-client/0.log"
Jun 06 05:40:20.742370 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.742349    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c86c57c4-8cmkl_d83f6c72-13fb-43d1-a251-d10d7635149d/reload/0.log"
Jun 06 05:40:20.763324 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.763300    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c86c57c4-8cmkl_d83f6c72-13fb-43d1-a251-d10d7635149d/kube-rbac-proxy/0.log"
Jun 06 05:40:20.795573 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.795553    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/thanos-query/0.log"
Jun 06 05:40:20.825674 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.825652    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy-web/0.log"
Jun 06 05:40:20.845799 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.845780    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy/0.log"
Jun 06 05:40:20.869506 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.869480    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/prom-label-proxy/0.log"
Jun 06 05:40:20.891402 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.891382    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy-rules/0.log"
Jun 06 05:40:20.913157 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:20.913140    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-767999fc4b-76wtg_a7bea0d4-c87a-48a7-9aa2-1831e832871f/kube-rbac-proxy-metrics/0.log"
Jun 06 05:40:22.152915 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:22.152885    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-bkwl8_19f77e19-1efe-4ed5-a9bb-b3e2b561c16b/networking-console-plugin/0.log"
Jun 06 05:40:23.017838 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.017804    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-pw8h6_6f86cb5a-b428-490b-a095-268c383ec622/download-server/0.log"
Jun 06 05:40:23.483199 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.483159    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"]
Jun 06 05:40:23.483791 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.483677    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerName="gather"
Jun 06 05:40:23.483791 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.483697    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerName="gather"
Jun 06 05:40:23.483791 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.483717    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerName="copy"
Jun 06 05:40:23.483791 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.483726    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerName="copy"
Jun 06 05:40:23.484009 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.483802    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerName="gather"
Jun 06 05:40:23.484009 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.483813    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a2ed6e-7118-4477-a719-5c3806649b6b" containerName="copy"
Jun 06 05:40:23.488843 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.488822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.491511 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.491490    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9qq24\"/\"default-dockercfg-jqqtz\""
Jun 06 05:40:23.491713 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.491697    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qq24\"/\"openshift-service-ca.crt\""
Jun 06 05:40:23.492697 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.492682    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qq24\"/\"kube-root-ca.crt\""
Jun 06 05:40:23.495032 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.495010    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"]
Jun 06 05:40:23.506851 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.506826    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-7ggnv_d6611bec-45ff-437e-bbeb-d1c236a92c32/volume-data-source-validator/0.log"
Jun 06 05:40:23.563599 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.563570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-lib-modules\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.563760 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.563642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-proc\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.563760 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.563662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-sys\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.563760 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.563686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-podres\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.563760 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.563711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79thn\" (UniqueName: \"kubernetes.io/projected/29ea19a1-7160-41b2-a959-0ef5b124c8b6-kube-api-access-79thn\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.664913 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.664873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-podres\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665116 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.664932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79thn\" (UniqueName: \"kubernetes.io/projected/29ea19a1-7160-41b2-a959-0ef5b124c8b6-kube-api-access-79thn\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665116 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.664968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-lib-modules\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665116 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.665042    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-podres\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665116 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.665056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-proc\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665116 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.665085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-sys\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.665135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-lib-modules\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.665161    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-sys\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.665374 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.665184    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29ea19a1-7160-41b2-a959-0ef5b124c8b6-proc\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.672479 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.672459    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79thn\" (UniqueName: \"kubernetes.io/projected/29ea19a1-7160-41b2-a959-0ef5b124c8b6-kube-api-access-79thn\") pod \"perf-node-gather-daemonset-kqjgf\" (UID: \"29ea19a1-7160-41b2-a959-0ef5b124c8b6\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.799741 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.799659    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:23.928959 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:23.928932    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"]
Jun 06 05:40:23.931647 ip-10-0-142-193 kubenswrapper[2582]: W0606 05:40:23.931620    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29ea19a1_7160_41b2_a959_0ef5b124c8b6.slice/crio-dd93af0a07473a95e11bcf3dc6f4c49ad4fafb56c7fa4a95751d1e8132d7493c WatchSource:0}: Error finding container dd93af0a07473a95e11bcf3dc6f4c49ad4fafb56c7fa4a95751d1e8132d7493c: Status 404 returned error can't find the container with id dd93af0a07473a95e11bcf3dc6f4c49ad4fafb56c7fa4a95751d1e8132d7493c
Jun 06 05:40:24.364916 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.364889    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9bbql_ef7708bc-ab15-44a8-8399-5da9076c0fd2/dns/0.log"
Jun 06 05:40:24.385946 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.385921    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9bbql_ef7708bc-ab15-44a8-8399-5da9076c0fd2/kube-rbac-proxy/0.log"
Jun 06 05:40:24.474933 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.474901    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7dhtw_85238ec9-ad65-4dcb-a789-d83c9861f21b/dns-node-resolver/0.log"
Jun 06 05:40:24.880932 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.880897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf" event={"ID":"29ea19a1-7160-41b2-a959-0ef5b124c8b6","Type":"ContainerStarted","Data":"a93c12f4fd9cac332dc3dd0964039b6e7bed1ccf72167d967eb14ff550e04563"}
Jun 06 05:40:24.881425 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.880956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf" event={"ID":"29ea19a1-7160-41b2-a959-0ef5b124c8b6","Type":"ContainerStarted","Data":"dd93af0a07473a95e11bcf3dc6f4c49ad4fafb56c7fa4a95751d1e8132d7493c"}
Jun 06 05:40:24.881425 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.881031    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:24.890527 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.890508    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7k9lr_f040a8fe-109d-4355-abd6-5d1ee6101544/node-ca/0.log"
Jun 06 05:40:24.895861 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:24.895788    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf" podStartSLOduration=1.895775875 podStartE2EDuration="1.895775875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:40:24.894601441 +0000 UTC m=+1907.753663630" watchObservedRunningTime="2026-06-06 05:40:24.895775875 +0000 UTC m=+1907.754838052"
Jun 06 05:40:25.646111 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:25.646083    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c7d6c6877-lc882_c1d2a316-1671-45af-b0a6-6332a51da69d/router/0.log"
Jun 06 05:40:26.014091 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:26.014013    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shh2l_a0b76e14-9df2-4368-a311-ec3991bc389c/serve-healthcheck-canary/0.log"
Jun 06 05:40:26.475926 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:26.475883    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjz5x_ec6615a8-aef3-4ccb-ac78-8ad03cf584c7/kube-rbac-proxy/0.log"
Jun 06 05:40:26.496437 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:26.496414    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjz5x_ec6615a8-aef3-4ccb-ac78-8ad03cf584c7/exporter/0.log"
Jun 06 05:40:26.516774 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:26.516745    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjz5x_ec6615a8-aef3-4ccb-ac78-8ad03cf584c7/extractor/0.log"
Jun 06 05:40:30.593509 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:30.593470    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jj47z_419fcb35-bfbc-47e2-95e9-a8cdbaaf799b/kube-storage-version-migrator-operator/1.log"
Jun 06 05:40:30.594305 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:30.594287    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-jj47z_419fcb35-bfbc-47e2-95e9-a8cdbaaf799b/kube-storage-version-migrator-operator/0.log"
Jun 06 05:40:30.894154 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:30.894073    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-kqjgf"
Jun 06 05:40:31.633108 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.633079    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z67zh_d28ddda6-b11e-4174-8d80-f7dec7acbc41/kube-multus-additional-cni-plugins/0.log"
Jun 06 05:40:31.654579 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.654554    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z67zh_d28ddda6-b11e-4174-8d80-f7dec7acbc41/egress-router-binary-copy/0.log"
Jun 06 05:40:31.676314 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.676290    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z67zh_d28ddda6-b11e-4174-8d80-f7dec7acbc41/cni-plugins/0.log"
Jun 06 05:40:31.697378 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.697351    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z67zh_d28ddda6-b11e-4174-8d80-f7dec7acbc41/bond-cni-plugin/0.log"
Jun 06 05:40:31.719073 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.719053    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z67zh_d28ddda6-b11e-4174-8d80-f7dec7acbc41/routeoverride-cni/0.log"
Jun 06 05:40:31.743680 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.743601    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z67zh_d28ddda6-b11e-4174-8d80-f7dec7acbc41/whereabouts-cni-bincopy/0.log"
Jun 06 05:40:31.767937 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.767909    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z67zh_d28ddda6-b11e-4174-8d80-f7dec7acbc41/whereabouts-cni/0.log"
Jun 06 05:40:31.807039 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.807012    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qgmhn_9b3345ed-3dc7-4347-b6d1-2f0187753f53/kube-multus/0.log"
Jun 06 05:40:31.938476 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.938399    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wv65h_89665e91-1799-4a69-b55a-54c498846550/network-metrics-daemon/0.log"
Jun 06 05:40:31.958644 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:31.958616    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wv65h_89665e91-1799-4a69-b55a-54c498846550/kube-rbac-proxy/0.log"
Jun 06 05:40:32.971097 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:32.971067    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-controller/0.log"
Jun 06 05:40:32.990752 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:32.990725    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/0.log"
Jun 06 05:40:32.990885 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:32.990793    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovn-acl-logging/1.log"
Jun 06 05:40:33.010279 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:33.010234    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/kube-rbac-proxy-node/0.log"
Jun 06 05:40:33.030013 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:33.029988    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/kube-rbac-proxy-ovn-metrics/0.log"
Jun 06 05:40:33.049741 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:33.049724    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/northd/0.log"
Jun 06 05:40:33.070392 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:33.070336    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/nbdb/0.log"
Jun 06 05:40:33.092384 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:33.092364    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/sbdb/0.log"
Jun 06 05:40:33.132382 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:33.132361    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p4xl4_eef09fbb-8000-41fc-aeb1-533d75c4be90/ovnkube-controller/0.log"
Jun 06 05:40:34.281008 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:34.280978    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-5m5s6_614819d6-b20f-43ea-bd5b-d81e80b3d8ef/check-endpoints/0.log"
Jun 06 05:40:34.303491 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:34.303463    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6fwqv_ca54cfb3-d638-4f3d-8d64-6d871bccf05e/network-check-target-container/0.log"
Jun 06 05:40:35.183764 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:35.183736    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bkb85_59bc29f0-1841-4ede-ba06-946ede4ebda8/iptables-alerter/0.log"
Jun 06 05:40:35.824481 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:35.824451    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-n447v_4f00ccf2-f8b9-4c22-b3ff-a719de44d014/tuned/0.log"
Jun 06 05:40:37.425756 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:37.425722    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-ffdh5_c05531af-ac75-4cf5-b361-f3caf10728b7/cluster-samples-operator/0.log"
Jun 06 05:40:37.442124 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:37.442096    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-ffdh5_c05531af-ac75-4cf5-b361-f3caf10728b7/cluster-samples-operator-watch/0.log"
Jun 06 05:40:38.289547 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:38.289515    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-b8rcn_b5e2c96a-5c24-4ce9-99fd-1afcff47a06b/service-ca-operator/1.log"
Jun 06 05:40:38.290242 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:38.290213    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-b8rcn_b5e2c96a-5c24-4ce9-99fd-1afcff47a06b/service-ca-operator/0.log"
Jun 06 05:40:38.586666 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:38.586643    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-lxk7f_b31a9999-5320-4777-9d7c-5ca31a60915c/service-ca-controller/0.log"
Jun 06 05:40:38.981989 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:38.981917    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-grfwr_3bdf9f5e-4f2f-4be8-93df-214257019dbc/csi-driver/0.log"
Jun 06 05:40:39.002113 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:39.002088    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-grfwr_3bdf9f5e-4f2f-4be8-93df-214257019dbc/csi-node-driver-registrar/0.log"
Jun 06 05:40:39.021887 ip-10-0-142-193 kubenswrapper[2582]: I0606 05:40:39.021860    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-grfwr_3bdf9f5e-4f2f-4be8-93df-214257019dbc/csi-liveness-probe/0.log"