Jun 03 21:30:28.736761 ip-10-0-140-77 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 21:30:29.157585 ip-10-0-140-77 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 21:30:29.157585 ip-10-0-140-77 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 21:30:29.157585 ip-10-0-140-77 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 21:30:29.157585 ip-10-0-140-77 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 21:30:29.157585 ip-10-0-140-77 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 21:30:29.158389 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.157661    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 21:30:29.163261 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163229    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 21:30:29.163261 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163254    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 21:30:29.163261 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163260    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 21:30:29.163261 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163265    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 21:30:29.163261 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163269    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 21:30:29.163261 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163273    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163278    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163283    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163288    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163291    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163295    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163299    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163303    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163306    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163310    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163314    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163317    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163320    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163324    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163336    2574 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163341    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163345    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163348    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163351    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163355    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 21:30:29.163675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163359    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163363    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163367    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163371    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163374    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163378    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163382    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163386    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163390    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163393    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163397    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163401    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163405    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163427    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163431    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163435    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163439    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163444    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163449    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163453    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 21:30:29.164509 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163457    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163461    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163465    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163470    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163474    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163478    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163483    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163488    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163493    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163499    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163504    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163510    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163515    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163519    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163523    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163528    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163533    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163537    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163541    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 21:30:29.165382 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163546    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163550    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163554    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163558    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163562    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163566    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163572    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163576    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163581    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163585    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163589    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163593    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163603    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163610    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163615    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163619    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163624    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163628    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163632    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163636    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 21:30:29.166109 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163640    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163644    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163652    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163658    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163664    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163670    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163676    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163681    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163685    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163690    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163695    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163699    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163703    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.163708    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164931    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164942    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164948    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164952    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164957    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 21:30:29.166869 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164962    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164967    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164971    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164976    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164980    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164984    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164988    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164993    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.164997    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165001    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165006    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165010    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165014    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165018    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165023    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165027    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165032    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165037    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165042    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 21:30:29.167690 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165047    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165051    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165055    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165059    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165063    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165067    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165072    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165076    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165082    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165087    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165091    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165096    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165100    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165104    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165109    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165113    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165119    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165125    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165129    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165134    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 21:30:29.168292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165140    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165143    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165148    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165152    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165157    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165164    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165170    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165175    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165180    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165184    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165191    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165195    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165200    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165204    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165209    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165213    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165217    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165222    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165226    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 21:30:29.168811 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165230    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165234    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165238    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165243    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165247    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165252    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165256    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165261    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165265    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165269    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165274    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165278    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165282    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165286    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165291    2574 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165295    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165299    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165303    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165307    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165315    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 21:30:29.169292 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165322    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165327    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165331    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165336    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.165436    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166679    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166694    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166700    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166706    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166711    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166717    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166722    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166726    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166734    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.166739    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167878    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167890    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167897    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167902    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167907    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167913    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 21:30:29.169814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167917    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167922    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.167927    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168108    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168117    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168122    2574 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168127    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168132    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168136    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168141    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168145    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168150    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168154    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168158    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168163    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168167    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168171    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168176    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168181    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168185    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 21:30:29.170356 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168188    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168193    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168197    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168201    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168206    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168215    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168219    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168223    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168226    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168231    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168235    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168239    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168243    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168247    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168251    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168257    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168261    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168265    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168269    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168276    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 21:30:29.170885 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168281    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168284    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168288    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168294    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168298    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168303    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168307    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168311    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168315    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168319    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168323    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168326    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168329    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168332    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168336    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168338    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168341    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168344    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168347    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168350    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 21:30:29.171451 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168352    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168355    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168360    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168364    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168368    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168372    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168377    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168381    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168384    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168387    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168389    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168393    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168397    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168402    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168407    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168427    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168437    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168441    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168445    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 21:30:29.171960 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168448    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168451    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168455    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168458    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168462    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168465    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168468    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168471    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168474    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168477    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168480    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168482    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.168485    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168575    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168587    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168597    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168604    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168611    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168614    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168620    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168626    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 21:30:29.172439 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168629    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168633    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168636    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168640    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168643    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168646    2574 flags.go:64] FLAG: --cgroup-root=""
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168649    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168652    2574 flags.go:64] FLAG: --client-ca-file=""
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168655    2574 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168659    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168663    2574 flags.go:64] FLAG: --cluster-domain=""
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168666    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168670    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168673    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168676    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168680    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168684    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168687    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168690    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168693    2574 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168696    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168699    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168703    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168706    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 21:30:29.173000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168711    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168714    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168717    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168720    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168723    2574 flags.go:64] FLAG: --enable-server="true"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168726    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168732    2574 flags.go:64] FLAG: --event-burst="100"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168736    2574 flags.go:64] FLAG: --event-qps="50"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168739    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168743    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168746    2574 flags.go:64] FLAG: --eviction-hard=""
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168750    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168753    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168756    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168759    2574 flags.go:64] FLAG: --eviction-soft=""
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168762    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168765    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168768    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168771    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168774    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168777    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168780    2574 flags.go:64] FLAG: --feature-gates=""
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168787    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168791    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168794    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 21:30:29.173618 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168798    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168801    2574 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168805    2574 flags.go:64] FLAG: --help="false"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168808    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168812    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168815    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168818    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168822    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168825    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168829    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168831    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168834    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168838    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168841    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168845    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168848    2574 flags.go:64] FLAG: --kube-reserved=""
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168852    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168855    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168858    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168861    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168864    2574 flags.go:64] FLAG: --lock-file=""
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168867    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168870    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168873    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 21:30:29.174391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168879    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168882    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168885    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168888    2574 flags.go:64] FLAG: --logging-format="text"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168890    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168894    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168897    2574 flags.go:64] FLAG: --manifest-url=""
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168904    2574 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168909    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168912    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168917    2574 flags.go:64] FLAG: --max-pods="110"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168920    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168923    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168927    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168930    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168933    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168936    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168939    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168947    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168950    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168953    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168956    2574 flags.go:64] FLAG: --pod-cidr=""
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168960    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 03 21:30:29.175045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168965    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168969    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168972    2574 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168975    2574 flags.go:64] FLAG: --port="10250"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168978    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168981    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c778002db5704c5b"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168985    2574 flags.go:64] FLAG: --qos-reserved=""
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168988    2574 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168991    2574 flags.go:64] FLAG: --register-node="true"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168994    2574 flags.go:64] FLAG: --register-with-taints=""
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.168998    2574 flags.go:64] FLAG: --registry-burst="10"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169001    2574 flags.go:64] FLAG: --registry-qps="5"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169004    2574 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169007    2574 flags.go:64] FLAG: --reserved-memory=""
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169011    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169015    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169019    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169022    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169025    2574 flags.go:64] FLAG: --runonce="false"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169028    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169031    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169034    2574 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169037    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169040    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169043    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169046    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 21:30:29.175697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169050    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169052    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169055    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169058    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169061    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169064    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169067    2574 flags.go:64] FLAG: --system-cgroups=""
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169070    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169076    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169080    2574 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169083    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169087    2574 flags.go:64] FLAG: --tls-min-version=""
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169090    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169093    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169096    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169099    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169102    2574 flags.go:64] FLAG: --v="2"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169106    2574 flags.go:64] FLAG: --version="false"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169110    2574 flags.go:64] FLAG: --vmodule=""
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169115    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.169119    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169248    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169256    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169259    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 21:30:29.176351 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169262    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169265    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169270    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169274    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169277    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169280    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169282    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169285    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169288    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169290    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169293    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169296    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169299    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169303    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169306    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169308    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169313    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169318    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169321    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 21:30:29.176987 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169325    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169328    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169330    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169333    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169336    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169339    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169342    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169345    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169349    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169352    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169355    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169359    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169362    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169365    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169368    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169371    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169374    2574 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169377    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169379    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169382    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169385    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 21:30:29.177485 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169388    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169390    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169393    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169396    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169399    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169401    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169404    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169407    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169426    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169430    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169434    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169437    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169440    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169442    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169445    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169448    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169451    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169454    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169456    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 21:30:29.178050 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169461    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169464    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169466    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169471    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169474    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169477    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169479    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169483    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169485    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169488    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169491    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169493    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169496    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169500    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169504    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169507    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169510    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169513    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169516    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169519    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 21:30:29.179235 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169522    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169525    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169527    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169530    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169533    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169536    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169538    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169541    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169544    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169547    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169549    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169552    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169556    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169559    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169562    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 21:30:29.179774 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.169566    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.170137    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.177032    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.177058    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.177082    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.177088    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177167    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177172    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177176    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177180    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177184    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177187    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177190    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177193    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 21:30:29.180160 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177196    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177199    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177201    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177204    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177207    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177210    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177213    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177216    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177218    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177221    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177223    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177226    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177229    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177231    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177234    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177236    2574 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177239    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177241    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177244    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177247    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 21:30:29.180573 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177250    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177255    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177258    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177261    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177263    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177266    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177269    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177272    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177275    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177277    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177280    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177282    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177285    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177288    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177290    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177293    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177295    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177298    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177300    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177303    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 21:30:29.181085 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177305    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177308    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177311    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177314    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177317    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177319    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177322    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177325    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177327    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177331    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177333    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177336    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177340    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177343    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177346    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177349    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177352    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177354    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177357    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 21:30:29.181674 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177360    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177362    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177367    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177371    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177374    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177377    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177380    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177383    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177386    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177388    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177391    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177393    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177396    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177398    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177402    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177404    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177407    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177422    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177425    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 21:30:29.182175 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177428    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177431    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177435    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177438    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177441    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177445    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177449    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177453    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177456    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177460    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177464    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177467    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.177473    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177595    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 21:30:29.182724 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177600    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177603    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177606    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177609    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177612    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177615    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177618    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177620    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177623    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177626    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177628    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177631    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177634    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177637    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177639    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177642    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177645    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177647    2574 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177650    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177653    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 21:30:29.183121 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177655    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177658    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177661    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177663    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177666    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177669    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177672    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177676    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177679    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177682    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177685    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177689    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177694    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177697    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177700    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177703    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177706    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177708    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177711    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 21:30:29.183763 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177714    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177716    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177719    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177721    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177724    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177726    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177729    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177731    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177734    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177737    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177739    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177741    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177744    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177748    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177752    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177754    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177757    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177760    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177762    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 21:30:29.184679 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177766    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177770    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177772    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177777    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177779    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177782    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177785    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177788    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177791    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177793    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177796    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177799    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177802    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177804    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177807    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177809    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177812    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177815    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177817    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177820    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 21:30:29.185211 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177822    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177825    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177828    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177830    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177833    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177835    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177838    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177841    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177844    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177846    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177850    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177852    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177855    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177858    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177860    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177863    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177867    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177870    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 21:30:29.185919 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:29.177872    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 21:30:29.186449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.177878    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 21:30:29.186449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.178027    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 21:30:29.186449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.180066    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 21:30:29.186449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.181405    2574 server.go:1019] "Starting client certificate rotation"
Jun 03 21:30:29.186449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.181528    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 21:30:29.186449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.181582    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 21:30:29.186449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.184020    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 21:30:29.187632 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.187615    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 21:30:29.197889 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.197863    2574 log.go:25] "Validated CRI v1 runtime API"
Jun 03 21:30:29.200820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.200801    2574 log.go:25] "Validated CRI v1 image API"
Jun 03 21:30:29.201646 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.201627    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 21:30:29.204255 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.204229    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a528becf-549a-4ad5-88e5-afa9ffe9418c:/dev/nvme0n1p4 ff2d4432-f7b5-4c2c-929c-c5a8630417de:/dev/nvme0n1p3]
Jun 03 21:30:29.204348 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.204252    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 21:30:29.209058 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.209028    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 21:30:29.211103 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.210983    2574 manager.go:216] Machine: {Timestamp:2026-06-03 21:30:29.209621575 +0000 UTC m=+0.341799439 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099523 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec203160184ebdec7257c6fa61d7b17a SystemUUID:ec203160-184e-bdec-7257-c6fa61d7b17a BootID:ede44d9c-f7fe-468e-aeee-600845576daa Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:e0:98:99:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:e0:98:99:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:28:2f:fe:1c:7e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 21:30:29.211103 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.211096    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 21:30:29.211261 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.211206    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 21:30:29.213630 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.213597    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 21:30:29.213776 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.213632    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 21:30:29.214406 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.214395    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 21:30:29.214465 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.214424    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jun 03 21:30:29.214465 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.214434    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 21:30:29.215264 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.215249    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 21:30:29.216027 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.216013    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 03 21:30:29.218713 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.218696    2574 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 21:30:29.218856 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.218846    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 03 21:30:29.218899 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.218878    2574 kubelet.go:486] "Attempting to sync node with API server"
Jun 03 21:30:29.218899 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.218889    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 21:30:29.218964 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.218901    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 21:30:29.218964 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.218913    2574 kubelet.go:398] "Adding apiserver pod source"
Jun 03 21:30:29.218964 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.218923    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 21:30:29.219319 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.219305    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 21:30:29.219390 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.219333    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 21:30:29.221846 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.221828    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 03 21:30:29.223144 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223129    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 21:30:29.223202 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223160    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 03 21:30:29.223734 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223722    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 21:30:29.223778 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223737    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 21:30:29.223778 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223744    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 21:30:29.223778 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223750    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 21:30:29.223778 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223759    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 21:30:29.223778 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223764    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 21:30:29.223778 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223773    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 21:30:29.223945 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223785    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 21:30:29.223945 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223792    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 21:30:29.223945 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223798    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 21:30:29.223945 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223810    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 21:30:29.223945 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.223818    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 21:30:29.224719 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.224708    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 21:30:29.224719 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.224719    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 21:30:29.228460 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.228438    2574 server.go:1268] "Started kubelet"
Jun 03 21:30:29.228566 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.228518    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 21:30:29.229004 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.228964    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 21:30:29.229004 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.228964    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 21:30:29.229172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.229038    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 21:30:29.229172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.229080    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 21:30:29.229172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.229132    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 03 21:30:29.229583 ip-10-0-140-77 systemd[1]: Started Kubernetes Kubelet.
Jun 03 21:30:29.230364 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.230344    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 21:30:29.230673 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.230613    2574 server.go:310] "Adding debug handlers to kubelet server"
Jun 03 21:30:29.233996 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.233000    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-77.ec2.internal.18b5af88abd83236  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-77.ec2.internal,UID:ip-10-0-140-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-77.ec2.internal,},FirstTimestamp:2026-06-03 21:30:29.228384822 +0000 UTC m=+0.360562677,LastTimestamp:2026-06-03 21:30:29.228384822 +0000 UTC m=+0.360562677,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-77.ec2.internal,}"
Jun 03 21:30:29.234836 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.234806    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 21:30:29.236033 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236014    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 21:30:29.236137 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236032    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 21:30:29.236137 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.236114    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.236624 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236603    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 03 21:30:29.236713 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236602    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 03 21:30:29.236713 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236645    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 03 21:30:29.236941 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236758    2574 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 21:30:29.236941 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236768    2574 reconciler.go:29] "Reconciler: start to sync state"
Jun 03 21:30:29.237038 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.236997    2574 factory.go:55] Registering systemd factory
Jun 03 21:30:29.237038 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.237012    2574 factory.go:223] Registration of the systemd container factory successfully
Jun 03 21:30:29.237407 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.237390    2574 factory.go:153] Registering CRI-O factory
Jun 03 21:30:29.237491 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.237428    2574 factory.go:223] Registration of the crio container factory successfully
Jun 03 21:30:29.237526 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.237504    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 21:30:29.237620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.237527    2574 factory.go:103] Registering Raw factory
Jun 03 21:30:29.237620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.237542    2574 manager.go:1196] Started watching for new ooms in manager
Jun 03 21:30:29.238065 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.237902    2574 manager.go:349] Starting recovery of all containers
Jun 03 21:30:29.245221 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.245182    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 21:30:29.245221 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.245195    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 21:30:29.248926 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.248898    2574 manager.go:354] Recovery completed
Jun 03 21:30:29.253600 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.253583    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:29.255616 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.255592    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:29.255708 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.255629    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:29.255708 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.255640    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:29.256196 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.256181    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 21:30:29.256196 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.256193    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 21:30:29.256295 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.256212    2574 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 21:30:29.256295 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.256222    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:29.257053 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.257038    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:29.257123 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.257066    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:29.257123 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.257077    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:29.257638 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.257625    2574 policy_none.go:49] "None policy: Start"
Jun 03 21:30:29.257673 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.257642    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 03 21:30:29.257673 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.257653    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 03 21:30:29.258673 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.258663    2574 policy_none.go:47] "Start"
Jun 03 21:30:29.265321 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.265227    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-77.ec2.internal.18b5af88ad77b124  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-77.ec2.internal,UID:ip-10-0-140-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-77.ec2.internal,},FirstTimestamp:2026-06-03 21:30:29.255614756 +0000 UTC m=+0.387792610,LastTimestamp:2026-06-03 21:30:29.255614756 +0000 UTC m=+0.387792610,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-77.ec2.internal,}"
Jun 03 21:30:29.267530 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.267463    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-77.ec2.internal.18b5af88ad77fc68  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-77.ec2.internal,UID:ip-10-0-140-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-77.ec2.internal,},FirstTimestamp:2026-06-03 21:30:29.255634024 +0000 UTC m=+0.387811878,LastTimestamp:2026-06-03 21:30:29.255634024 +0000 UTC m=+0.387811878,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-77.ec2.internal,}"
Jun 03 21:30:29.275117 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.275035    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-77.ec2.internal.18b5af88ad782283  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-77.ec2.internal,UID:ip-10-0-140-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-77.ec2.internal,},FirstTimestamp:2026-06-03 21:30:29.255643779 +0000 UTC m=+0.387821634,LastTimestamp:2026-06-03 21:30:29.255643779 +0000 UTC m=+0.387821634,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-77.ec2.internal,}"
Jun 03 21:30:29.285221 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.285146    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-77.ec2.internal.18b5af88ad77b124\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-77.ec2.internal.18b5af88ad77b124  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-77.ec2.internal,UID:ip-10-0-140-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-77.ec2.internal,},FirstTimestamp:2026-06-03 21:30:29.255614756 +0000 UTC m=+0.387792610,LastTimestamp:2026-06-03 21:30:29.257053437 +0000 UTC m=+0.389231290,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-77.ec2.internal,}"
Jun 03 21:30:29.287763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.287741    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dc6t9"
Jun 03 21:30:29.293240 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.293216    2574 manager.go:337] "Starting Device Plugin manager"
Jun 03 21:30:29.293388 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.293272    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 21:30:29.293388 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.293286    2574 server.go:87] "Starting device plugin registration server"
Jun 03 21:30:29.293623 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.293606    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 21:30:29.293818 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.293623    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 21:30:29.293818 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.293745    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 21:30:29.293917 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.293835    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 21:30:29.293917 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.293843    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 21:30:29.294681 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.294554    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 21:30:29.294681 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.294602    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.294838    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-77.ec2.internal.18b5af88ad77fc68\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-77.ec2.internal.18b5af88ad77fc68  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-77.ec2.internal,UID:ip-10-0-140-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-77.ec2.internal,},FirstTimestamp:2026-06-03 21:30:29.255634024 +0000 UTC m=+0.387811878,LastTimestamp:2026-06-03 21:30:29.257071562 +0000 UTC m=+0.389249416,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-77.ec2.internal,}"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.296374    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dc6t9"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.310789    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.312115    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.312153    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.312174    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.312208    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 21:30:29.316342 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.313730    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 21:30:29.394166 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.394134    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:29.395103 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.395084    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:29.395103 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.395115    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:29.395240 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.395126    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:29.395240 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.395153    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.403383 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.403362    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.403469 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.403392    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-77.ec2.internal\": node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.412534 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.412439    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal"]
Jun 03 21:30:29.412668 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.412545    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:29.415425 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.415387    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:29.415563 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.415442    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:29.415563 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.415454    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:29.416657 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.416644    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:29.416771 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.416755    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.416817 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.416788    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:29.417502 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.417482    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:29.417620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.417515    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:29.417620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.417529    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:29.417620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.417484    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:29.417620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.417587    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:29.417620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.417597    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:29.417869 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.417854    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.418878 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.418864    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.418915 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.418891    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:29.419625 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.419608    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:29.419748 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.419637    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:29.419748 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.419651    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:29.448430 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.448392    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-77.ec2.internal\" not found" node="ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.453268 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.453249    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-77.ec2.internal\" not found" node="ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.518019 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.517977    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.537683 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.537645    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4d1ad5559533687ca686434a0c4ede6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-77.ec2.internal\" (UID: \"d4d1ad5559533687ca686434a0c4ede6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.537683 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.537681    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d21059ae7ce928c107437710156b4ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal\" (UID: \"5d21059ae7ce928c107437710156b4ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.537877 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.537700    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d21059ae7ce928c107437710156b4ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal\" (UID: \"5d21059ae7ce928c107437710156b4ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.618753 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.618716    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.638024 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.637984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d21059ae7ce928c107437710156b4ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal\" (UID: \"5d21059ae7ce928c107437710156b4ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.638177 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.638027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d21059ae7ce928c107437710156b4ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal\" (UID: \"5d21059ae7ce928c107437710156b4ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.638177 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.638052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4d1ad5559533687ca686434a0c4ede6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-77.ec2.internal\" (UID: \"d4d1ad5559533687ca686434a0c4ede6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.638177 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.638099    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4d1ad5559533687ca686434a0c4ede6-config\") pod \"kube-apiserver-proxy-ip-10-0-140-77.ec2.internal\" (UID: \"d4d1ad5559533687ca686434a0c4ede6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.638177 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.638104    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d21059ae7ce928c107437710156b4ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal\" (UID: \"5d21059ae7ce928c107437710156b4ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.638177 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.638104    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d21059ae7ce928c107437710156b4ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal\" (UID: \"5d21059ae7ce928c107437710156b4ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.719338 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.719260    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.751917 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.751873    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.756810 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:29.756790    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:29.819998 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.819959    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:29.920573 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:29.920542    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.021148 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.021062    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.121689 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.121653    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.181199 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.181165    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 21:30:30.181818 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.181340    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 21:30:30.222741 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.222705    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.282278 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:30.282184    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d21059ae7ce928c107437710156b4ba.slice/crio-844cd65831de71952fc36349e825736350a626bfa7f03f5738f61dbbc68785ab WatchSource:0}: Error finding container 844cd65831de71952fc36349e825736350a626bfa7f03f5738f61dbbc68785ab: Status 404 returned error can't find the container with id 844cd65831de71952fc36349e825736350a626bfa7f03f5738f61dbbc68785ab
Jun 03 21:30:30.282439 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:30.282399    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d1ad5559533687ca686434a0c4ede6.slice/crio-2d29d654d64d67913235d95fb2be74d547a19180a940c608738da81ebc0f9594 WatchSource:0}: Error finding container 2d29d654d64d67913235d95fb2be74d547a19180a940c608738da81ebc0f9594: Status 404 returned error can't find the container with id 2d29d654d64d67913235d95fb2be74d547a19180a940c608738da81ebc0f9594
Jun 03 21:30:30.287336 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.287299    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 21:30:30.300124 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.300087    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 21:25:29 +0000 UTC" deadline="2027-12-07 14:02:43.52953719 +0000 UTC"
Jun 03 21:30:30.300124 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.300119    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13240h32m13.22942168s"
Jun 03 21:30:30.315489 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.315436    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal" event={"ID":"5d21059ae7ce928c107437710156b4ba","Type":"ContainerStarted","Data":"844cd65831de71952fc36349e825736350a626bfa7f03f5738f61dbbc68785ab"}
Jun 03 21:30:30.316398 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.316377    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal" event={"ID":"d4d1ad5559533687ca686434a0c4ede6","Type":"ContainerStarted","Data":"2d29d654d64d67913235d95fb2be74d547a19180a940c608738da81ebc0f9594"}
Jun 03 21:30:30.323561 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.323533    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.416084 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.416030    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 21:30:30.417068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.417040    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 21:30:30.417068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.417074    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 21:30:30.417210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.417086    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeHasSufficientPID"
Jun 03 21:30:30.424661 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.424640    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.468339 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.468306    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 21:30:30.525592 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.525548    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.584620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.584546    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 21:30:30.625679 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.625637    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.726478 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:30.726437    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-77.ec2.internal\" not found"
Jun 03 21:30:30.781202 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.781171    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 21:30:30.837078 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.836988    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:30.851457 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.851427    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 21:30:30.852656 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.852633    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal"
Jun 03 21:30:30.859487 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:30.859460    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 21:30:31.219744 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.219658    2574 apiserver.go:52] "Watching apiserver"
Jun 03 21:30:31.227991 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.227963    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 21:30:31.228376 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.228352    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-srd6t","openshift-ovn-kubernetes/ovnkube-node-vtbbn","kube-system/global-pull-secret-syncer-v4jr7","kube-system/konnectivity-agent-gkndg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn","openshift-multus/multus-44pnt","openshift-multus/multus-additional-cni-plugins-nb8lg","openshift-multus/network-metrics-daemon-xjfjq","openshift-network-operator/iptables-alerter-b98lw","kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ndqbr","openshift-dns/node-resolver-7ls5z","openshift-image-registry/node-ca-qzkc7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal"]
Jun 03 21:30:31.229952 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.229933    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.231205 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.231180    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.232987 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.232929    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.233087 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.232996    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 21:30:31.233145 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.233103    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:31.233265 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.233247    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 21:30:31.233265 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.233260    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 21:30:31.233399 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.233357    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 21:30:31.233506 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.233488    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 21:30:31.234022 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.234001    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s5vfg\""
Jun 03 21:30:31.234243 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.234225    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 21:30:31.234606 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.234585    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 21:30:31.235120 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.235097    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 21:30:31.235209 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.235159    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9lndw\""
Jun 03 21:30:31.236157 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.235816    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.237449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.237070    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 21:30:31.239448 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.238497    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.239448 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.238530    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 21:30:31.239448 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.238556    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hpx5r\""
Jun 03 21:30:31.239448 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.238502    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 21:30:31.239971 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.239879    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.240806 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.240717    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 21:30:31.240806 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.240742    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 21:30:31.240806 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.240804    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 21:30:31.241027 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.241017    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p7kdj\""
Jun 03 21:30:31.241347 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.241328    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.242221 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.242206    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 21:30:31.242872 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.242855    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sbv77\""
Jun 03 21:30:31.244118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.243741    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:31.244118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.243813    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 21:30:31.244118 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.243831    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:31.244118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.243915    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 21:30:31.244118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.243956    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zfvf2\""
Jun 03 21:30:31.244118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.244003    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 21:30:31.245309 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.245291    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.247208 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247171    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:31.247390 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.247296    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:31.247507 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-etc-selinux\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.247608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-sys-fs\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.247608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247562    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4k8kl\""
Jun 03 21:30:31.247608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247564    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-os-release\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.247608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.247825 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247652    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 21:30:31.247825 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3a6c923-856d-40f5-a0d0-674ebaf12949-host\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.247825 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3a6c923-856d-40f5-a0d0-674ebaf12949-serviceca\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.247825 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247766    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svb2k\" (UniqueName: \"kubernetes.io/projected/c3a6c923-856d-40f5-a0d0-674ebaf12949-kube-api-access-svb2k\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.247825 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e723e70c-2b23-470d-88b2-b47bb1d6ef6d-agent-certs\") pod \"konnectivity-agent-gkndg\" (UID: \"e723e70c-2b23-470d-88b2-b47bb1d6ef6d\") " pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-socket-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247862    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247917    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248022    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.247862    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqzxp\" (UniqueName: \"kubernetes.io/projected/f90167cc-edd6-4a0d-b56e-b97404113f80-kube-api-access-dqzxp\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248090    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248118    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e723e70c-2b23-470d-88b2-b47bb1d6ef6d-konnectivity-ca\") pod \"konnectivity-agent-gkndg\" (UID: \"e723e70c-2b23-470d-88b2-b47bb1d6ef6d\") " pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248172    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-system-cni-dir\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.248219 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248211    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cni-binary-copy\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-registration-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248314    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cnibin\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p476n\" (UniqueName: \"kubernetes.io/projected/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-kube-api-access-p476n\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3768a2b-b041-454c-8d77-0960f70fcecf-kubelet-config\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248402    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3768a2b-b041-454c-8d77-0960f70fcecf-dbus\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.248704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-device-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.249106 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248807    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 21:30:31.249106 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248841    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 21:30:31.249106 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.248990    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.249265 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.249160    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 21:30:31.250224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.250205    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.251360 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.251339    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 21:30:31.251571 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.251544    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2m8zp\""
Jun 03 21:30:31.251689 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.251653    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 21:30:31.252560 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.252541    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9h5w\""
Jun 03 21:30:31.252649 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.252610    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 21:30:31.252716 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.252615    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 21:30:31.271035 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.271008    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lknqm"
Jun 03 21:30:31.280578 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.280551    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lknqm"
Jun 03 21:30:31.338133 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.338098    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 03 21:30:31.349225 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349191    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scrff\" (UniqueName: \"kubernetes.io/projected/fda6aa3f-d98c-4b83-8959-201f42d98ca3-kube-api-access-scrff\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.349225 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349230    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.349476 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.349476 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-log-socket\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.349476 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovnkube-config\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.349638 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349476    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.349638 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-lib-modules\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.349638 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.349520    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:31.349638 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349529    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a88d3f4-f42c-4197-be27-3ae842050c7b-tmp-dir\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.349638 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349563    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9kgj\" (UniqueName: \"kubernetes.io/projected/3a88d3f4-f42c-4197-be27-3ae842050c7b-kube-api-access-f9kgj\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.349638 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.349604    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret podName:f3768a2b-b041-454c-8d77-0960f70fcecf nodeName:}" failed. No retries permitted until 2026-06-03 21:30:31.849579961 +0000 UTC m=+2.981757829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret") pod "global-pull-secret-syncer-v4jr7" (UID: "f3768a2b-b041-454c-8d77-0960f70fcecf") : object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:31.349638 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33927779-dfda-42bb-8552-7a5f05acd002-iptables-alerter-script\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-systemd\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-kubelet\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3768a2b-b041-454c-8d77-0960f70fcecf-kubelet-config\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqzxp\" (UniqueName: \"kubernetes.io/projected/f90167cc-edd6-4a0d-b56e-b97404113f80-kube-api-access-dqzxp\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-etc-kubernetes\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349749    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxjt\" (UniqueName: \"kubernetes.io/projected/33927779-dfda-42bb-8552-7a5f05acd002-kube-api-access-2qxjt\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3a6c923-856d-40f5-a0d0-674ebaf12949-host\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349788    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f3768a2b-b041-454c-8d77-0960f70fcecf-kubelet-config\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3a6c923-856d-40f5-a0d0-674ebaf12949-serviceca\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349820    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-systemd-units\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-slash\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysctl-d\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349893    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovn-node-metrics-cert\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-system-cni-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349956    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3a6c923-856d-40f5-a0d0-674ebaf12949-host\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.349982 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.349971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-os-release\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-cni-bin\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350086    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-system-cni-dir\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350122    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cni-binary-copy\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-ovn\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350167    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-system-cni-dir\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-cni-bin\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-run\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350285    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgrcv\" (UniqueName: \"kubernetes.io/projected/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-kube-api-access-lgrcv\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350309    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-netns\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cnibin\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-sys-fs\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350374    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c3a6c923-856d-40f5-a0d0-674ebaf12949-serviceca\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-node-log\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350396    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cnibin\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350448    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6d2h\" (UniqueName: \"kubernetes.io/projected/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-kube-api-access-p6d2h\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350480    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-sys-fs\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.350604 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-sys\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-socket-dir-parent\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-kubelet\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33927779-dfda-42bb-8552-7a5f05acd002-host-slash\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350624    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350636    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cni-binary-copy\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysctl-conf\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350597    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350676    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-tmp\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-cnibin\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysconfig\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p476n\" (UniqueName: \"kubernetes.io/projected/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-kube-api-access-p476n\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3768a2b-b041-454c-8d77-0960f70fcecf-dbus\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-run-netns\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.351608 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350961    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.350999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-daemon-config\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-os-release\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351081    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svb2k\" (UniqueName: \"kubernetes.io/projected/c3a6c923-856d-40f5-a0d0-674ebaf12949-kube-api-access-svb2k\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-socket-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-var-lib-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351132    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f3768a2b-b041-454c-8d77-0960f70fcecf-dbus\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fda6aa3f-d98c-4b83-8959-201f42d98ca3-cni-binary-copy\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-k8s-cni-cncf-io\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351202    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-os-release\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351204    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-conf-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351246    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-multus-certs\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351273    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e723e70c-2b23-470d-88b2-b47bb1d6ef6d-konnectivity-ca\") pod \"konnectivity-agent-gkndg\" (UID: \"e723e70c-2b23-470d-88b2-b47bb1d6ef6d\") " pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-kubernetes\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a88d3f4-f42c-4197-be27-3ae842050c7b-hosts-file\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-cni-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-registration-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.352352 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-env-overrides\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-device-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-etc-selinux\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-systemd\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-modprobe-d\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351546    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351571    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e723e70c-2b23-470d-88b2-b47bb1d6ef6d-agent-certs\") pod \"konnectivity-agent-gkndg\" (UID: \"e723e70c-2b23-470d-88b2-b47bb1d6ef6d\") " pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovnkube-script-lib\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351647    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mldr\" (UniqueName: \"kubernetes.io/projected/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-kube-api-access-5mldr\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-host\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-tuned\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-cni-multus\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351741    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-hostroot\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-etc-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351850    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e723e70c-2b23-470d-88b2-b47bb1d6ef6d-konnectivity-ca\") pod \"konnectivity-agent-gkndg\" (UID: \"e723e70c-2b23-470d-88b2-b47bb1d6ef6d\") " pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.353152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351862    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-cni-netd\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-var-lib-kubelet\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.351920    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-registration-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.352099    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.352197    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.352240    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-device-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.352300    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-etc-selinux\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.352454    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.353894 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.352466    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f90167cc-edd6-4a0d-b56e-b97404113f80-socket-dir\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.355681 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.355659    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e723e70c-2b23-470d-88b2-b47bb1d6ef6d-agent-certs\") pod \"konnectivity-agent-gkndg\" (UID: \"e723e70c-2b23-470d-88b2-b47bb1d6ef6d\") " pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.358919 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.358892    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqzxp\" (UniqueName: \"kubernetes.io/projected/f90167cc-edd6-4a0d-b56e-b97404113f80-kube-api-access-dqzxp\") pod \"aws-ebs-csi-driver-node-68rcn\" (UID: \"f90167cc-edd6-4a0d-b56e-b97404113f80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.359818 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.359787    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svb2k\" (UniqueName: \"kubernetes.io/projected/c3a6c923-856d-40f5-a0d0-674ebaf12949-kube-api-access-svb2k\") pod \"node-ca-qzkc7\" (UID: \"c3a6c923-856d-40f5-a0d0-674ebaf12949\") " pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.362727 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.362699    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p476n\" (UniqueName: \"kubernetes.io/projected/8ae31969-b86a-4ea1-9f71-6e15f2e3c69e-kube-api-access-p476n\") pod \"multus-additional-cni-plugins-nb8lg\" (UID: \"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e\") " pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.384957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.384927    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 21:30:31.452912 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.452871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovnkube-config\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.452912 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.452913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-lib-modules\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453134 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.452938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a88d3f4-f42c-4197-be27-3ae842050c7b-tmp-dir\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.453134 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.452971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9kgj\" (UniqueName: \"kubernetes.io/projected/3a88d3f4-f42c-4197-be27-3ae842050c7b-kube-api-access-f9kgj\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.453134 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33927779-dfda-42bb-8552-7a5f05acd002-iptables-alerter-script\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.453134 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453124    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-systemd\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-kubelet\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453178    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-etc-kubernetes\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxjt\" (UniqueName: \"kubernetes.io/projected/33927779-dfda-42bb-8552-7a5f05acd002-kube-api-access-2qxjt\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453229    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-systemd-units\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453249    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-slash\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysctl-d\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453094    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-lib-modules\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovn-node-metrics-cert\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-system-cni-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453366    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-os-release\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453366    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a88d3f4-f42c-4197-be27-3ae842050c7b-tmp-dir\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-cni-bin\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-ovn\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-cni-bin\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-run\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453528    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgrcv\" (UniqueName: \"kubernetes.io/projected/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-kube-api-access-lgrcv\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453549    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-system-cni-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-netns\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453591    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-node-log\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6d2h\" (UniqueName: \"kubernetes.io/projected/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-kube-api-access-p6d2h\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453635    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-os-release\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-sys\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453666    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/33927779-dfda-42bb-8552-7a5f05acd002-iptables-alerter-script\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453693    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovnkube-config\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453701    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-systemd\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453687    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-cni-bin\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.453800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453737    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-run\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453759    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-sys\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453740    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-netns\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453785    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-ovn\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453769    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-node-log\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453806    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-socket-dir-parent\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453818    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-slash\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453833    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-kubelet\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453847    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-cni-bin\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453855    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33927779-dfda-42bb-8552-7a5f05acd002-host-slash\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453865    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-systemd-units\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysctl-conf\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453921    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-socket-dir-parent\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-tmp\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453960    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453983    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-kubelet\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.454640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454001    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-kubelet\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.453989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454049    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.454085    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454100    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33927779-dfda-42bb-8552-7a5f05acd002-host-slash\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454088    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-etc-kubernetes\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.454142    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:31.95412379 +0000 UTC m=+3.086301631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-cnibin\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454148    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysctl-conf\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysconfig\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454200    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysctl-d\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-run-netns\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454225    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-cnibin\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454251    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-sysconfig\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-daemon-config\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454271    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-run-netns\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.455550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-var-lib-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454295    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-run-ovn-kubernetes\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fda6aa3f-d98c-4b83-8959-201f42d98ca3-cni-binary-copy\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454337    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-var-lib-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454343    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-k8s-cni-cncf-io\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454366    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-conf-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-multus-certs\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-kubernetes\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a88d3f4-f42c-4197-be27-3ae842050c7b-hosts-file\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454464    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-conf-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-cni-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454528    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-env-overrides\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454540    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-cni-dir\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-systemd\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454592    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-multus-certs\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-modprobe-d\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454633    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454643    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-kubernetes\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.456197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovnkube-script-lib\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mldr\" (UniqueName: \"kubernetes.io/projected/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-kube-api-access-5mldr\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454695    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a88d3f4-f42c-4197-be27-3ae842050c7b-hosts-file\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-host\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454729    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-tuned\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-cni-multus\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-hostroot\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454824    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-etc-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454844    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fda6aa3f-d98c-4b83-8959-201f42d98ca3-multus-daemon-config\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454875    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-cni-netd\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454901    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-run-systemd\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454935    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fda6aa3f-d98c-4b83-8959-201f42d98ca3-cni-binary-copy\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454953    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-run-k8s-cni-cncf-io\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.454959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-var-lib-kubelet\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455008    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-hostroot\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455051    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-modprobe-d\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455058    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-etc-openvswitch\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455069    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-env-overrides\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457043 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455120    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fda6aa3f-d98c-4b83-8959-201f42d98ca3-host-var-lib-cni-multus\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455176    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-var-lib-kubelet\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455234    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-host-cni-netd\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scrff\" (UniqueName: \"kubernetes.io/projected/fda6aa3f-d98c-4b83-8959-201f42d98ca3-kube-api-access-scrff\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-log-socket\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455556    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovnkube-script-lib\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455586    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-host\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.455607    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-log-socket\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.456786    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-tmp\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.456810    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-ovn-node-metrics-cert\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.457983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.457295    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-etc-tuned\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.466217 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.466032    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 21:30:31.466217 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.466068    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 21:30:31.466217 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.466083    2574 projected.go:196] Error preparing data for projected volume kube-api-access-47kv8 for pod openshift-network-diagnostics/network-check-target-srd6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:31.466217 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.466163    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8 podName:982714f8-8da7-4a3f-9f9b-d65b2c9a011d nodeName:}" failed. No retries permitted until 2026-06-03 21:30:31.966141387 +0000 UTC m=+3.098319246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-47kv8" (UniqueName: "kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8") pod "network-check-target-srd6t" (UID: "982714f8-8da7-4a3f-9f9b-d65b2c9a011d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:31.468652 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.468596    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scrff\" (UniqueName: \"kubernetes.io/projected/fda6aa3f-d98c-4b83-8959-201f42d98ca3-kube-api-access-scrff\") pod \"multus-44pnt\" (UID: \"fda6aa3f-d98c-4b83-8959-201f42d98ca3\") " pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.468781 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.468744    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mldr\" (UniqueName: \"kubernetes.io/projected/92408cb9-19d9-4f9c-b5a9-de7b535b7f81-kube-api-access-5mldr\") pod \"ovnkube-node-vtbbn\" (UID: \"92408cb9-19d9-4f9c-b5a9-de7b535b7f81\") " pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.469063 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.469038    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6d2h\" (UniqueName: \"kubernetes.io/projected/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-kube-api-access-p6d2h\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:31.469399 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.469366    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxjt\" (UniqueName: \"kubernetes.io/projected/33927779-dfda-42bb-8552-7a5f05acd002-kube-api-access-2qxjt\") pod \"iptables-alerter-b98lw\" (UID: \"33927779-dfda-42bb-8552-7a5f05acd002\") " pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.469522 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.469370    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgrcv\" (UniqueName: \"kubernetes.io/projected/51a74ef5-a09e-43f6-ae62-d9a7db866fd6-kube-api-access-lgrcv\") pod \"tuned-ndqbr\" (UID: \"51a74ef5-a09e-43f6-ae62-d9a7db866fd6\") " pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.469522 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.469490    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9kgj\" (UniqueName: \"kubernetes.io/projected/3a88d3f4-f42c-4197-be27-3ae842050c7b-kube-api-access-f9kgj\") pod \"node-resolver-7ls5z\" (UID: \"3a88d3f4-f42c-4197-be27-3ae842050c7b\") " pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.543712 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.543630    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nb8lg"
Jun 03 21:30:31.551632 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.551594    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzkc7"
Jun 03 21:30:31.560768 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.560733    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:31.566811 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.566778    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn"
Jun 03 21:30:31.573694 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.573652    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-44pnt"
Jun 03 21:30:31.582710 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.582670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b98lw"
Jun 03 21:30:31.590706 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.590670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:31.597653 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.597621    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ndqbr"
Jun 03 21:30:31.602708 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.602687    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7ls5z"
Jun 03 21:30:31.859559 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.859463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:31.859720 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.859586    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:31.859720 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.859658    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret podName:f3768a2b-b041-454c-8d77-0960f70fcecf nodeName:}" failed. No retries permitted until 2026-06-03 21:30:32.859641784 +0000 UTC m=+3.991819624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret") pod "global-pull-secret-syncer-v4jr7" (UID: "f3768a2b-b041-454c-8d77-0960f70fcecf") : object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:31.960184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:31.960148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:31.960387 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.960282    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:31.960387 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:31.960363    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:32.960344144 +0000 UTC m=+4.092522000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:32.060969 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.060934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:32.061150 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.061068    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 21:30:32.061150 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.061084    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 21:30:32.061150 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.061092    2574 projected.go:196] Error preparing data for projected volume kube-api-access-47kv8 for pod openshift-network-diagnostics/network-check-target-srd6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:32.061150 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.061139    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8 podName:982714f8-8da7-4a3f-9f9b-d65b2c9a011d nodeName:}" failed. No retries permitted until 2026-06-03 21:30:33.061127639 +0000 UTC m=+4.193305480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-47kv8" (UniqueName: "kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8") pod "network-check-target-srd6t" (UID: "982714f8-8da7-4a3f-9f9b-d65b2c9a011d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:32.091601 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.091262    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33927779_dfda_42bb_8552_7a5f05acd002.slice/crio-3bcf776dbde26831bf543d961782e93334a280cbe1b4fd85e34cc5678a61f9c6 WatchSource:0}: Error finding container 3bcf776dbde26831bf543d961782e93334a280cbe1b4fd85e34cc5678a61f9c6: Status 404 returned error can't find the container with id 3bcf776dbde26831bf543d961782e93334a280cbe1b4fd85e34cc5678a61f9c6
Jun 03 21:30:32.092564 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.092524    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda6aa3f_d98c_4b83_8959_201f42d98ca3.slice/crio-52b1eecc70682e35b17770ecbd39092b4b10fac31ad28be04454e380259e5f23 WatchSource:0}: Error finding container 52b1eecc70682e35b17770ecbd39092b4b10fac31ad28be04454e380259e5f23: Status 404 returned error can't find the container with id 52b1eecc70682e35b17770ecbd39092b4b10fac31ad28be04454e380259e5f23
Jun 03 21:30:32.097110 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.097087    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a74ef5_a09e_43f6_ae62_d9a7db866fd6.slice/crio-e258672025e0aa1604b6383b3e1103096e5d44eeccf4fc060244dccf00b2790b WatchSource:0}: Error finding container e258672025e0aa1604b6383b3e1103096e5d44eeccf4fc060244dccf00b2790b: Status 404 returned error can't find the container with id e258672025e0aa1604b6383b3e1103096e5d44eeccf4fc060244dccf00b2790b
Jun 03 21:30:32.099046 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.099011    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode723e70c_2b23_470d_88b2_b47bb1d6ef6d.slice/crio-7b1d06e985c7a21cf9833f1a19235b775de8302e7d6a1e34b4dff6aa8cc278be WatchSource:0}: Error finding container 7b1d06e985c7a21cf9833f1a19235b775de8302e7d6a1e34b4dff6aa8cc278be: Status 404 returned error can't find the container with id 7b1d06e985c7a21cf9833f1a19235b775de8302e7d6a1e34b4dff6aa8cc278be
Jun 03 21:30:32.099954 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.099913    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a88d3f4_f42c_4197_be27_3ae842050c7b.slice/crio-de6dc51d104a59a31eb2200177e8cf8b36661c26d9825eae4269f6a7b61ce4f8 WatchSource:0}: Error finding container de6dc51d104a59a31eb2200177e8cf8b36661c26d9825eae4269f6a7b61ce4f8: Status 404 returned error can't find the container with id de6dc51d104a59a31eb2200177e8cf8b36661c26d9825eae4269f6a7b61ce4f8
Jun 03 21:30:32.101790 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.101684    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae31969_b86a_4ea1_9f71_6e15f2e3c69e.slice/crio-c7a654c5627e58bb669779b0aa81589004dc9694dd5a859e20329446305e0560 WatchSource:0}: Error finding container c7a654c5627e58bb669779b0aa81589004dc9694dd5a859e20329446305e0560: Status 404 returned error can't find the container with id c7a654c5627e58bb669779b0aa81589004dc9694dd5a859e20329446305e0560
Jun 03 21:30:32.102167 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.102147    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90167cc_edd6_4a0d_b56e_b97404113f80.slice/crio-7ba53fb876b007cc0ebd9590d1ecb8ddaf8fec1f6aa76cd6bad0abd269cd6678 WatchSource:0}: Error finding container 7ba53fb876b007cc0ebd9590d1ecb8ddaf8fec1f6aa76cd6bad0abd269cd6678: Status 404 returned error can't find the container with id 7ba53fb876b007cc0ebd9590d1ecb8ddaf8fec1f6aa76cd6bad0abd269cd6678
Jun 03 21:30:32.103895 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.103852    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a6c923_856d_40f5_a0d0_674ebaf12949.slice/crio-0a5d7c02678bdd74f992c5531312b7dcbcae560393a7551bb91e96d7deae8d51 WatchSource:0}: Error finding container 0a5d7c02678bdd74f992c5531312b7dcbcae560393a7551bb91e96d7deae8d51: Status 404 returned error can't find the container with id 0a5d7c02678bdd74f992c5531312b7dcbcae560393a7551bb91e96d7deae8d51
Jun 03 21:30:32.107260 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:30:32.106972    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92408cb9_19d9_4f9c_b5a9_de7b535b7f81.slice/crio-5dea1902f5a4fd12ac586e8c04d628396ee329d8c6ea82292a84a85461c69a2c WatchSource:0}: Error finding container 5dea1902f5a4fd12ac586e8c04d628396ee329d8c6ea82292a84a85461c69a2c: Status 404 returned error can't find the container with id 5dea1902f5a4fd12ac586e8c04d628396ee329d8c6ea82292a84a85461c69a2c
Jun 03 21:30:32.283224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.283160    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:25:31 +0000 UTC" deadline="2028-01-08 21:49:14.943789795 +0000 UTC"
Jun 03 21:30:32.283224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.283218    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14016h18m42.66057632s"
Jun 03 21:30:32.312866 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.312773    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:32.313024 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.312913    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:32.322493 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.322452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal" event={"ID":"d4d1ad5559533687ca686434a0c4ede6","Type":"ContainerStarted","Data":"b858497eec71c427602cc699313a52b13936eca835ebfcbcdafdf2e9589210bb"}
Jun 03 21:30:32.323744 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.323701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzkc7" event={"ID":"c3a6c923-856d-40f5-a0d0-674ebaf12949","Type":"ContainerStarted","Data":"0a5d7c02678bdd74f992c5531312b7dcbcae560393a7551bb91e96d7deae8d51"}
Jun 03 21:30:32.324697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.324673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerStarted","Data":"c7a654c5627e58bb669779b0aa81589004dc9694dd5a859e20329446305e0560"}
Jun 03 21:30:32.325667 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.325641    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gkndg" event={"ID":"e723e70c-2b23-470d-88b2-b47bb1d6ef6d","Type":"ContainerStarted","Data":"7b1d06e985c7a21cf9833f1a19235b775de8302e7d6a1e34b4dff6aa8cc278be"}
Jun 03 21:30:32.326742 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.326720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"5dea1902f5a4fd12ac586e8c04d628396ee329d8c6ea82292a84a85461c69a2c"}
Jun 03 21:30:32.327718 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.327699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn" event={"ID":"f90167cc-edd6-4a0d-b56e-b97404113f80","Type":"ContainerStarted","Data":"7ba53fb876b007cc0ebd9590d1ecb8ddaf8fec1f6aa76cd6bad0abd269cd6678"}
Jun 03 21:30:32.328691 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.328673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7ls5z" event={"ID":"3a88d3f4-f42c-4197-be27-3ae842050c7b","Type":"ContainerStarted","Data":"de6dc51d104a59a31eb2200177e8cf8b36661c26d9825eae4269f6a7b61ce4f8"}
Jun 03 21:30:32.329565 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.329545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ndqbr" event={"ID":"51a74ef5-a09e-43f6-ae62-d9a7db866fd6","Type":"ContainerStarted","Data":"e258672025e0aa1604b6383b3e1103096e5d44eeccf4fc060244dccf00b2790b"}
Jun 03 21:30:32.331288 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.331232    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-44pnt" event={"ID":"fda6aa3f-d98c-4b83-8959-201f42d98ca3","Type":"ContainerStarted","Data":"52b1eecc70682e35b17770ecbd39092b4b10fac31ad28be04454e380259e5f23"}
Jun 03 21:30:32.333298 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.333277    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b98lw" event={"ID":"33927779-dfda-42bb-8552-7a5f05acd002","Type":"ContainerStarted","Data":"3bcf776dbde26831bf543d961782e93334a280cbe1b4fd85e34cc5678a61f9c6"}
Jun 03 21:30:32.337386 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.337318    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-77.ec2.internal" podStartSLOduration=2.337303041 podStartE2EDuration="2.337303041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:32.337128994 +0000 UTC m=+3.469306882" watchObservedRunningTime="2026-06-03 21:30:32.337303041 +0000 UTC m=+3.469480903"
Jun 03 21:30:32.867555 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.867510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:32.867747 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.867716    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:32.867820 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.867786    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret podName:f3768a2b-b041-454c-8d77-0960f70fcecf nodeName:}" failed. No retries permitted until 2026-06-03 21:30:34.867765968 +0000 UTC m=+5.999943812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret") pod "global-pull-secret-syncer-v4jr7" (UID: "f3768a2b-b041-454c-8d77-0960f70fcecf") : object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:32.969255 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:32.968638    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:32.969255 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.968801    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:32.969255 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:32.968868    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:34.968848073 +0000 UTC m=+6.101025951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:33.071162 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:33.070339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:33.071162 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:33.070555    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 21:30:33.071162 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:33.070593    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 21:30:33.071162 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:33.070608    2574 projected.go:196] Error preparing data for projected volume kube-api-access-47kv8 for pod openshift-network-diagnostics/network-check-target-srd6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:33.071162 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:33.070731    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8 podName:982714f8-8da7-4a3f-9f9b-d65b2c9a011d nodeName:}" failed. No retries permitted until 2026-06-03 21:30:35.070666778 +0000 UTC m=+6.202844624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-47kv8" (UniqueName: "kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8") pod "network-check-target-srd6t" (UID: "982714f8-8da7-4a3f-9f9b-d65b2c9a011d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:33.283780 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:33.283662    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 21:25:31 +0000 UTC" deadline="2027-11-25 10:10:26.842025895 +0000 UTC"
Jun 03 21:30:33.283780 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:33.283723    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12948h39m53.558307041s"
Jun 03 21:30:33.315678 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:33.315647    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:33.315880 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:33.315784    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:33.316195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:33.316171    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:33.316299 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:33.316280    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:33.355443 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:33.354625    2574 generic.go:356] "Generic (PLEG): container finished" podID="5d21059ae7ce928c107437710156b4ba" containerID="7da0a49c037f185879772e8e572584d7f8b9670b3ce449fe915cd04ba91bee87" exitCode=0
Jun 03 21:30:33.355794 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:33.355698    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal" event={"ID":"5d21059ae7ce928c107437710156b4ba","Type":"ContainerDied","Data":"7da0a49c037f185879772e8e572584d7f8b9670b3ce449fe915cd04ba91bee87"}
Jun 03 21:30:34.313343 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:34.313268    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:34.313855 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:34.313443    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:34.371996 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:34.371948    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal" event={"ID":"5d21059ae7ce928c107437710156b4ba","Type":"ContainerStarted","Data":"a9fd3846b6156a8b6dfd3f883f918fe1e1fa3495a5ce4290215df0a810ada083"}
Jun 03 21:30:34.388538 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:34.388475    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-77.ec2.internal" podStartSLOduration=4.388453352 podStartE2EDuration="4.388453352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:34.388234398 +0000 UTC m=+5.520412262" watchObservedRunningTime="2026-06-03 21:30:34.388453352 +0000 UTC m=+5.520631216"
Jun 03 21:30:34.888003 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:34.887927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:34.888191 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:34.888102    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:34.888191 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:34.888181    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret podName:f3768a2b-b041-454c-8d77-0960f70fcecf nodeName:}" failed. No retries permitted until 2026-06-03 21:30:38.888160036 +0000 UTC m=+10.020337881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret") pod "global-pull-secret-syncer-v4jr7" (UID: "f3768a2b-b041-454c-8d77-0960f70fcecf") : object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:34.989310 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:34.988694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:34.989310 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:34.988858    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:34.989310 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:34.988924    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:38.988906162 +0000 UTC m=+10.121084008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:35.089824 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:35.089775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:35.090037 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:35.090006    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 21:30:35.090037 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:35.090034    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 21:30:35.090157 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:35.090047    2574 projected.go:196] Error preparing data for projected volume kube-api-access-47kv8 for pod openshift-network-diagnostics/network-check-target-srd6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:35.090157 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:35.090109    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8 podName:982714f8-8da7-4a3f-9f9b-d65b2c9a011d nodeName:}" failed. No retries permitted until 2026-06-03 21:30:39.09009115 +0000 UTC m=+10.222268992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-47kv8" (UniqueName: "kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8") pod "network-check-target-srd6t" (UID: "982714f8-8da7-4a3f-9f9b-d65b2c9a011d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:35.313157 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:35.313072    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:35.313321 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:35.313229    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:35.313321 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:35.313282    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:35.313819 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:35.313431    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:36.312867 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:36.312667    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:36.312867 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:36.312816    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:37.316162 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:37.316132    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:37.316654 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:37.316178    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:37.316654 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:37.316260    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:37.316654 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:37.316354    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:38.312741 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:38.312668    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:38.312930 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:38.312824    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:38.919814 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:38.919754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:38.920296 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:38.919886    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:38.920296 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:38.919969    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret podName:f3768a2b-b041-454c-8d77-0960f70fcecf nodeName:}" failed. No retries permitted until 2026-06-03 21:30:46.919949376 +0000 UTC m=+18.052127221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret") pod "global-pull-secret-syncer-v4jr7" (UID: "f3768a2b-b041-454c-8d77-0960f70fcecf") : object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:39.020159 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:39.020117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:39.020358 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.020327    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:39.020451 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.020393    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:30:47.020374065 +0000 UTC m=+18.152551911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:39.121168 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:39.121120    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:39.121386 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.121333    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 21:30:39.121466 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.121398    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 21:30:39.121466 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.121431    2574 projected.go:196] Error preparing data for projected volume kube-api-access-47kv8 for pod openshift-network-diagnostics/network-check-target-srd6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:39.121565 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.121529    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8 podName:982714f8-8da7-4a3f-9f9b-d65b2c9a011d nodeName:}" failed. No retries permitted until 2026-06-03 21:30:47.121506422 +0000 UTC m=+18.253684276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-47kv8" (UniqueName: "kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8") pod "network-check-target-srd6t" (UID: "982714f8-8da7-4a3f-9f9b-d65b2c9a011d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:39.314163 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:39.314083    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:39.314311 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.314202    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:39.314640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:39.314611    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:39.314754 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:39.314731    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:40.313079 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:40.312992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:40.313543 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:40.313120    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:41.313540 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:41.313503    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:41.314037 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:41.313514    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:41.314037 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:41.313644    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:41.314037 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:41.313739    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:42.313344 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:42.313302    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:42.313537 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:42.313474    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:43.312991 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:43.312955    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:43.313385 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:43.312955    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:43.313385 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:43.313083    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:43.313385 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:43.313175    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:44.312497 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:44.312460    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:44.312719 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:44.312605    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:45.313385 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:45.313351    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:45.313385 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:45.313366    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:45.313918 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:45.313492    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:45.313918 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:45.313618    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:46.312958 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:46.312911    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:46.313155 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:46.313065    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:46.982569 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:46.982520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:46.982988 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:46.982705    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:46.982988 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:46.982785    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret podName:f3768a2b-b041-454c-8d77-0960f70fcecf nodeName:}" failed. No retries permitted until 2026-06-03 21:31:02.982764084 +0000 UTC m=+34.114941927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret") pod "global-pull-secret-syncer-v4jr7" (UID: "f3768a2b-b041-454c-8d77-0960f70fcecf") : object "kube-system"/"original-pull-secret" not registered
Jun 03 21:30:47.083642 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:47.083600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:47.083837 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.083738    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:47.083837 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.083806    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:31:03.083785605 +0000 UTC m=+34.215963463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:30:47.184348 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:47.184310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:47.184560 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.184486    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 21:30:47.184560 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.184509    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 21:30:47.184560 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.184518    2574 projected.go:196] Error preparing data for projected volume kube-api-access-47kv8 for pod openshift-network-diagnostics/network-check-target-srd6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:47.184721 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.184576    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8 podName:982714f8-8da7-4a3f-9f9b-d65b2c9a011d nodeName:}" failed. No retries permitted until 2026-06-03 21:31:03.184558167 +0000 UTC m=+34.316736030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-47kv8" (UniqueName: "kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8") pod "network-check-target-srd6t" (UID: "982714f8-8da7-4a3f-9f9b-d65b2c9a011d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:30:47.312516 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:47.312400    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:47.312516 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:47.312467    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:47.312731 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.312580    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:47.312789 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:47.312713    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:48.312741 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:48.312700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:48.313276 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:48.312841    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:49.313804 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:49.313721    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:49.314256 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:49.313837    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:49.314256 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:49.313894    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:49.314256 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:49.314027    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:50.313350 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.313163    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:50.313545 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:50.313485    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:50.406328 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.406292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn" event={"ID":"f90167cc-edd6-4a0d-b56e-b97404113f80","Type":"ContainerStarted","Data":"64d86c311d6b9f9da49d995941fbf7ececdc822c6744b4f6e1dc33af4b9c9f2b"}
Jun 03 21:30:50.408112 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.407977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7ls5z" event={"ID":"3a88d3f4-f42c-4197-be27-3ae842050c7b","Type":"ContainerStarted","Data":"c716835bab22a71b0ceb34cc240392341a17bca77d9a4a40030b31b0cfe872b6"}
Jun 03 21:30:50.410065 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.409878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ndqbr" event={"ID":"51a74ef5-a09e-43f6-ae62-d9a7db866fd6","Type":"ContainerStarted","Data":"1cf9d382bb26fc9d42d173802f112be7cac592fe94004686c94b40756e91d14e"}
Jun 03 21:30:50.411458 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.411432    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-44pnt" event={"ID":"fda6aa3f-d98c-4b83-8959-201f42d98ca3","Type":"ContainerStarted","Data":"1209b8c8668f48b8b186260cc3602e833fa26285eb978dfb5ef2f377c6876906"}
Jun 03 21:30:50.413283 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.413213    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzkc7" event={"ID":"c3a6c923-856d-40f5-a0d0-674ebaf12949","Type":"ContainerStarted","Data":"518e7015b70cc731273a142af3941466750f2f4f88f073a6cf9906cb395c71b0"}
Jun 03 21:30:50.414923 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.414899    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae31969-b86a-4ea1-9f71-6e15f2e3c69e" containerID="458f34cf28b565f8fa5b10642e40d897abb33465322613eca0c709379bc0121c" exitCode=0
Jun 03 21:30:50.415019 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.414981    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerDied","Data":"458f34cf28b565f8fa5b10642e40d897abb33465322613eca0c709379bc0121c"}
Jun 03 21:30:50.416541 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.416439    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gkndg" event={"ID":"e723e70c-2b23-470d-88b2-b47bb1d6ef6d","Type":"ContainerStarted","Data":"7165a493e7ba3eae1804727cf20745d990872d28e748aab14ebaecb2ad1b8a5a"}
Jun 03 21:30:50.418985 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.418968    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:30:50.419280 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.419263    2574 generic.go:356] "Generic (PLEG): container finished" podID="92408cb9-19d9-4f9c-b5a9-de7b535b7f81" containerID="bc73d61be4d9f4654f7915f8d1d3878cdd328abd332aaccb28931aef8577dee8" exitCode=1
Jun 03 21:30:50.419385 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.419292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"315d3b028f829ded00c33e81eecd65507222fd486906e20716732f548d9d4273"}
Jun 03 21:30:50.419385 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.419352    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"f2cbe436fc9aaade8d94b7950c4d5de10c52ca1395b05018b63c071425c1d9aa"}
Jun 03 21:30:50.419385 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.419385    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerDied","Data":"bc73d61be4d9f4654f7915f8d1d3878cdd328abd332aaccb28931aef8577dee8"}
Jun 03 21:30:50.419552 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.419452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"367fcd7581f72a45cdb91279696bcfbed9231cd63238544d46b9bc97f588b71d"}
Jun 03 21:30:50.424396 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.424344    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7ls5z" podStartSLOduration=3.745674894 podStartE2EDuration="21.424326093s" totalImagesPullingTime="17.678651199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:50.424050046 +0000 UTC m=+21.556227937" watchObservedRunningTime="2026-06-03 21:30:50.424326093 +0000 UTC m=+21.556503957"
Jun 03 21:30:50.462622 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.461518    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ndqbr" podStartSLOduration=3.7797788199999998 podStartE2EDuration="21.461498858s" totalImagesPullingTime="17.681720038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:50.460700811 +0000 UTC m=+21.592878673" watchObservedRunningTime="2026-06-03 21:30:50.461498858 +0000 UTC m=+21.593676721"
Jun 03 21:30:50.474904 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.474858    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qzkc7" podStartSLOduration=3.801298412 podStartE2EDuration="21.474841762s" totalImagesPullingTime="17.67354335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:50.47423229 +0000 UTC m=+21.606410173" watchObservedRunningTime="2026-06-03 21:30:50.474841762 +0000 UTC m=+21.607019625"
Jun 03 21:30:50.494453 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.494386    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gkndg" podStartSLOduration=8.102793831 podStartE2EDuration="21.494370621s" totalImagesPullingTime="13.39157679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:50.494197178 +0000 UTC m=+21.626375041" watchObservedRunningTime="2026-06-03 21:30:50.494370621 +0000 UTC m=+21.626548483"
Jun 03 21:30:50.512765 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:50.512710    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-44pnt" podStartSLOduration=3.760661681 podStartE2EDuration="21.512694113s" totalImagesPullingTime="17.752032432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:50.512531267 +0000 UTC m=+21.644709157" watchObservedRunningTime="2026-06-03 21:30:50.512694113 +0000 UTC m=+21.644871974"
Jun 03 21:30:51.241574 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.241543    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 21:30:51.305985 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.305873    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T21:30:51.241568608Z","UUID":"265fa72b-47cf-4120-ba70-e2234b2383ad","Handler":null,"Name":"","Endpoint":""}
Jun 03 21:30:51.307862 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.307821    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 21:30:51.307862 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.307870    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 21:30:51.312997 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.312970    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:51.313160 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.313051    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:51.313160 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:51.313088    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:51.313160 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:51.313152    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:51.424883 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.424648    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:30:51.425371 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.425235    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"4dc7e798143d656c8ebd1c8a613c3c298720841195cef244b11180adc89e13cd"}
Jun 03 21:30:51.425371 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.425310    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"545f9d71074633f10e1739c86d43d5cf4f966e4d010795373d75a91684d534a0"}
Jun 03 21:30:51.427607 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.427578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn" event={"ID":"f90167cc-edd6-4a0d-b56e-b97404113f80","Type":"ContainerStarted","Data":"9b17ae357cd6b96c31fdd09884e28e82f26e75001b31c760196f262cf925d038"}
Jun 03 21:30:51.429316 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.429209    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b98lw" event={"ID":"33927779-dfda-42bb-8552-7a5f05acd002","Type":"ContainerStarted","Data":"50d848bb4fafd354f4eccbaf9ebc98b16353131e353a703bbe6bc6e09c16ed3b"}
Jun 03 21:30:51.445149 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:51.445090    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b98lw" podStartSLOduration=4.823283141 podStartE2EDuration="22.445073665s" totalImagesPullingTime="17.621790524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:51.444728771 +0000 UTC m=+22.576906635" watchObservedRunningTime="2026-06-03 21:30:51.445073665 +0000 UTC m=+22.577251528"
Jun 03 21:30:52.312600 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:52.312560    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:52.312824 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:52.312701    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:52.434565 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:52.434522    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn" event={"ID":"f90167cc-edd6-4a0d-b56e-b97404113f80","Type":"ContainerStarted","Data":"b82d3e0483d686ecf58a48326e71884cb32c423d675108881bee43e3e027e3af"}
Jun 03 21:30:52.865945 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:52.865902    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:52.866516 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:52.866498    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:52.882746 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:52.882697    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68rcn" podStartSLOduration=4.147149929 podStartE2EDuration="23.882677203s" totalImagesPullingTime="19.735527274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:52.456523027 +0000 UTC m=+23.588700930" watchObservedRunningTime="2026-06-03 21:30:52.882677203 +0000 UTC m=+24.014855065"
Jun 03 21:30:53.313132 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:53.313096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:53.313329 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:53.313107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:53.313329 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:53.313264    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:53.313329 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:53.313279    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:53.440777 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:53.440742    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:30:53.441351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:53.441214    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"dfe829f6117f23b3b422c8033be47e9f602add3712d2d547d2af6d116deb6301"}
Jun 03 21:30:53.441559 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:53.441537    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:53.442076 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:53.442051    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gkndg"
Jun 03 21:30:54.313206 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:54.313115    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:54.313370 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:54.313241    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:55.312671 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:55.312384    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:55.313275 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:55.312469    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:55.313275 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:55.312702    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:55.313275 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:55.312794    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:55.447436 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:55.447388    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae31969-b86a-4ea1-9f71-6e15f2e3c69e" containerID="763f6a839c1da9456425388c651cd4b3a8ae732da260cd1afda4afd31983e2c4" exitCode=0
Jun 03 21:30:55.447621 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:55.447481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerDied","Data":"763f6a839c1da9456425388c651cd4b3a8ae732da260cd1afda4afd31983e2c4"}
Jun 03 21:30:55.451006 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:55.450988    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:30:55.451427 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:55.451383    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"09eb59e78145bfce1301a3ee936636095a8c0d668b77f43a77fe3eb59d39ef4b"}
Jun 03 21:30:55.451936 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:55.451919    2574 scope.go:117] "RemoveContainer" containerID="bc73d61be4d9f4654f7915f8d1d3878cdd328abd332aaccb28931aef8577dee8"
Jun 03 21:30:56.313141 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.313096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:56.313510 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:56.313221    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:56.456144 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.456052    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae31969-b86a-4ea1-9f71-6e15f2e3c69e" containerID="879e829f24c36d7d5ad3eb6558b8fbacb1b74d677d33b2bb3822792556c20fe3" exitCode=0
Jun 03 21:30:56.456144 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.456136    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerDied","Data":"879e829f24c36d7d5ad3eb6558b8fbacb1b74d677d33b2bb3822792556c20fe3"}
Jun 03 21:30:56.460381 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.460354    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:30:56.460942 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.460903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" event={"ID":"92408cb9-19d9-4f9c-b5a9-de7b535b7f81","Type":"ContainerStarted","Data":"55361c5769a414d479bd58d4a7ae66e18d4b5d01489d6909282db1d7df519061"}
Jun 03 21:30:56.461178 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.461145    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:56.461288 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.461234    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:56.461288 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.461284    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:56.478004 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.477972    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:56.478492 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.478467    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:30:56.504855 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.504785    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn" podStartSLOduration=9.744810072 podStartE2EDuration="27.504769268s" totalImagesPullingTime="17.759959196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:30:56.504064823 +0000 UTC m=+27.636242686" watchObservedRunningTime="2026-06-03 21:30:56.504769268 +0000 UTC m=+27.636947130"
Jun 03 21:30:56.797869 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.797566    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srd6t"]
Jun 03 21:30:56.798070 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.797944    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:56.798070 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:56.798040    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:56.798191 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.798170    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4jr7"]
Jun 03 21:30:56.798268 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.798258    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:56.798344 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:56.798327    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:30:56.799962 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.799940    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xjfjq"]
Jun 03 21:30:56.800045 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:56.800020    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:56.800107 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:56.800092    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:57.465959 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:57.465868    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae31969-b86a-4ea1-9f71-6e15f2e3c69e" containerID="eb6cfbda8b4074eaf66c03bbfeafe71856d050f6a23db85643b38d2cf9246d4f" exitCode=0
Jun 03 21:30:57.466483 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:57.465952    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerDied","Data":"eb6cfbda8b4074eaf66c03bbfeafe71856d050f6a23db85643b38d2cf9246d4f"}
Jun 03 21:30:58.312788 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:58.312755    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:30:58.312978 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:58.312758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:30:58.312978 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:58.312873    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:30:58.313075 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:58.312985    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:30:58.313075 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:30:58.312755    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:30:58.313170 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:30:58.313078    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:31:00.313481 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:00.313444    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:31:00.313481 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:00.313478    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:31:00.314213 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:00.313444    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:00.314213 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:00.313573    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:31:00.314213 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:00.313670    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:31:00.314213 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:00.313769    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:31:02.312576 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.312364    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:31:02.313008 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.312365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:31:02.313008 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:02.312689    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:31:02.313008 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.312365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:02.313008 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:02.312736    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4jr7" podUID="f3768a2b-b041-454c-8d77-0960f70fcecf"
Jun 03 21:31:02.313008 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:02.312824    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srd6t" podUID="982714f8-8da7-4a3f-9f9b-d65b2c9a011d"
Jun 03 21:31:02.481277 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.481182    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae31969-b86a-4ea1-9f71-6e15f2e3c69e" containerID="25ff3118130a36b3039ba61c82aac818a3ed5c73c90e26d7b195a936483d40c8" exitCode=0
Jun 03 21:31:02.481277 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.481250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerDied","Data":"25ff3118130a36b3039ba61c82aac818a3ed5c73c90e26d7b195a936483d40c8"}
Jun 03 21:31:02.705052 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.705026    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-77.ec2.internal" event="NodeReady"
Jun 03 21:31:02.705210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.705143    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 03 21:31:02.756179 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.756103    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zsrlp"]
Jun 03 21:31:02.769936 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.769897    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pkczs"]
Jun 03 21:31:02.770098 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.770021    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:02.775653 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.775625    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 21:31:02.775827 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.775652    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 21:31:02.776229 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.776204    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x7hbm\""
Jun 03 21:31:02.785613 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.785587    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zsrlp"]
Jun 03 21:31:02.785760 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.785624    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pkczs"]
Jun 03 21:31:02.785760 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.785700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:02.788490 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.788463    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 21:31:02.788629 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.788469    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 21:31:02.788629 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.788527    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 21:31:02.788746 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.788651    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-97rvb\""
Jun 03 21:31:02.902468 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.902426    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab289959-f3e9-4378-8150-1aee4cfab20a-cert\") pod \"ingress-canary-pkczs\" (UID: \"ab289959-f3e9-4378-8150-1aee4cfab20a\") " pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:02.902468 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.902472    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rhtk\" (UniqueName: \"kubernetes.io/projected/ab289959-f3e9-4378-8150-1aee4cfab20a-kube-api-access-8rhtk\") pod \"ingress-canary-pkczs\" (UID: \"ab289959-f3e9-4378-8150-1aee4cfab20a\") " pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:02.902693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.902498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52vx\" (UniqueName: \"kubernetes.io/projected/6b99cda7-8109-4787-920b-b524c81814db-kube-api-access-p52vx\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:02.902693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.902545    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b99cda7-8109-4787-920b-b524c81814db-tmp-dir\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:02.902693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.902590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:02.902693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:02.902653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b99cda7-8109-4787-920b-b524c81814db-config-volume\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.003761 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.003725    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b99cda7-8109-4787-920b-b524c81814db-tmp-dir\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.003895 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.003771    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.003966 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.003943    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:31:03.004022 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.004011    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:31:03.503995182 +0000 UTC m=+34.636173022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:31:03.004022 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.004018    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 21:31:03.004106 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.004058    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret podName:f3768a2b-b041-454c-8d77-0960f70fcecf nodeName:}" failed. No retries permitted until 2026-06-03 21:31:35.004047742 +0000 UTC m=+66.136225583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret") pod "global-pull-secret-syncer-v4jr7" (UID: "f3768a2b-b041-454c-8d77-0960f70fcecf") : object "kube-system"/"original-pull-secret" not registered
Jun 03 21:31:03.004106 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.003951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:31:03.004106 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.004068    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b99cda7-8109-4787-920b-b524c81814db-tmp-dir\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.004222 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.004106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b99cda7-8109-4787-920b-b524c81814db-config-volume\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.004222 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.004141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab289959-f3e9-4378-8150-1aee4cfab20a-cert\") pod \"ingress-canary-pkczs\" (UID: \"ab289959-f3e9-4378-8150-1aee4cfab20a\") " pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:03.004222 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.004159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rhtk\" (UniqueName: \"kubernetes.io/projected/ab289959-f3e9-4378-8150-1aee4cfab20a-kube-api-access-8rhtk\") pod \"ingress-canary-pkczs\" (UID: \"ab289959-f3e9-4378-8150-1aee4cfab20a\") " pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:03.004222 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.004179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52vx\" (UniqueName: \"kubernetes.io/projected/6b99cda7-8109-4787-920b-b524c81814db-kube-api-access-p52vx\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.004663 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.004643    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6b99cda7-8109-4787-920b-b524c81814db-config-volume\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.008375 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.008312    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab289959-f3e9-4378-8150-1aee4cfab20a-cert\") pod \"ingress-canary-pkczs\" (UID: \"ab289959-f3e9-4378-8150-1aee4cfab20a\") " pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:03.013542 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.013515    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52vx\" (UniqueName: \"kubernetes.io/projected/6b99cda7-8109-4787-920b-b524c81814db-kube-api-access-p52vx\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.013667 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.013570    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rhtk\" (UniqueName: \"kubernetes.io/projected/ab289959-f3e9-4378-8150-1aee4cfab20a-kube-api-access-8rhtk\") pod \"ingress-canary-pkczs\" (UID: \"ab289959-f3e9-4378-8150-1aee4cfab20a\") " pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:03.094807 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.094764    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pkczs"
Jun 03 21:31:03.105131 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.105090    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:31:03.105281 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.105245    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:31:03.105332 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.105307    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:31:35.105293795 +0000 UTC m=+66.237471641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 21:31:03.206461 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.206397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:03.206669 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.206637    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 21:31:03.206669 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.206663    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 21:31:03.207032 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.206677    2574 projected.go:196] Error preparing data for projected volume kube-api-access-47kv8 for pod openshift-network-diagnostics/network-check-target-srd6t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:31:03.207032 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.206737    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8 podName:982714f8-8da7-4a3f-9f9b-d65b2c9a011d nodeName:}" failed. No retries permitted until 2026-06-03 21:31:35.206720035 +0000 UTC m=+66.338897893 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-47kv8" (UniqueName: "kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8") pod "network-check-target-srd6t" (UID: "982714f8-8da7-4a3f-9f9b-d65b2c9a011d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 21:31:03.269726 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.269648    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pkczs"]
Jun 03 21:31:03.272851 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:31:03.272816    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab289959_f3e9_4378_8150_1aee4cfab20a.slice/crio-378e753d58b7c40c437c3081900993a9b9fe2c0277860913183854d9686677ce WatchSource:0}: Error finding container 378e753d58b7c40c437c3081900993a9b9fe2c0277860913183854d9686677ce: Status 404 returned error can't find the container with id 378e753d58b7c40c437c3081900993a9b9fe2c0277860913183854d9686677ce
Jun 03 21:31:03.487119 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.487083    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae31969-b86a-4ea1-9f71-6e15f2e3c69e" containerID="494cf1905777b7011989bac48aa98c51e46c776e6951e5735ae784d94c5f90bc" exitCode=0
Jun 03 21:31:03.487610 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.487162    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerDied","Data":"494cf1905777b7011989bac48aa98c51e46c776e6951e5735ae784d94c5f90bc"}
Jun 03 21:31:03.488276 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.488252    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pkczs" event={"ID":"ab289959-f3e9-4378-8150-1aee4cfab20a","Type":"ContainerStarted","Data":"378e753d58b7c40c437c3081900993a9b9fe2c0277860913183854d9686677ce"}
Jun 03 21:31:03.508456 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:03.508398    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:03.508609 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.508570    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:31:03.508734 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:03.508644    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:31:04.50862316 +0000 UTC m=+35.640801018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:31:04.313266 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.313226    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:04.313266 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.313272    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:31:04.313707 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.313370    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:31:04.316377 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.316355    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 21:31:04.317760 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.317517    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 21:31:04.317760 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.317567    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 21:31:04.317760 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.317594    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfkft\""
Jun 03 21:31:04.317957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.317818    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvgnm\""
Jun 03 21:31:04.318009 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.317972    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 21:31:04.494213 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.494179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" event={"ID":"8ae31969-b86a-4ea1-9f71-6e15f2e3c69e","Type":"ContainerStarted","Data":"1faa5f67f27d66ff5108fca42451ce2afe37fc167d7c63bde199858188ebcae5"}
Jun 03 21:31:04.515297 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.515263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:04.515480 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:04.515388    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:31:04.515480 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:04.515461    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:31:06.515447619 +0000 UTC m=+37.647625461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:31:04.517098 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:04.517057    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nb8lg" podStartSLOduration=7.7489931819999995 podStartE2EDuration="35.517041654s" totalImagesPullingTime="27.768048472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:04.515531129 +0000 UTC m=+35.647709012" watchObservedRunningTime="2026-06-03 21:31:04.517041654 +0000 UTC m=+35.649219516"
Jun 03 21:31:06.500044 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:06.500001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pkczs" event={"ID":"ab289959-f3e9-4378-8150-1aee4cfab20a","Type":"ContainerStarted","Data":"99df3f1e51d973e46ab9c879a766e823440fe734d17e268894e8c8f3754f4326"}
Jun 03 21:31:06.518058 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:06.518006    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pkczs" podStartSLOduration=2.290985301 podStartE2EDuration="4.517990884s" totalImagesPullingTime="2.227005583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:06.51695545 +0000 UTC m=+37.649133318" watchObservedRunningTime="2026-06-03 21:31:06.517990884 +0000 UTC m=+37.650168766"
Jun 03 21:31:06.530991 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:06.530853    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:06.530991 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:06.530975    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:31:06.531236 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:06.531051    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:31:10.531028298 +0000 UTC m=+41.663206141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:31:10.558237 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:10.558193    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:10.558776 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:10.558345    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:31:10.558776 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:10.558408    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:31:18.558392734 +0000 UTC m=+49.690570579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:31:18.611359 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:18.611309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:18.611841 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:18.611453    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:31:18.611841 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:18.611508    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:31:34.611493788 +0000 UTC m=+65.743671629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:31:28.479562 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:28.479526    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vtbbn"
Jun 03 21:31:34.630085 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:34.630039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:31:34.630822 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:34.630235    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:31:34.630822 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:34.630325    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:32:06.630303826 +0000 UTC m=+97.762481667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:31:35.032836 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.032799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:31:35.036041 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.036016    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 21:31:35.046482 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.046450    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f3768a2b-b041-454c-8d77-0960f70fcecf-original-pull-secret\") pod \"global-pull-secret-syncer-v4jr7\" (UID: \"f3768a2b-b041-454c-8d77-0960f70fcecf\") " pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:31:35.133690 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.133651    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:31:35.136691 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.136669    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 21:31:35.144011 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:35.143983    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 21:31:35.144109 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:31:35.144059    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:32:39.144040433 +0000 UTC m=+130.276218279 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : secret "metrics-daemon-secret" not found
Jun 03 21:31:35.234013 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.233974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:35.234172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.234033    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4jr7"
Jun 03 21:31:35.236791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.236770    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 21:31:35.246994 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.246969    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 21:31:35.258240 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.258209    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47kv8\" (UniqueName: \"kubernetes.io/projected/982714f8-8da7-4a3f-9f9b-d65b2c9a011d-kube-api-access-47kv8\") pod \"network-check-target-srd6t\" (UID: \"982714f8-8da7-4a3f-9f9b-d65b2c9a011d\") " pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:35.375042 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.374869    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4jr7"]
Jun 03 21:31:35.377814 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:31:35.377781    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3768a2b_b041_454c_8d77_0960f70fcecf.slice/crio-af6971f9cde2fb069554e6897726dd4114a8322194fc52b04cdb82089e9fc86e WatchSource:0}: Error finding container af6971f9cde2fb069554e6897726dd4114a8322194fc52b04cdb82089e9fc86e: Status 404 returned error can't find the container with id af6971f9cde2fb069554e6897726dd4114a8322194fc52b04cdb82089e9fc86e
Jun 03 21:31:35.531210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.531176    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfkft\""
Jun 03 21:31:35.539040 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.539008    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:35.567009 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.566973    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4jr7" event={"ID":"f3768a2b-b041-454c-8d77-0960f70fcecf","Type":"ContainerStarted","Data":"af6971f9cde2fb069554e6897726dd4114a8322194fc52b04cdb82089e9fc86e"}
Jun 03 21:31:35.666767 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:35.666734    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srd6t"]
Jun 03 21:31:35.669761 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:31:35.669724    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982714f8_8da7_4a3f_9f9b_d65b2c9a011d.slice/crio-37a964a788b81e819c9ff3987baaf7d13ca0c49eb967b79867268f8878c0f52e WatchSource:0}: Error finding container 37a964a788b81e819c9ff3987baaf7d13ca0c49eb967b79867268f8878c0f52e: Status 404 returned error can't find the container with id 37a964a788b81e819c9ff3987baaf7d13ca0c49eb967b79867268f8878c0f52e
Jun 03 21:31:36.571948 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:36.571870    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srd6t" event={"ID":"982714f8-8da7-4a3f-9f9b-d65b2c9a011d","Type":"ContainerStarted","Data":"37a964a788b81e819c9ff3987baaf7d13ca0c49eb967b79867268f8878c0f52e"}
Jun 03 21:31:37.768369 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.768329    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"]
Jun 03 21:31:37.772332 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.771452    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:37.774877 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.774843    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 03 21:31:37.774877 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.774865    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 03 21:31:37.775134 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.774889    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 03 21:31:37.776224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.775987    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 03 21:31:37.776224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.776116    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lz72d\""
Jun 03 21:31:37.781876 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.781846    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"]
Jun 03 21:31:37.955689 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.955646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3ef61bb-c8c3-4406-9684-bd3ed5971fd0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b4c7458cb-p94zs\" (UID: \"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:37.955886 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:37.955700    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsxdl\" (UniqueName: \"kubernetes.io/projected/d3ef61bb-c8c3-4406-9684-bd3ed5971fd0-kube-api-access-wsxdl\") pod \"managed-serviceaccount-addon-agent-b4c7458cb-p94zs\" (UID: \"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:38.056693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.056603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3ef61bb-c8c3-4406-9684-bd3ed5971fd0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b4c7458cb-p94zs\" (UID: \"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:38.056693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.056641    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsxdl\" (UniqueName: \"kubernetes.io/projected/d3ef61bb-c8c3-4406-9684-bd3ed5971fd0-kube-api-access-wsxdl\") pod \"managed-serviceaccount-addon-agent-b4c7458cb-p94zs\" (UID: \"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:38.060474 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.060392    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3ef61bb-c8c3-4406-9684-bd3ed5971fd0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b4c7458cb-p94zs\" (UID: \"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:38.067015 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.066977    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsxdl\" (UniqueName: \"kubernetes.io/projected/d3ef61bb-c8c3-4406-9684-bd3ed5971fd0-kube-api-access-wsxdl\") pod \"managed-serviceaccount-addon-agent-b4c7458cb-p94zs\" (UID: \"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:38.094761 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.094722    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"
Jun 03 21:31:38.393236 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.393200    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"]
Jun 03 21:31:38.395235 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.395208    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.397960 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.397932    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 03 21:31:38.407122 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.407088    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"]
Jun 03 21:31:38.560704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.560667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cd7358cf-229f-422a-9e6f-6b52603b1fee-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.560704 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.560707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gswjp\" (UniqueName: \"kubernetes.io/projected/cd7358cf-229f-422a-9e6f-6b52603b1fee-kube-api-access-gswjp\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.560944 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.560737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd7358cf-229f-422a-9e6f-6b52603b1fee-tmp\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.662116 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.662027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cd7358cf-229f-422a-9e6f-6b52603b1fee-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.662116 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.662075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gswjp\" (UniqueName: \"kubernetes.io/projected/cd7358cf-229f-422a-9e6f-6b52603b1fee-kube-api-access-gswjp\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.662116 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.662098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd7358cf-229f-422a-9e6f-6b52603b1fee-tmp\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.662581 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.662550    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd7358cf-229f-422a-9e6f-6b52603b1fee-tmp\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.665190 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.665167    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cd7358cf-229f-422a-9e6f-6b52603b1fee-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.670874 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.670842    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gswjp\" (UniqueName: \"kubernetes.io/projected/cd7358cf-229f-422a-9e6f-6b52603b1fee-kube-api-access-gswjp\") pod \"klusterlet-addon-workmgr-7c567dcc96-gx66f\" (UID: \"cd7358cf-229f-422a-9e6f-6b52603b1fee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:38.706726 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:38.706684    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:40.324373 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.324328    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs"]
Jun 03 21:31:40.327327 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:31:40.327275    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3ef61bb_c8c3_4406_9684_bd3ed5971fd0.slice/crio-8ea988adaa8d4c282ad67c6a85449c65bbb2fb725582b52514611695630cbe55 WatchSource:0}: Error finding container 8ea988adaa8d4c282ad67c6a85449c65bbb2fb725582b52514611695630cbe55: Status 404 returned error can't find the container with id 8ea988adaa8d4c282ad67c6a85449c65bbb2fb725582b52514611695630cbe55
Jun 03 21:31:40.339283 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.339250    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"]
Jun 03 21:31:40.343158 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:31:40.343132    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7358cf_229f_422a_9e6f_6b52603b1fee.slice/crio-677dee0093f2521db6e928b55e4dbb180dd86cacc57ffbb346e9f9a70d192ab9 WatchSource:0}: Error finding container 677dee0093f2521db6e928b55e4dbb180dd86cacc57ffbb346e9f9a70d192ab9: Status 404 returned error can't find the container with id 677dee0093f2521db6e928b55e4dbb180dd86cacc57ffbb346e9f9a70d192ab9
Jun 03 21:31:40.584077 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.583972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs" event={"ID":"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0","Type":"ContainerStarted","Data":"8ea988adaa8d4c282ad67c6a85449c65bbb2fb725582b52514611695630cbe55"}
Jun 03 21:31:40.585388 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.585354    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srd6t" event={"ID":"982714f8-8da7-4a3f-9f9b-d65b2c9a011d","Type":"ContainerStarted","Data":"eb1c91bd1c181c8d490c00b0b1482d3bca9269689a09cc06d1e16be4c6eb6b87"}
Jun 03 21:31:40.585568 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.585468    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:31:40.586798 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.586777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4jr7" event={"ID":"f3768a2b-b041-454c-8d77-0960f70fcecf","Type":"ContainerStarted","Data":"253b502608ea0d5db014d1d84de8ba03a1a52514d34c4fe26b0805a044783eef"}
Jun 03 21:31:40.587902 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.587882    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f" event={"ID":"cd7358cf-229f-422a-9e6f-6b52603b1fee","Type":"ContainerStarted","Data":"677dee0093f2521db6e928b55e4dbb180dd86cacc57ffbb346e9f9a70d192ab9"}
Jun 03 21:31:40.605931 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:40.603257    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-srd6t" podStartSLOduration=67.087138168 podStartE2EDuration="1m11.603236826s" totalImagesPullingTime="4.516098658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:40.60256205 +0000 UTC m=+71.734739912" watchObservedRunningTime="2026-06-03 21:31:40.603236826 +0000 UTC m=+71.735414689"
Jun 03 21:31:45.606326 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:45.606237    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs" event={"ID":"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0","Type":"ContainerStarted","Data":"4515f9187d8863ffd81c5796824c2b6e1f1ea8933bfb92774742b5bef6ad7c3a"}
Jun 03 21:31:45.607864 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:45.607829    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f" event={"ID":"cd7358cf-229f-422a-9e6f-6b52603b1fee","Type":"ContainerStarted","Data":"6f27f49f62529cf35d7ba0f80f549426eb96459799894e12f8d2cffb1678eeda"}
Jun 03 21:31:45.608009 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:45.607994    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:45.609659 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:45.609637    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:31:45.623119 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:45.623070    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs" podStartSLOduration=3.578072259 podStartE2EDuration="8.623055455s" totalImagesPullingTime="5.044983196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:45.622903046 +0000 UTC m=+76.755080910" watchObservedRunningTime="2026-06-03 21:31:45.623055455 +0000 UTC m=+76.755233361"
Jun 03 21:31:45.623456 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:45.623400    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v4jr7" podStartSLOduration=71.817161377 podStartE2EDuration="1m16.623392913s" totalImagesPullingTime="4.806231536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:40.618265101 +0000 UTC m=+71.750442965" watchObservedRunningTime="2026-06-03 21:31:45.623392913 +0000 UTC m=+76.755570777"
Jun 03 21:31:45.641185 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:31:45.641128    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f" podStartSLOduration=2.595824295 podStartE2EDuration="7.641108297s" totalImagesPullingTime="5.045284002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:31:45.640961419 +0000 UTC m=+76.773139282" watchObservedRunningTime="2026-06-03 21:31:45.641108297 +0000 UTC m=+76.773286157"
Jun 03 21:32:06.661465 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:32:06.661427    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:32:06.661846 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:32:06.661511    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:32:06.661846 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:32:06.661592    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:33:10.661575791 +0000 UTC m=+161.793753633 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:32:11.595182 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:32:11.595145    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-srd6t"
Jun 03 21:32:39.179745 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:32:39.179701    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:32:39.180236 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:32:39.179865    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 21:32:39.180236 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:32:39.179941    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs podName:cf5f89fc-4c76-42fb-9c67-2c541ff27e55 nodeName:}" failed. No retries permitted until 2026-06-03 21:34:41.179925035 +0000 UTC m=+252.312102875 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs") pod "network-metrics-daemon-xjfjq" (UID: "cf5f89fc-4c76-42fb-9c67-2c541ff27e55") : secret "metrics-daemon-secret" not found
Jun 03 21:33:05.784307 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:05.784245    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zsrlp" podUID="6b99cda7-8109-4787-920b-b524c81814db"
Jun 03 21:33:05.828706 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:05.828674    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:33:07.340243 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:07.340192    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xjfjq" podUID="cf5f89fc-4c76-42fb-9c67-2c541ff27e55"
Jun 03 21:33:10.707228 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:10.707177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:33:10.707690 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:10.707344    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 21:33:10.707690 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:10.707431    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls podName:6b99cda7-8109-4787-920b-b524c81814db nodeName:}" failed. No retries permitted until 2026-06-03 21:35:12.707395408 +0000 UTC m=+283.839573249 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls") pod "dns-default-zsrlp" (UID: "6b99cda7-8109-4787-920b-b524c81814db") : secret "dns-default-metrics-tls" not found
Jun 03 21:33:18.313255 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:18.313159    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:33:24.938479 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.938434    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"]
Jun 03 21:33:24.940446 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.940425    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"]
Jun 03 21:33:24.940586 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.940548    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:24.942472 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.942446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:24.942619 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.942594    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-qbkbq"]
Jun 03 21:33:24.943340 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.943313    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 03 21:33:24.943503 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.943487    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ch4pd\""
Jun 03 21:33:24.943613 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.943586    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 03 21:33:24.943832 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.943820    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 03 21:33:24.944752 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.944733    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:24.945182 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.945167    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 03 21:33:24.946981 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.946921    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 21:33:24.946981 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.946936    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 21:33:24.947224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.947207    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lxdlb\""
Jun 03 21:33:24.947305 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.947225    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 03 21:33:24.947305 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.947233    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 03 21:33:24.947305 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.947226    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5nvh7\""
Jun 03 21:33:24.947605 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.947590    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 03 21:33:24.949623 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.949604    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 03 21:33:24.951282 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.951266    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 03 21:33:24.954181 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.954162    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 03 21:33:24.957565 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.957528    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"]
Jun 03 21:33:24.958676 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.958654    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"]
Jun 03 21:33:24.962895 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:24.962872    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-qbkbq"]
Jun 03 21:33:25.010921 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.010886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.010921 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.010926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d944768e-e7a8-481c-85d5-dc9a24c4cf78-serving-cert\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.011138 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.010954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmn6\" (UniqueName: \"kubernetes.io/projected/76bd295a-c44e-4253-8edb-42f4b787d6f1-kube-api-access-dtmn6\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.011138 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.010999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d944768e-e7a8-481c-85d5-dc9a24c4cf78-config\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.011138 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.011026    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvmmc\" (UniqueName: \"kubernetes.io/projected/b1e081e6-59a8-4379-935a-f09a6c6f9263-kube-api-access-xvmmc\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:25.011138 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.011093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d944768e-e7a8-481c-85d5-dc9a24c4cf78-trusted-ca\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.011138 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.011122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6698\" (UniqueName: \"kubernetes.io/projected/d944768e-e7a8-481c-85d5-dc9a24c4cf78-kube-api-access-c6698\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.011302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.011151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:25.011302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.011181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76bd295a-c44e-4253-8edb-42f4b787d6f1-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.112032 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.111980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.112032 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d944768e-e7a8-481c-85d5-dc9a24c4cf78-serving-cert\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112053    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmn6\" (UniqueName: \"kubernetes.io/projected/76bd295a-c44e-4253-8edb-42f4b787d6f1-kube-api-access-dtmn6\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d944768e-e7a8-481c-85d5-dc9a24c4cf78-config\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvmmc\" (UniqueName: \"kubernetes.io/projected/b1e081e6-59a8-4379-935a-f09a6c6f9263-kube-api-access-xvmmc\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d944768e-e7a8-481c-85d5-dc9a24c4cf78-trusted-ca\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.112139    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6698\" (UniqueName: \"kubernetes.io/projected/d944768e-e7a8-481c-85d5-dc9a24c4cf78-kube-api-access-c6698\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112190    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.112212    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls podName:76bd295a-c44e-4253-8edb-42f4b787d6f1 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:25.612190078 +0000 UTC m=+176.744367918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-k2542" (UID: "76bd295a-c44e-4253-8edb-42f4b787d6f1") : secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112248    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76bd295a-c44e-4253-8edb-42f4b787d6f1-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.112262    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 21:33:25.112311 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.112312    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls podName:b1e081e6-59a8-4379-935a-f09a6c6f9263 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:25.61229771 +0000 UTC m=+176.744475552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-j2nk7" (UID: "b1e081e6-59a8-4379-935a-f09a6c6f9263") : secret "samples-operator-tls" not found
Jun 03 21:33:25.113006 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.112983    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d944768e-e7a8-481c-85d5-dc9a24c4cf78-config\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.113092 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.113069    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76bd295a-c44e-4253-8edb-42f4b787d6f1-telemetry-config\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.113127 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.113099    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d944768e-e7a8-481c-85d5-dc9a24c4cf78-trusted-ca\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.114590 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.114572    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d944768e-e7a8-481c-85d5-dc9a24c4cf78-serving-cert\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.121338 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.121306    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvmmc\" (UniqueName: \"kubernetes.io/projected/b1e081e6-59a8-4379-935a-f09a6c6f9263-kube-api-access-xvmmc\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:25.121501 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.121404    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6698\" (UniqueName: \"kubernetes.io/projected/d944768e-e7a8-481c-85d5-dc9a24c4cf78-kube-api-access-c6698\") pod \"console-operator-85bd8fd97d-qbkbq\" (UID: \"d944768e-e7a8-481c-85d5-dc9a24c4cf78\") " pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.121501 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.121451    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmn6\" (UniqueName: \"kubernetes.io/projected/76bd295a-c44e-4253-8edb-42f4b787d6f1-kube-api-access-dtmn6\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.265720 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.265628    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:25.395564 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.395523    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-qbkbq"]
Jun 03 21:33:25.398653 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:33:25.398621    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd944768e_e7a8_481c_85d5_dc9a24c4cf78.slice/crio-fc7e08e5bed059bfaabdf81e402b493ffce1d5309e35f3099e752017f90bbe57 WatchSource:0}: Error finding container fc7e08e5bed059bfaabdf81e402b493ffce1d5309e35f3099e752017f90bbe57: Status 404 returned error can't find the container with id fc7e08e5bed059bfaabdf81e402b493ffce1d5309e35f3099e752017f90bbe57
Jun 03 21:33:25.616266 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.616155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:25.616266 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.616254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:25.616538 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.616327    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:25.616538 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.616357    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 21:33:25.616538 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.616436    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls podName:76bd295a-c44e-4253-8edb-42f4b787d6f1 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:26.616389022 +0000 UTC m=+177.748566877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-k2542" (UID: "76bd295a-c44e-4253-8edb-42f4b787d6f1") : secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:25.616538 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:25.616457    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls podName:b1e081e6-59a8-4379-935a-f09a6c6f9263 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:26.616447213 +0000 UTC m=+177.748625054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-j2nk7" (UID: "b1e081e6-59a8-4379-935a-f09a6c6f9263") : secret "samples-operator-tls" not found
Jun 03 21:33:25.882921 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:25.882828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" event={"ID":"d944768e-e7a8-481c-85d5-dc9a24c4cf78","Type":"ContainerStarted","Data":"fc7e08e5bed059bfaabdf81e402b493ffce1d5309e35f3099e752017f90bbe57"}
Jun 03 21:33:26.623515 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:26.623483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:26.623984 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:26.623566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:26.623984 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:26.623649    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:26.623984 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:26.623705    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 21:33:26.623984 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:26.623717    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls podName:76bd295a-c44e-4253-8edb-42f4b787d6f1 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:28.623702227 +0000 UTC m=+179.755880068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-k2542" (UID: "76bd295a-c44e-4253-8edb-42f4b787d6f1") : secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:26.623984 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:26.623771    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls podName:b1e081e6-59a8-4379-935a-f09a6c6f9263 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:28.623752716 +0000 UTC m=+179.755930575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-j2nk7" (UID: "b1e081e6-59a8-4379-935a-f09a6c6f9263") : secret "samples-operator-tls" not found
Jun 03 21:33:27.893673 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:27.893636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" event={"ID":"d944768e-e7a8-481c-85d5-dc9a24c4cf78","Type":"ContainerStarted","Data":"c4ed12f0240fbb2d6b629def8a7b603e4a6b7b5fb4ce5ccf26004e6743204610"}
Jun 03 21:33:27.894146 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:27.893834    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:27.895226 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:27.895199    2574 patch_prober.go:28] interesting pod/console-operator-85bd8fd97d-qbkbq container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.12:8443/readyz\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body=
Jun 03 21:33:27.895319 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:27.895243    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" podUID="d944768e-e7a8-481c-85d5-dc9a24c4cf78" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.12:8443/readyz\": dial tcp 10.134.0.12:8443: connect: connection refused"
Jun 03 21:33:27.910486 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:27.910434    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" podStartSLOduration=1.492725876 podStartE2EDuration="3.910405815s" totalImagesPullingTime="2.417679939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:27.909697415 +0000 UTC m=+179.041875298" watchObservedRunningTime="2026-06-03 21:33:27.910405815 +0000 UTC m=+179.042583700"
Jun 03 21:33:28.643541 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:28.643485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:28.643745 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:28.643579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:28.643745 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:28.643664    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 21:33:28.643745 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:28.643718    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:28.643745 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:28.643744    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls podName:b1e081e6-59a8-4379-935a-f09a6c6f9263 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:32.643723398 +0000 UTC m=+183.775901254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-j2nk7" (UID: "b1e081e6-59a8-4379-935a-f09a6c6f9263") : secret "samples-operator-tls" not found
Jun 03 21:33:28.643968 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:28.643779    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls podName:76bd295a-c44e-4253-8edb-42f4b787d6f1 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:32.643765227 +0000 UTC m=+183.775943069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-k2542" (UID: "76bd295a-c44e-4253-8edb-42f4b787d6f1") : secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:28.898502 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:28.898403    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/0.log"
Jun 03 21:33:28.898502 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:28.898461    2574 generic.go:356] "Generic (PLEG): container finished" podID="d944768e-e7a8-481c-85d5-dc9a24c4cf78" containerID="c4ed12f0240fbb2d6b629def8a7b603e4a6b7b5fb4ce5ccf26004e6743204610" exitCode=255
Jun 03 21:33:28.898502 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:28.898488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" event={"ID":"d944768e-e7a8-481c-85d5-dc9a24c4cf78","Type":"ContainerDied","Data":"c4ed12f0240fbb2d6b629def8a7b603e4a6b7b5fb4ce5ccf26004e6743204610"}
Jun 03 21:33:28.898937 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:28.898729    2574 scope.go:117] "RemoveContainer" containerID="c4ed12f0240fbb2d6b629def8a7b603e4a6b7b5fb4ce5ccf26004e6743204610"
Jun 03 21:33:29.903125 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:29.903098    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:33:29.903575 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:29.903494    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/0.log"
Jun 03 21:33:29.903575 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:29.903527    2574 generic.go:356] "Generic (PLEG): container finished" podID="d944768e-e7a8-481c-85d5-dc9a24c4cf78" containerID="18fb22a36fdd9b5545146b6bf14950ecaf58e7cbb5bd86269e6143bbda9b5e53" exitCode=255
Jun 03 21:33:29.903575 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:29.903570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" event={"ID":"d944768e-e7a8-481c-85d5-dc9a24c4cf78","Type":"ContainerDied","Data":"18fb22a36fdd9b5545146b6bf14950ecaf58e7cbb5bd86269e6143bbda9b5e53"}
Jun 03 21:33:29.903675 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:29.903622    2574 scope.go:117] "RemoveContainer" containerID="c4ed12f0240fbb2d6b629def8a7b603e4a6b7b5fb4ce5ccf26004e6743204610"
Jun 03 21:33:29.903829 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:29.903809    2574 scope.go:117] "RemoveContainer" containerID="18fb22a36fdd9b5545146b6bf14950ecaf58e7cbb5bd86269e6143bbda9b5e53"
Jun 03 21:33:29.904019 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:29.903996    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-qbkbq_openshift-console-operator(d944768e-e7a8-481c-85d5-dc9a24c4cf78)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" podUID="d944768e-e7a8-481c-85d5-dc9a24c4cf78"
Jun 03 21:33:30.176143 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.176051    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"]
Jun 03 21:33:30.178859 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.178839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"
Jun 03 21:33:30.181875 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.181846    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r5dfb\""
Jun 03 21:33:30.182026 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.182007    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 03 21:33:30.182096 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.182081    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 03 21:33:30.187343 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.187312    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"]
Jun 03 21:33:30.255708 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.255664    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqnnl\" (UniqueName: \"kubernetes.io/projected/680b1d6f-91bd-4f4f-a503-7b643a4e5a89-kube-api-access-zqnnl\") pod \"migrator-955ffdf5f-vzkrv\" (UID: \"680b1d6f-91bd-4f4f-a503-7b643a4e5a89\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"
Jun 03 21:33:30.356715 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.356677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqnnl\" (UniqueName: \"kubernetes.io/projected/680b1d6f-91bd-4f4f-a503-7b643a4e5a89-kube-api-access-zqnnl\") pod \"migrator-955ffdf5f-vzkrv\" (UID: \"680b1d6f-91bd-4f4f-a503-7b643a4e5a89\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"
Jun 03 21:33:30.369683 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.369647    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqnnl\" (UniqueName: \"kubernetes.io/projected/680b1d6f-91bd-4f4f-a503-7b643a4e5a89-kube-api-access-zqnnl\") pod \"migrator-955ffdf5f-vzkrv\" (UID: \"680b1d6f-91bd-4f4f-a503-7b643a4e5a89\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"
Jun 03 21:33:30.487750 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.487650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"
Jun 03 21:33:30.611300 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.611264    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv"]
Jun 03 21:33:30.614239 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:33:30.614206    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680b1d6f_91bd_4f4f_a503_7b643a4e5a89.slice/crio-7408e2bb4c28898a5ce4ea7786426831b395771ff9fb0fc160a37b5200df6909 WatchSource:0}: Error finding container 7408e2bb4c28898a5ce4ea7786426831b395771ff9fb0fc160a37b5200df6909: Status 404 returned error can't find the container with id 7408e2bb4c28898a5ce4ea7786426831b395771ff9fb0fc160a37b5200df6909
Jun 03 21:33:30.907923 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.907887    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:33:30.908380 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.908247    2574 scope.go:117] "RemoveContainer" containerID="18fb22a36fdd9b5545146b6bf14950ecaf58e7cbb5bd86269e6143bbda9b5e53"
Jun 03 21:33:30.908466 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:30.908399    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-qbkbq_openshift-console-operator(d944768e-e7a8-481c-85d5-dc9a24c4cf78)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" podUID="d944768e-e7a8-481c-85d5-dc9a24c4cf78"
Jun 03 21:33:30.909146 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:30.909122    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv" event={"ID":"680b1d6f-91bd-4f4f-a503-7b643a4e5a89","Type":"ContainerStarted","Data":"7408e2bb4c28898a5ce4ea7786426831b395771ff9fb0fc160a37b5200df6909"}
Jun 03 21:33:31.621154 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:31.621119    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7ls5z_3a88d3f4-f42c-4197-be27-3ae842050c7b/dns-node-resolver/0.log"
Jun 03 21:33:32.621344 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:32.621315    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzkc7_c3a6c923-856d-40f5-a0d0-674ebaf12949/node-ca/0.log"
Jun 03 21:33:32.674833 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:32.674794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:32.674961 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:32.674860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:32.674999 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:32.674961    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:32.675045 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:32.674997    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 21:33:32.675077 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:32.675044    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls podName:76bd295a-c44e-4253-8edb-42f4b787d6f1 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:40.6750264 +0000 UTC m=+191.807204242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-k2542" (UID: "76bd295a-c44e-4253-8edb-42f4b787d6f1") : secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:32.675077 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:32.675059    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls podName:b1e081e6-59a8-4379-935a-f09a6c6f9263 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:40.675052467 +0000 UTC m=+191.807230308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-j2nk7" (UID: "b1e081e6-59a8-4379-935a-f09a6c6f9263") : secret "samples-operator-tls" not found
Jun 03 21:33:32.917789 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:32.917752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv" event={"ID":"680b1d6f-91bd-4f4f-a503-7b643a4e5a89","Type":"ContainerStarted","Data":"e79a36ee6d3964e4999845e0018a0d27bfc3ad87cf6fd4a0d17386e1a3052a04"}
Jun 03 21:33:32.917974 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:32.917804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv" event={"ID":"680b1d6f-91bd-4f4f-a503-7b643a4e5a89","Type":"ContainerStarted","Data":"7f58c39940940868f9e15deec6d7f7b36e9181f4168ec1cee591ed338df4759d"}
Jun 03 21:33:32.940578 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:32.940522    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vzkrv" podStartSLOduration=1.462519557 podStartE2EDuration="2.940502648s" totalImagesPullingTime="1.477983091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:32.939699298 +0000 UTC m=+184.071877141" watchObservedRunningTime="2026-06-03 21:33:32.940502648 +0000 UTC m=+184.072680511"
Jun 03 21:33:33.222336 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:33.222257    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pkczs_ab289959-f3e9-4378-8150-1aee4cfab20a/serve-healthcheck-canary/0.log"
Jun 03 21:33:35.266689 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:35.266650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:35.267243 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:35.267164    2574 scope.go:117] "RemoveContainer" containerID="18fb22a36fdd9b5545146b6bf14950ecaf58e7cbb5bd86269e6143bbda9b5e53"
Jun 03 21:33:35.267395 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:35.267371    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-qbkbq_openshift-console-operator(d944768e-e7a8-481c-85d5-dc9a24c4cf78)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" podUID="d944768e-e7a8-481c-85d5-dc9a24c4cf78"
Jun 03 21:33:37.894846 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:37.894793    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:37.895260 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:37.895200    2574 scope.go:117] "RemoveContainer" containerID="18fb22a36fdd9b5545146b6bf14950ecaf58e7cbb5bd86269e6143bbda9b5e53"
Jun 03 21:33:37.895364 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:37.895344    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-qbkbq_openshift-console-operator(d944768e-e7a8-481c-85d5-dc9a24c4cf78)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" podUID="d944768e-e7a8-481c-85d5-dc9a24c4cf78"
Jun 03 21:33:40.734735 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:40.734689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:40.735259 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:40.734762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:40.735259 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:40.734879    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:40.735259 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:33:40.734974    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls podName:76bd295a-c44e-4253-8edb-42f4b787d6f1 nodeName:}" failed. No retries permitted until 2026-06-03 21:33:56.734953558 +0000 UTC m=+207.867131400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-57769895dd-k2542" (UID: "76bd295a-c44e-4253-8edb-42f4b787d6f1") : secret "cluster-monitoring-operator-tls" not found
Jun 03 21:33:40.737132 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:40.737109    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b1e081e6-59a8-4379-935a-f09a6c6f9263-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-j2nk7\" (UID: \"b1e081e6-59a8-4379-935a-f09a6c6f9263\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:40.854349 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:40.854320    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ch4pd\""
Jun 03 21:33:40.861833 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:40.861800    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"
Jun 03 21:33:40.992264 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:40.992188    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7"]
Jun 03 21:33:41.946321 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:41.946285    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7" event={"ID":"b1e081e6-59a8-4379-935a-f09a6c6f9263","Type":"ContainerStarted","Data":"4ab38cd6016919033252707a5d7e21dd176c93e11fe2b543f37c9a77874b5c13"}
Jun 03 21:33:42.950929 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:42.950893    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7" event={"ID":"b1e081e6-59a8-4379-935a-f09a6c6f9263","Type":"ContainerStarted","Data":"b86b8f0fb22797869cc735c257e63804250dffbedd119f942b99d555a6c6d34f"}
Jun 03 21:33:42.951311 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:42.950954    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7" event={"ID":"b1e081e6-59a8-4379-935a-f09a6c6f9263","Type":"ContainerStarted","Data":"dbeed15380c50f54c365d8938b54cef97d7842cd46721e39be1ac4e56cea11ed"}
Jun 03 21:33:42.970354 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:42.970303    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-j2nk7" podStartSLOduration=17.242108651 podStartE2EDuration="18.970287293s" totalImagesPullingTime="1.728178642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:42.968716037 +0000 UTC m=+194.100893911" watchObservedRunningTime="2026-06-03 21:33:42.970287293 +0000 UTC m=+194.102465181"
Jun 03 21:33:45.609027 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:45.608983    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f" podUID="cd7358cf-229f-422a-9e6f-6b52603b1fee" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused"
Jun 03 21:33:45.964147 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:45.964112    2574 generic.go:356] "Generic (PLEG): container finished" podID="cd7358cf-229f-422a-9e6f-6b52603b1fee" containerID="6f27f49f62529cf35d7ba0f80f549426eb96459799894e12f8d2cffb1678eeda" exitCode=1
Jun 03 21:33:45.964362 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:45.964189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f" event={"ID":"cd7358cf-229f-422a-9e6f-6b52603b1fee","Type":"ContainerDied","Data":"6f27f49f62529cf35d7ba0f80f549426eb96459799894e12f8d2cffb1678eeda"}
Jun 03 21:33:45.964637 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:45.964616    2574 scope.go:117] "RemoveContainer" containerID="6f27f49f62529cf35d7ba0f80f549426eb96459799894e12f8d2cffb1678eeda"
Jun 03 21:33:45.965736 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:45.965716    2574 generic.go:356] "Generic (PLEG): container finished" podID="d3ef61bb-c8c3-4406-9684-bd3ed5971fd0" containerID="4515f9187d8863ffd81c5796824c2b6e1f1ea8933bfb92774742b5bef6ad7c3a" exitCode=255
Jun 03 21:33:45.965827 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:45.965745    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs" event={"ID":"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0","Type":"ContainerDied","Data":"4515f9187d8863ffd81c5796824c2b6e1f1ea8933bfb92774742b5bef6ad7c3a"}
Jun 03 21:33:45.972506 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:45.972482    2574 scope.go:117] "RemoveContainer" containerID="4515f9187d8863ffd81c5796824c2b6e1f1ea8933bfb92774742b5bef6ad7c3a"
Jun 03 21:33:46.971290 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:46.971250    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b4c7458cb-p94zs" event={"ID":"d3ef61bb-c8c3-4406-9684-bd3ed5971fd0","Type":"ContainerStarted","Data":"d2a1bfb45e0fa636ce7d348d97c557b373fac13440ea7bc4ebe3fefc46f7fd16"}
Jun 03 21:33:46.972842 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:46.972819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f" event={"ID":"cd7358cf-229f-422a-9e6f-6b52603b1fee","Type":"ContainerStarted","Data":"c86c915bdf3c47ceaf0cfd0d2c3d98550cf1f1cdcc5cb6048a9136578e4394e5"}
Jun 03 21:33:46.973087 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:46.973071    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:33:46.973675 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:46.973656    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c567dcc96-gx66f"
Jun 03 21:33:51.313391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:51.313354    2574 scope.go:117] "RemoveContainer" containerID="18fb22a36fdd9b5545146b6bf14950ecaf58e7cbb5bd86269e6143bbda9b5e53"
Jun 03 21:33:51.989936 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:51.989909    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:33:51.990112 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:51.990004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq" event={"ID":"d944768e-e7a8-481c-85d5-dc9a24c4cf78","Type":"ContainerStarted","Data":"0476c07f13ff1dbef5ec119bcaa97fc55698aa9363bbcf939ec9273073e8f53d"}
Jun 03 21:33:51.990306 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:51.990279    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:52.084606 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:52.084575    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-qbkbq"
Jun 03 21:33:55.879620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.879586    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-swzhv"]
Jun 03 21:33:55.882304 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.882284    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:55.885294 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.885266    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 21:33:55.887339 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.887314    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 21:33:55.893097 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.888920    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 21:33:55.893097 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.888975    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 21:33:55.893097 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.890037    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5cgd6\""
Jun 03 21:33:55.898653 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.898621    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swzhv"]
Jun 03 21:33:55.962162 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.962127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a07dae1-d085-4f3b-a06d-978b71a6741a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:55.962331 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.962238    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a07dae1-d085-4f3b-a06d-978b71a6741a-crio-socket\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:55.962331 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.962264    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a07dae1-d085-4f3b-a06d-978b71a6741a-data-volume\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:55.962331 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.962282    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a07dae1-d085-4f3b-a06d-978b71a6741a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:55.962331 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.962303    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-854vj\" (UniqueName: \"kubernetes.io/projected/2a07dae1-d085-4f3b-a06d-978b71a6741a-kube-api-access-854vj\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:55.965979 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.965954    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-597f9cc6dc-gtjjm"]
Jun 03 21:33:55.969028 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.969010    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:55.972790 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.972767    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6m9lg\""
Jun 03 21:33:55.972939 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.972852    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 21:33:55.972939 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.972870    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 21:33:55.973061 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.973046    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 21:33:55.977327 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.977302    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 21:33:55.987367 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:55.987335    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597f9cc6dc-gtjjm"]
Jun 03 21:33:56.063061 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d3ed37-d00f-42f1-96dd-331a0512923d-ca-trust-extracted\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063250 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063071    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d3ed37-d00f-42f1-96dd-331a0512923d-installation-pull-secrets\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063250 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghr6\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-kube-api-access-gghr6\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063250 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063181    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a07dae1-d085-4f3b-a06d-978b71a6741a-data-volume\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.063434 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-bound-sa-token\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063434 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d3ed37-d00f-42f1-96dd-331a0512923d-registry-certificates\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063434 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-registry-tls\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063434 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063397    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d3ed37-d00f-42f1-96dd-331a0512923d-trusted-ca\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063644 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a07dae1-d085-4f3b-a06d-978b71a6741a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.063644 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a07dae1-d085-4f3b-a06d-978b71a6741a-crio-socket\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.063644 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d3ed37-d00f-42f1-96dd-331a0512923d-image-registry-private-configuration\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.063644 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063612    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a07dae1-d085-4f3b-a06d-978b71a6741a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.063644 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063639    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-854vj\" (UniqueName: \"kubernetes.io/projected/2a07dae1-d085-4f3b-a06d-978b71a6741a-kube-api-access-854vj\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.063896 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063653    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a07dae1-d085-4f3b-a06d-978b71a6741a-data-volume\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.063896 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063861    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2a07dae1-d085-4f3b-a06d-978b71a6741a-crio-socket\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.064018 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.063994    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2a07dae1-d085-4f3b-a06d-978b71a6741a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.066402 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.066375    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2a07dae1-d085-4f3b-a06d-978b71a6741a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.072917 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.072886    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-854vj\" (UniqueName: \"kubernetes.io/projected/2a07dae1-d085-4f3b-a06d-978b71a6741a-kube-api-access-854vj\") pod \"insights-runtime-extractor-swzhv\" (UID: \"2a07dae1-d085-4f3b-a06d-978b71a6741a\") " pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.164247 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164207    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d3ed37-d00f-42f1-96dd-331a0512923d-trusted-ca\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164489 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d3ed37-d00f-42f1-96dd-331a0512923d-image-registry-private-configuration\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164489 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d3ed37-d00f-42f1-96dd-331a0512923d-ca-trust-extracted\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164489 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d3ed37-d00f-42f1-96dd-331a0512923d-installation-pull-secrets\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164489 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghr6\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-kube-api-access-gghr6\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164489 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-bound-sa-token\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164489 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164479    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d3ed37-d00f-42f1-96dd-331a0512923d-registry-certificates\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164796 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164504    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-registry-tls\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.164853 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.164793    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23d3ed37-d00f-42f1-96dd-331a0512923d-ca-trust-extracted\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.165360 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.165335    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23d3ed37-d00f-42f1-96dd-331a0512923d-registry-certificates\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.165360 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.165352    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23d3ed37-d00f-42f1-96dd-331a0512923d-trusted-ca\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.167036 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.167009    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-registry-tls\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.167511 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.167488    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23d3ed37-d00f-42f1-96dd-331a0512923d-installation-pull-secrets\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.167560 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.167537    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23d3ed37-d00f-42f1-96dd-331a0512923d-image-registry-private-configuration\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.177401 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.177366    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-bound-sa-token\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.177625 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.177601    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghr6\" (UniqueName: \"kubernetes.io/projected/23d3ed37-d00f-42f1-96dd-331a0512923d-kube-api-access-gghr6\") pod \"image-registry-597f9cc6dc-gtjjm\" (UID: \"23d3ed37-d00f-42f1-96dd-331a0512923d\") " pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.195539 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.195498    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swzhv"
Jun 03 21:33:56.278647 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.278624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:56.332555 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.332517    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swzhv"]
Jun 03 21:33:56.336689 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:33:56.336654    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a07dae1_d085_4f3b_a06d_978b71a6741a.slice/crio-e8f44552b44ae38f6e82cb1eed09bf25421f1e8ac9601176097a8684237e78bf WatchSource:0}: Error finding container e8f44552b44ae38f6e82cb1eed09bf25421f1e8ac9601176097a8684237e78bf: Status 404 returned error can't find the container with id e8f44552b44ae38f6e82cb1eed09bf25421f1e8ac9601176097a8684237e78bf
Jun 03 21:33:56.422701 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.422669    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-597f9cc6dc-gtjjm"]
Jun 03 21:33:56.425675 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:33:56.425644    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d3ed37_d00f_42f1_96dd_331a0512923d.slice/crio-2d92b26b5cbd5b23109734a8ed9ee5a3a83e6573301cfcc046474365d310e89a WatchSource:0}: Error finding container 2d92b26b5cbd5b23109734a8ed9ee5a3a83e6573301cfcc046474365d310e89a: Status 404 returned error can't find the container with id 2d92b26b5cbd5b23109734a8ed9ee5a3a83e6573301cfcc046474365d310e89a
Jun 03 21:33:56.769082 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.768988    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:56.771525 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:56.771492    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76bd295a-c44e-4253-8edb-42f4b787d6f1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-57769895dd-k2542\" (UID: \"76bd295a-c44e-4253-8edb-42f4b787d6f1\") " pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:57.007781 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.007736    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" event={"ID":"23d3ed37-d00f-42f1-96dd-331a0512923d","Type":"ContainerStarted","Data":"2607d9884da7749f4cbbc012ddf03d5fca9adc802fc0a10afc185f02afd486d2"}
Jun 03 21:33:57.008286 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.007803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" event={"ID":"23d3ed37-d00f-42f1-96dd-331a0512923d","Type":"ContainerStarted","Data":"2d92b26b5cbd5b23109734a8ed9ee5a3a83e6573301cfcc046474365d310e89a"}
Jun 03 21:33:57.008286 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.007866    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:33:57.009452 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.009408    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swzhv" event={"ID":"2a07dae1-d085-4f3b-a06d-978b71a6741a","Type":"ContainerStarted","Data":"1de2ff6a98772e0e1b8883734002037e5a9171e6aee30a843d63ddfd646aec2a"}
Jun 03 21:33:57.009569 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.009473    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swzhv" event={"ID":"2a07dae1-d085-4f3b-a06d-978b71a6741a","Type":"ContainerStarted","Data":"e8f44552b44ae38f6e82cb1eed09bf25421f1e8ac9601176097a8684237e78bf"}
Jun 03 21:33:57.028793 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.028690    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podStartSLOduration=2.028672393 podStartE2EDuration="2.028672393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:33:57.027785376 +0000 UTC m=+208.159963250" watchObservedRunningTime="2026-06-03 21:33:57.028672393 +0000 UTC m=+208.160850256"
Jun 03 21:33:57.061111 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.061073    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5nvh7\""
Jun 03 21:33:57.069512 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.069474    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"
Jun 03 21:33:57.296444 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:57.296345    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542"]
Jun 03 21:33:57.300406 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:33:57.300373    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bd295a_c44e_4253_8edb_42f4b787d6f1.slice/crio-054e73f439f2228e26abbf0d32f7708b0650ebe0b599523068f8d57cfd76b624 WatchSource:0}: Error finding container 054e73f439f2228e26abbf0d32f7708b0650ebe0b599523068f8d57cfd76b624: Status 404 returned error can't find the container with id 054e73f439f2228e26abbf0d32f7708b0650ebe0b599523068f8d57cfd76b624
Jun 03 21:33:58.021956 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:58.018693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swzhv" event={"ID":"2a07dae1-d085-4f3b-a06d-978b71a6741a","Type":"ContainerStarted","Data":"224ba1ba71c80a2eecc12616f8dc56c100171006235c1e8b2a4f2dee47a19914"}
Jun 03 21:33:58.022756 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:33:58.022709    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542" event={"ID":"76bd295a-c44e-4253-8edb-42f4b787d6f1","Type":"ContainerStarted","Data":"054e73f439f2228e26abbf0d32f7708b0650ebe0b599523068f8d57cfd76b624"}
Jun 03 21:34:00.030851 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:00.030810    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542" event={"ID":"76bd295a-c44e-4253-8edb-42f4b787d6f1","Type":"ContainerStarted","Data":"0e95f58c70c90dc584477dc6005377f4f400106a1ff9c5681a1e25657065ce0d"}
Jun 03 21:34:00.032828 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:00.032800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swzhv" event={"ID":"2a07dae1-d085-4f3b-a06d-978b71a6741a","Type":"ContainerStarted","Data":"8e9aef5c4c31ee7ba3b4d59b7686b5fe116bd3f48c24d68139bdb6f0cf930864"}
Jun 03 21:34:00.048247 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:00.048193    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-57769895dd-k2542" podStartSLOduration=34.124529664 podStartE2EDuration="36.048178617s" totalImagesPullingTime="1.923648953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:00.047105515 +0000 UTC m=+211.179283378" watchObservedRunningTime="2026-06-03 21:34:00.048178617 +0000 UTC m=+211.180356479"
Jun 03 21:34:00.066589 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:00.066536    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-swzhv" podStartSLOduration=2.319473702 podStartE2EDuration="5.066517958s" totalImagesPullingTime="2.747044256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 21:33:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:00.065760555 +0000 UTC m=+211.197938423" watchObservedRunningTime="2026-06-03 21:34:00.066517958 +0000 UTC m=+211.198695820"
Jun 03 21:34:03.805829 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.805790    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"]
Jun 03 21:34:03.810692 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.810667    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:03.814278 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.814252    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 03 21:34:03.814449 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.814350    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ts4sb\""
Jun 03 21:34:03.814638 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.814617    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 03 21:34:03.814964 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.814950    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 21:34:03.820934 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.820908    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"]
Jun 03 21:34:03.924910 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.924856    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:03.925118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.924918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:03.925118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.924954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:03.925118 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:03.924991    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5hqb\" (UniqueName: \"kubernetes.io/projected/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-kube-api-access-k5hqb\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.026284 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.026239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.026503 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.026293    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.026503 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.026330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5hqb\" (UniqueName: \"kubernetes.io/projected/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-kube-api-access-k5hqb\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.026503 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.026433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.027072 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.027049    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.028708 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.028682    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.028865 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.028844    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.035866 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.035831    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5hqb\" (UniqueName: \"kubernetes.io/projected/c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c-kube-api-access-k5hqb\") pod \"prometheus-operator-7f7d445d84-mwj8f\" (UID: \"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.120333 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.120243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"
Jun 03 21:34:04.252588 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:04.252550    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f"]
Jun 03 21:34:04.255468 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:34:04.255439    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b4d1ec_095f_40d4_9ebf_8fdeb9ea5e8c.slice/crio-ad6781e624dcc4eaf7e385875812107ab69135da55bd1ba2090f057c0a2f92a7 WatchSource:0}: Error finding container ad6781e624dcc4eaf7e385875812107ab69135da55bd1ba2090f057c0a2f92a7: Status 404 returned error can't find the container with id ad6781e624dcc4eaf7e385875812107ab69135da55bd1ba2090f057c0a2f92a7
Jun 03 21:34:05.050768 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:05.050726    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f" event={"ID":"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c","Type":"ContainerStarted","Data":"ad6781e624dcc4eaf7e385875812107ab69135da55bd1ba2090f057c0a2f92a7"}
Jun 03 21:34:06.055834 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:06.055798    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f" event={"ID":"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c","Type":"ContainerStarted","Data":"fa811c89406cbcc921acb3d14d509357ceeeda3a4f5e253c8f805a2935faff15"}
Jun 03 21:34:06.056241 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:06.055860    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f" event={"ID":"c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c","Type":"ContainerStarted","Data":"db314427c6f4de5c0dd7b35c2a27f72140643c7c4f852ab25b9a547d7949a84c"}
Jun 03 21:34:06.075813 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:06.075752    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-mwj8f" podStartSLOduration=1.824876373 podStartE2EDuration="3.0757333s" totalImagesPullingTime="1.250856927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:06.073843923 +0000 UTC m=+217.206021787" watchObservedRunningTime="2026-06-03 21:34:06.0757333 +0000 UTC m=+217.207911162"
Jun 03 21:34:08.195948 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.195911    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pfh5l"]
Jun 03 21:34:08.199961 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.199934    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.202931 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.202910    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 21:34:08.203262 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.203242    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 21:34:08.203349 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.203332    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6mf74\""
Jun 03 21:34:08.203868 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.203854    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 21:34:08.364243 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364204    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364243 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-textfile\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364530 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-sys\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364530 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-wtmp\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364530 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364377    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6f78f6-66e5-49e8-8078-be2ad5318f88-metrics-client-ca\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364530 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-root\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364530 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2p8\" (UniqueName: \"kubernetes.io/projected/7b6f78f6-66e5-49e8-8078-be2ad5318f88-kube-api-access-hn2p8\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364530 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.364770 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.364572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-tls\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466025 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.465928    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466025 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.465987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-tls\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466025 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-textfile\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-sys\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466112    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-wtmp\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6f78f6-66e5-49e8-8078-be2ad5318f88-metrics-client-ca\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:34:08.466169    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466181    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-root\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466178    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-sys\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466205    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2p8\" (UniqueName: \"kubernetes.io/projected/7b6f78f6-66e5-49e8-8078-be2ad5318f88-kube-api-access-hn2p8\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:34:08.466234    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-tls podName:7b6f78f6-66e5-49e8-8078-be2ad5318f88 nodeName:}" failed. No retries permitted until 2026-06-03 21:34:08.966215167 +0000 UTC m=+220.098393016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-tls") pod "node-exporter-pfh5l" (UID: "7b6f78f6-66e5-49e8-8078-be2ad5318f88") : secret "node-exporter-tls" not found
Jun 03 21:34:08.466302 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466248    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-root\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466863 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466348    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-wtmp\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466863 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466489    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-textfile\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466863 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466746    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6f78f6-66e5-49e8-8078-be2ad5318f88-metrics-client-ca\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.466863 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.466787    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.468491 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.468468    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.476257 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.476228    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2p8\" (UniqueName: \"kubernetes.io/projected/7b6f78f6-66e5-49e8-8078-be2ad5318f88-kube-api-access-hn2p8\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.971199 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.971163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-tls\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:08.973521 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:08.973495    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6f78f6-66e5-49e8-8078-be2ad5318f88-node-exporter-tls\") pod \"node-exporter-pfh5l\" (UID: \"7b6f78f6-66e5-49e8-8078-be2ad5318f88\") " pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:09.109539 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:09.109496    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfh5l"
Jun 03 21:34:09.121522 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:34:09.121493    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6f78f6_66e5_49e8_8078_be2ad5318f88.slice/crio-503d9b2b4417387ce08b263eb7a228a854dea8557bc203d5940222d09eb7efc8 WatchSource:0}: Error finding container 503d9b2b4417387ce08b263eb7a228a854dea8557bc203d5940222d09eb7efc8: Status 404 returned error can't find the container with id 503d9b2b4417387ce08b263eb7a228a854dea8557bc203d5940222d09eb7efc8
Jun 03 21:34:10.075226 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:10.075191    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfh5l" event={"ID":"7b6f78f6-66e5-49e8-8078-be2ad5318f88","Type":"ContainerStarted","Data":"503d9b2b4417387ce08b263eb7a228a854dea8557bc203d5940222d09eb7efc8"}
Jun 03 21:34:11.080343 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:11.080303    2574 generic.go:356] "Generic (PLEG): container finished" podID="7b6f78f6-66e5-49e8-8078-be2ad5318f88" containerID="b829031f33bc4006f77d61346a913cd56bd49680926c2ca56e54ed1402746d94" exitCode=0
Jun 03 21:34:11.080779 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:11.080353    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfh5l" event={"ID":"7b6f78f6-66e5-49e8-8078-be2ad5318f88","Type":"ContainerDied","Data":"b829031f33bc4006f77d61346a913cd56bd49680926c2ca56e54ed1402746d94"}
Jun 03 21:34:12.085868 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:12.085830    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfh5l" event={"ID":"7b6f78f6-66e5-49e8-8078-be2ad5318f88","Type":"ContainerStarted","Data":"5786e75eb15654c9909eed094361c1272f2258ab6794173585f381ae2dd7128e"}
Jun 03 21:34:12.086243 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:12.085885    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfh5l" event={"ID":"7b6f78f6-66e5-49e8-8078-be2ad5318f88","Type":"ContainerStarted","Data":"4395dc66eaf2c5796aa30d345df0d662142af1442d5d53ddbc092c4e75292863"}
Jun 03 21:34:12.115974 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:12.115908    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pfh5l" podStartSLOduration=3.161949276 podStartE2EDuration="4.115889954s" totalImagesPullingTime="883.475838ms" totalInitContainerRuntime="70.46484ms" isStatefulPod=true podCreationTimestamp="2026-06-03 21:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:12.115124723 +0000 UTC m=+223.247302587" watchObservedRunningTime="2026-06-03 21:34:12.115889954 +0000 UTC m=+223.248067817"
Jun 03 21:34:14.386691 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.386656    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:34:14.390833 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.390806    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.393909    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.394126    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.394289    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.394471    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-thq4v\""
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.395079    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.395530    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.395737    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 21:34:14.395763 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.395737    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 21:34:14.396300 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.395776    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 21:34:14.396300 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.395925    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 21:34:14.396300 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.395978    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 21:34:14.396300 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.396184    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 21:34:14.396528 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.396437    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2eb7esesu06u\""
Jun 03 21:34:14.396528 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.396452    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 21:34:14.396625 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.396565    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 21:34:14.398827 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.398635    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 21:34:14.405531 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.405023    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 21:34:14.410029 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.410002    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:34:14.517295 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517253    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517295 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517295    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517574 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517574 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517451    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517574 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517574 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517539    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517574 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517628    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ln2p\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-kube-api-access-6ln2p\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517657    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517684    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.517820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.518210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517868    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.518210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.518210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517917    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.518210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.518210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.517962    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618376 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618376 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618656 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618656 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618656 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618817 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618817 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618729    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618817 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618758    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618817 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618786    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.618817 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618837    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.618973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.619014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.619049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619407 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.619084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619407 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.619110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ln2p\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-kube-api-access-6ln2p\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619407 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.619131    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619407 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.619142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.619792 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.619554    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.622249 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.622213    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.623655 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.623624    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.623811 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.623736    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.624550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.623927    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.624550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.624059    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config-out\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.624550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.624361    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.624550 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.624488    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.624796 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.624564    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.625811 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.625763    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.626854 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.626809    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.628448 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.627192    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.628685 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.628653    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.630270 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.629115    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.630270 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.629609    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.630270 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.629984    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-web-config\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.630629 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.630545    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.630905 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.630878    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.632567 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.632534    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ln2p\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-kube-api-access-6ln2p\") pod \"prometheus-k8s-0\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.707308 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.707263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:14.851146 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:14.851100    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:34:14.853683 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:34:14.853655    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1b8cc2_61da_4a3c_bada_b8aa83057802.slice/crio-b703bb3553f1dc6bf4e7f374ccd85c3f2e11f006d860e20ed41c355b9c72513b WatchSource:0}: Error finding container b703bb3553f1dc6bf4e7f374ccd85c3f2e11f006d860e20ed41c355b9c72513b: Status 404 returned error can't find the container with id b703bb3553f1dc6bf4e7f374ccd85c3f2e11f006d860e20ed41c355b9c72513b
Jun 03 21:34:15.098407 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:15.098313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerStarted","Data":"b703bb3553f1dc6bf4e7f374ccd85c3f2e11f006d860e20ed41c355b9c72513b"}
Jun 03 21:34:16.105480 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:16.105378    2574 generic.go:356] "Generic (PLEG): container finished" podID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerID="5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d" exitCode=0
Jun 03 21:34:16.105480 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:16.105447    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d"}
Jun 03 21:34:16.283432 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:16.283373    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:16.283602 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:16.283456    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:18.027885 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:18.027849    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:18.028353 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:18.027909    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:20.133792 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:20.133754    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerStarted","Data":"4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3"}
Jun 03 21:34:20.134155 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:20.133829    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerStarted","Data":"5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c"}
Jun 03 21:34:22.145788 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:22.145752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerStarted","Data":"dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224"}
Jun 03 21:34:22.146275 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:22.145813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerStarted","Data":"1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9"}
Jun 03 21:34:22.146275 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:22.145841    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerStarted","Data":"5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24"}
Jun 03 21:34:22.146275 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:22.145868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerStarted","Data":"671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0"}
Jun 03 21:34:22.176922 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:22.176861    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.273415854 podStartE2EDuration="8.176829124s" totalImagesPullingTime="5.88321491s" totalInitContainerRuntime="20.19836ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:34:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:22.175732212 +0000 UTC m=+233.307910113" watchObservedRunningTime="2026-06-03 21:34:22.176829124 +0000 UTC m=+233.309006998"
Jun 03 21:34:24.708000 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:24.707961    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:34:26.284044 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:26.284012    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:26.284435 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:26.284061    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:28.027688 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:28.027648    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:28.028066 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:28.027698    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:36.282951 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:36.282911    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:36.283446 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:36.282972    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:36.283446 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:36.283013    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:34:36.283543 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:36.283486    2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"2607d9884da7749f4cbbc012ddf03d5fca9adc802fc0a10afc185f02afd486d2"} pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 03 21:34:36.287089 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:36.287061    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:36.287206 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:36.287108    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:41.245788 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:41.245731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:34:41.248145 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:41.248116    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf5f89fc-4c76-42fb-9c67-2c541ff27e55-metrics-certs\") pod \"network-metrics-daemon-xjfjq\" (UID: \"cf5f89fc-4c76-42fb-9c67-2c541ff27e55\") " pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:34:41.417115 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:41.417085    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bvgnm\""
Jun 03 21:34:41.424481 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:41.424452    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xjfjq"
Jun 03 21:34:41.559872 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:41.559842    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xjfjq"]
Jun 03 21:34:41.561965 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:34:41.561937    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5f89fc_4c76_42fb_9c67_2c541ff27e55.slice/crio-b91604f6d431cd2e2b69daff3b617873e6c68110e8afd90b4372889c7c6d4fb9 WatchSource:0}: Error finding container b91604f6d431cd2e2b69daff3b617873e6c68110e8afd90b4372889c7c6d4fb9: Status 404 returned error can't find the container with id b91604f6d431cd2e2b69daff3b617873e6c68110e8afd90b4372889c7c6d4fb9
Jun 03 21:34:42.223290 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:42.223246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjfjq" event={"ID":"cf5f89fc-4c76-42fb-9c67-2c541ff27e55","Type":"ContainerStarted","Data":"b91604f6d431cd2e2b69daff3b617873e6c68110e8afd90b4372889c7c6d4fb9"}
Jun 03 21:34:43.228402 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:43.228364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjfjq" event={"ID":"cf5f89fc-4c76-42fb-9c67-2c541ff27e55","Type":"ContainerStarted","Data":"fb2848446fa4463ed0b7ad3386b5c35cc8664851a2f32e9b85fddeaa9c70975e"}
Jun 03 21:34:43.228809 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:43.228438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xjfjq" event={"ID":"cf5f89fc-4c76-42fb-9c67-2c541ff27e55","Type":"ContainerStarted","Data":"a9e68cc120de43fc35d27f4e85a4a025d02ba83bb84b97bc5f5b74ae7edc1568"}
Jun 03 21:34:43.249034 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:43.248976    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xjfjq" podStartSLOduration=253.45363745 podStartE2EDuration="4m14.248957825s" totalImagesPullingTime="795.320375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:34:43.248276921 +0000 UTC m=+254.380454815" watchObservedRunningTime="2026-06-03 21:34:43.248957825 +0000 UTC m=+254.381135689"
Jun 03 21:34:46.287712 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:46.287676    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:46.288122 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:46.287731    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:56.287925 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:56.287835    2574 patch_prober.go:28] interesting pod/image-registry-597f9cc6dc-gtjjm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 21:34:56.287925 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:56.287885    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:34:58.588055 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:34:58.588026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-k2542_76bd295a-c44e-4253-8edb-42f4b787d6f1/cluster-monitoring-operator/0.log"
Jun 03 21:35:00.386391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:00.386365    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfh5l_7b6f78f6-66e5-49e8-8078-be2ad5318f88/init-textfile/0.log"
Jun 03 21:35:00.587131 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:00.587103    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfh5l_7b6f78f6-66e5-49e8-8078-be2ad5318f88/node-exporter/0.log"
Jun 03 21:35:00.789844 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:00.789812    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfh5l_7b6f78f6-66e5-49e8-8078-be2ad5318f88/kube-rbac-proxy/0.log"
Jun 03 21:35:01.302308 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:01.302266    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" podUID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerName="registry" containerID="cri-o://2607d9884da7749f4cbbc012ddf03d5fca9adc802fc0a10afc185f02afd486d2" gracePeriod=30
Jun 03 21:35:02.187853 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:02.187811    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1b8cc2-61da-4a3c-bada-b8aa83057802/init-config-reloader/0.log"
Jun 03 21:35:02.388174 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:02.388152    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1b8cc2-61da-4a3c-bada-b8aa83057802/prometheus/0.log"
Jun 03 21:35:02.586582 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:02.586542    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1b8cc2-61da-4a3c-bada-b8aa83057802/config-reloader/0.log"
Jun 03 21:35:02.788103 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:02.788031    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1b8cc2-61da-4a3c-bada-b8aa83057802/thanos-sidecar/0.log"
Jun 03 21:35:02.988701 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:02.988672    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1b8cc2-61da-4a3c-bada-b8aa83057802/kube-rbac-proxy-web/0.log"
Jun 03 21:35:03.189712 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.189637    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1b8cc2-61da-4a3c-bada-b8aa83057802/kube-rbac-proxy/0.log"
Jun 03 21:35:03.310134 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.310104    2574 generic.go:356] "Generic (PLEG): container finished" podID="23d3ed37-d00f-42f1-96dd-331a0512923d" containerID="2607d9884da7749f4cbbc012ddf03d5fca9adc802fc0a10afc185f02afd486d2" exitCode=0
Jun 03 21:35:03.310315 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.310182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" event={"ID":"23d3ed37-d00f-42f1-96dd-331a0512923d","Type":"ContainerDied","Data":"2607d9884da7749f4cbbc012ddf03d5fca9adc802fc0a10afc185f02afd486d2"}
Jun 03 21:35:03.310315 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.310261    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm" event={"ID":"23d3ed37-d00f-42f1-96dd-331a0512923d","Type":"ContainerStarted","Data":"c15e61feb178125a97c48070c13aa963ff9207337a75ffe694e8b4c278321951"}
Jun 03 21:35:03.310535 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.310521    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:35:03.387135 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.387104    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6e1b8cc2-61da-4a3c-bada-b8aa83057802/kube-rbac-proxy-thanos/0.log"
Jun 03 21:35:03.587953 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.587875    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mwj8f_c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c/prometheus-operator/0.log"
Jun 03 21:35:03.786815 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:03.786787    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mwj8f_c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c/kube-rbac-proxy/0.log"
Jun 03 21:35:06.186529 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:06.186500    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:35:06.392006 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:06.391977    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/2.log"
Jun 03 21:35:08.829886 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:08.829832    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zsrlp" podUID="6b99cda7-8109-4787-920b-b524c81814db"
Jun 03 21:35:08.986632 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:08.986603    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7ls5z_3a88d3f4-f42c-4197-be27-3ae842050c7b/dns-node-resolver/0.log"
Jun 03 21:35:09.186642 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:09.186609    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-597f9cc6dc-gtjjm_23d3ed37-d00f-42f1-96dd-331a0512923d/registry/1.log"
Jun 03 21:35:09.333943 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:09.333918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:35:09.986775 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:09.986748    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzkc7_c3a6c923-856d-40f5-a0d0-674ebaf12949/node-ca/0.log"
Jun 03 21:35:10.585212 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:10.585181    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pkczs_ab289959-f3e9-4378-8150-1aee4cfab20a/serve-healthcheck-canary/0.log"
Jun 03 21:35:12.727706 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:12.727669    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:35:12.730323 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:12.730296    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b99cda7-8109-4787-920b-b524c81814db-metrics-tls\") pod \"dns-default-zsrlp\" (UID: \"6b99cda7-8109-4787-920b-b524c81814db\") " pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:35:12.938006 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:12.937962    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x7hbm\""
Jun 03 21:35:12.945658 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:12.945628    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:35:13.110911 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:13.110884    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zsrlp"]
Jun 03 21:35:13.112488 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:35:13.112461    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b99cda7_8109_4787_920b_b524c81814db.slice/crio-9c40a3936f5075441bc6d907b9563c1551377e11e9f0628c55a82f46fbedabb1 WatchSource:0}: Error finding container 9c40a3936f5075441bc6d907b9563c1551377e11e9f0628c55a82f46fbedabb1: Status 404 returned error can't find the container with id 9c40a3936f5075441bc6d907b9563c1551377e11e9f0628c55a82f46fbedabb1
Jun 03 21:35:13.354204 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:13.354088    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsrlp" event={"ID":"6b99cda7-8109-4787-920b-b524c81814db","Type":"ContainerStarted","Data":"9c40a3936f5075441bc6d907b9563c1551377e11e9f0628c55a82f46fbedabb1"}
Jun 03 21:35:14.708335 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:14.708292    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:14.731882 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:14.731846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:15.363824 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:15.363717    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsrlp" event={"ID":"6b99cda7-8109-4787-920b-b524c81814db","Type":"ContainerStarted","Data":"8d96908b3696fba9745350a96de74fb37300e5db5418ad2960d878b1eeb5f48f"}
Jun 03 21:35:15.363824 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:15.363785    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zsrlp" event={"ID":"6b99cda7-8109-4787-920b-b524c81814db","Type":"ContainerStarted","Data":"4d8290b597d4cfcc77773306db6214ce94c232837b64f1b0cf60cdf0e0ded7a2"}
Jun 03 21:35:15.364261 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:15.364201    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:35:15.382459 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:15.382391    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:15.385106 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:15.385045    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zsrlp" podStartSLOduration=251.497297116 podStartE2EDuration="4m13.385029063s" totalImagesPullingTime="1.887731947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:35:15.383664256 +0000 UTC m=+286.515842121" watchObservedRunningTime="2026-06-03 21:35:15.385029063 +0000 UTC m=+286.517206925"
Jun 03 21:35:24.318601 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:24.318568    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-597f9cc6dc-gtjjm"
Jun 03 21:35:26.374531 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:26.374496    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zsrlp"
Jun 03 21:35:29.249578 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:29.249548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:35:29.250921 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:29.250900    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:35:29.255806 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:29.255775    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:35:29.258853 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:29.258832    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:35:29.267229 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:29.267210    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jun 03 21:35:33.009337 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.009294    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:35:33.012019 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.009709    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="prometheus" containerID="cri-o://5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c" gracePeriod=600
Jun 03 21:35:33.012019 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.009892    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-web" containerID="cri-o://5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24" gracePeriod=600
Jun 03 21:35:33.012019 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.009884    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy" containerID="cri-o://1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9" gracePeriod=600
Jun 03 21:35:33.012019 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.009977    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="thanos-sidecar" containerID="cri-o://671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0" gracePeriod=600
Jun 03 21:35:33.012019 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.010050    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="config-reloader" containerID="cri-o://4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3" gracePeriod=600
Jun 03 21:35:33.012019 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.010192    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224" gracePeriod=600
Jun 03 21:35:33.431200 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431163    2574 generic.go:356] "Generic (PLEG): container finished" podID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerID="dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224" exitCode=0
Jun 03 21:35:33.431200 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431194    2574 generic.go:356] "Generic (PLEG): container finished" podID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerID="1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9" exitCode=0
Jun 03 21:35:33.431200 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431202    2574 generic.go:356] "Generic (PLEG): container finished" podID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerID="671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0" exitCode=0
Jun 03 21:35:33.431200 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431208    2574 generic.go:356] "Generic (PLEG): container finished" podID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerID="4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3" exitCode=0
Jun 03 21:35:33.431200 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431218    2574 generic.go:356] "Generic (PLEG): container finished" podID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerID="5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c" exitCode=0
Jun 03 21:35:33.431536 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431239    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224"}
Jun 03 21:35:33.431536 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431309    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9"}
Jun 03 21:35:33.431536 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0"}
Jun 03 21:35:33.431536 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431361    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3"}
Jun 03 21:35:33.431536 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:33.431385    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c"}
Jun 03 21:35:34.245121 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.245091    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.321906 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.321823    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-thanos-prometheus-http-client-file\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.321906 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.321866    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-grpc-tls\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.321906 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.321892    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.321919    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-db\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.321959    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-web-config\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.321990    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-0\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322016    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-2\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322052    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-trusted-ca-bundle\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322080    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-tls-assets\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322108    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-tls\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322133    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-1\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322164    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-kube-rbac-proxy\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322193    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-metrics-client-ca\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322218    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config-out\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322261    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322289    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ln2p\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-kube-api-access-6ln2p\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322367    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322395    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-serving-certs-ca-bundle\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322447    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-metrics-client-certs\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.322640 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.322475    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-kubelet-serving-ca-bundle\") pod \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\" (UID: \"6e1b8cc2-61da-4a3c-bada-b8aa83057802\") "
Jun 03 21:35:34.323062 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.323037    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 21:35:34.323163 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.323128    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 21:35:34.323706 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.323452    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 21:35:34.323840 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.323755    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 21:35:34.324496 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.324468    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 21:35:34.324853 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.324826    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 21:35:34.325065 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.325038    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 21:35:34.325145 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.325116    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.325663 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.325620    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 21:35:34.325869 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.325823    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.327541 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.327229    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.328538 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.328497    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.328800 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.328777    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 21:35:34.328874 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.328793    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.328998 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.328975    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-kube-api-access-6ln2p" (OuterVolumeSpecName: "kube-api-access-6ln2p") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "kube-api-access-6ln2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 21:35:34.329257 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.329222    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.329454 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.329428    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.329570 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.329546    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config-out" (OuterVolumeSpecName: "config-out") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 21:35:34.329635 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.329619    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config" (OuterVolumeSpecName: "config") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.338011 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.337989    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-web-config" (OuterVolumeSpecName: "web-config") pod "6e1b8cc2-61da-4a3c-bada-b8aa83057802" (UID: "6e1b8cc2-61da-4a3c-bada-b8aa83057802"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 21:35:34.423528 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423489    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423528 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423522    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423528 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423532    2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-metrics-client-certs\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423528 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423540    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423549    2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423559    2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-grpc-tls\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423567    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423576    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-db\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423586    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-web-config\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423594    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423602    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423610    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423618    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-tls-assets\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423625    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423633    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423642    2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-secret-kube-rbac-proxy\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423651    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e1b8cc2-61da-4a3c-bada-b8aa83057802-configmap-metrics-client-ca\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423659    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config-out\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423667    2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6e1b8cc2-61da-4a3c-bada-b8aa83057802-config\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.423791 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.423676    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ln2p\" (UniqueName: \"kubernetes.io/projected/6e1b8cc2-61da-4a3c-bada-b8aa83057802-kube-api-access-6ln2p\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:35:34.437840 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.437802    2574 generic.go:356] "Generic (PLEG): container finished" podID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerID="5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24" exitCode=0
Jun 03 21:35:34.438011 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.437878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24"}
Jun 03 21:35:34.438011 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.437891    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.438011 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.437976    2574 scope.go:117] "RemoveContainer" containerID="dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224"
Jun 03 21:35:34.438166 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.437962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6e1b8cc2-61da-4a3c-bada-b8aa83057802","Type":"ContainerDied","Data":"b703bb3553f1dc6bf4e7f374ccd85c3f2e11f006d860e20ed41c355b9c72513b"}
Jun 03 21:35:34.447590 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.447564    2574 scope.go:117] "RemoveContainer" containerID="1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9"
Jun 03 21:35:34.454353 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.454334    2574 scope.go:117] "RemoveContainer" containerID="5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24"
Jun 03 21:35:34.461069 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.461053    2574 scope.go:117] "RemoveContainer" containerID="671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0"
Jun 03 21:35:34.467558 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.467535    2574 scope.go:117] "RemoveContainer" containerID="4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3"
Jun 03 21:35:34.472169 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.472142    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:35:34.474553 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.474534    2574 scope.go:117] "RemoveContainer" containerID="5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c"
Jun 03 21:35:34.479660 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.479638    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:35:34.482148 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.482131    2574 scope.go:117] "RemoveContainer" containerID="5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d"
Jun 03 21:35:34.488664 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.488650    2574 scope.go:117] "RemoveContainer" containerID="dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224"
Jun 03 21:35:34.488894 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:34.488873    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224\": container with ID starting with dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224 not found: ID does not exist" containerID="dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224"
Jun 03 21:35:34.488950 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.488904    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224"} err="failed to get container status \"dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224\": rpc error: code = NotFound desc = could not find container \"dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224\": container with ID starting with dd1c8fa2e3b3eb6ede5269c995d28e2bf3e71783d5534771032c634ae064e224 not found: ID does not exist"
Jun 03 21:35:34.488950 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.488925    2574 scope.go:117] "RemoveContainer" containerID="1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9"
Jun 03 21:35:34.489180 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:34.489163    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9\": container with ID starting with 1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9 not found: ID does not exist" containerID="1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9"
Jun 03 21:35:34.489233 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489187    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9"} err="failed to get container status \"1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9\": rpc error: code = NotFound desc = could not find container \"1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9\": container with ID starting with 1aa2526c530af51a674dd3d6f7d535df475cea678cb04dc0bfbf016a3775e4a9 not found: ID does not exist"
Jun 03 21:35:34.489233 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489203    2574 scope.go:117] "RemoveContainer" containerID="5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24"
Jun 03 21:35:34.489449 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:34.489433    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24\": container with ID starting with 5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24 not found: ID does not exist" containerID="5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24"
Jun 03 21:35:34.489511 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489457    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24"} err="failed to get container status \"5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24\": rpc error: code = NotFound desc = could not find container \"5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24\": container with ID starting with 5e3a3734afd86e204604c25ca9a26eb4664997b6ee99ca27ec2af2aa61a12e24 not found: ID does not exist"
Jun 03 21:35:34.489511 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489472    2574 scope.go:117] "RemoveContainer" containerID="671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0"
Jun 03 21:35:34.489694 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:34.489678    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0\": container with ID starting with 671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0 not found: ID does not exist" containerID="671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0"
Jun 03 21:35:34.489733 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489698    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0"} err="failed to get container status \"671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0\": rpc error: code = NotFound desc = could not find container \"671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0\": container with ID starting with 671c5f27c657b9d6137de688a64a23462539daab6ed4e80700d2a73aede9b1b0 not found: ID does not exist"
Jun 03 21:35:34.489733 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489710    2574 scope.go:117] "RemoveContainer" containerID="4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3"
Jun 03 21:35:34.489940 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:34.489921    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3\": container with ID starting with 4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3 not found: ID does not exist" containerID="4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3"
Jun 03 21:35:34.489999 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489943    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3"} err="failed to get container status \"4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3\": rpc error: code = NotFound desc = could not find container \"4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3\": container with ID starting with 4f167cae6d96c43566b570ec2da05237dc1a57ac05812d3ed5857696b9959bd3 not found: ID does not exist"
Jun 03 21:35:34.489999 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.489958    2574 scope.go:117] "RemoveContainer" containerID="5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c"
Jun 03 21:35:34.490199 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:34.490181    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c\": container with ID starting with 5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c not found: ID does not exist" containerID="5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c"
Jun 03 21:35:34.490248 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.490201    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c"} err="failed to get container status \"5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c\": rpc error: code = NotFound desc = could not find container \"5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c\": container with ID starting with 5972b79d35f7968cbdae2877fa98ac808e057c560409d423aaaed518c6922f1c not found: ID does not exist"
Jun 03 21:35:34.490248 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.490212    2574 scope.go:117] "RemoveContainer" containerID="5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d"
Jun 03 21:35:34.490490 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:35:34.490473    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d\": container with ID starting with 5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d not found: ID does not exist" containerID="5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d"
Jun 03 21:35:34.490490 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.490491    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d"} err="failed to get container status \"5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d\": rpc error: code = NotFound desc = could not find container \"5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d\": container with ID starting with 5ef13d620f6ae5ed268727aae065eccb13bd93718991921539345a59f0cb244d not found: ID does not exist"
Jun 03 21:35:34.510697 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.510666    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:35:34.510962 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.510948    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-thanos"
Jun 03 21:35:34.511010 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.510964    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-thanos"
Jun 03 21:35:34.511010 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.510974    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-web"
Jun 03 21:35:34.511010 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.510980    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-web"
Jun 03 21:35:34.511010 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.510995    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="init-config-reloader"
Jun 03 21:35:34.511010 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511001    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="init-config-reloader"
Jun 03 21:35:34.511010 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511007    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="config-reloader"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511013    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="config-reloader"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511018    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511023    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511031    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="prometheus"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511036    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="prometheus"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511043    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="thanos-sidecar"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511048    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="thanos-sidecar"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511093    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="thanos-sidecar"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511100    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511106    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-thanos"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511112    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="prometheus"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511118    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="kube-rbac-proxy-web"
Jun 03 21:35:34.511184 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.511123    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" containerName="config-reloader"
Jun 03 21:35:34.517278 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.517246    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.520754 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.520733    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 21:35:34.521033 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.521016    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 21:35:34.521362 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.521342    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 21:35:34.521478 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.521461    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 21:35:34.521596 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.521572    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 21:35:34.521662 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.521593    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 21:35:34.521712 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.521676    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2eb7esesu06u\""
Jun 03 21:35:34.522370 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.522344    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 21:35:34.522512 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.522476    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-thq4v\""
Jun 03 21:35:34.522626 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.522611    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 21:35:34.522814 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.522800    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 21:35:34.523097 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.523078    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 21:35:34.523273 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.523254    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 21:35:34.523385 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.523306    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 21:35:34.523819 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.523698    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 21:35:34.525723 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.525705    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 21:35:34.526891 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.526875    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 21:35:34.533472 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.533444    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:35:34.624726 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624726 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624726 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79frl\" (UniqueName: \"kubernetes.io/projected/bda5e71b-710c-4701-82b3-ec7044b972b2-kube-api-access-79frl\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bda5e71b-710c-4701-82b3-ec7044b972b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.624957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bda5e71b-710c-4701-82b3-ec7044b972b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.624973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625062    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625195 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-config\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625498 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625214    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.625498 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.625252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726461 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726399    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726461 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726462    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726490    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726544    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726564    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-config\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726647    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.726721 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726702    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79frl\" (UniqueName: \"kubernetes.io/projected/bda5e71b-710c-4701-82b3-ec7044b972b2-kube-api-access-79frl\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bda5e71b-710c-4701-82b3-ec7044b972b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726852    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726916    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bda5e71b-710c-4701-82b3-ec7044b972b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727150 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.726967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727635 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.727234    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.727635 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.727462    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.728017 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.727991    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730109 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.729720    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730109 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.729821    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730109 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.729895    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730109 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.729926    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-config\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730109 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.729983    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730109 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.730029    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730483 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.730369    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730555 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.730535    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bda5e71b-710c-4701-82b3-ec7044b972b2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730879 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.730749    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.730879 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.730806    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.731175 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.731149    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.731393 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.731375    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bda5e71b-710c-4701-82b3-ec7044b972b2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.732205 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.732178    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-web-config\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.732546 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.732529    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.732743 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.732724    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bda5e71b-710c-4701-82b3-ec7044b972b2-config-out\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.732895 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.732881    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bda5e71b-710c-4701-82b3-ec7044b972b2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.736666 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.736649    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79frl\" (UniqueName: \"kubernetes.io/projected/bda5e71b-710c-4701-82b3-ec7044b972b2-kube-api-access-79frl\") pod \"prometheus-k8s-0\" (UID: \"bda5e71b-710c-4701-82b3-ec7044b972b2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.827546 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.827504    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:35:34.979839 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:34.979797    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 21:35:34.983646 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:35:34.983618    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda5e71b_710c_4701_82b3_ec7044b972b2.slice/crio-e4ae7bc8cf1b4870b8dd5da5386f9252a1bfce2c5c38b6639b9d49c96d352dd0 WatchSource:0}: Error finding container e4ae7bc8cf1b4870b8dd5da5386f9252a1bfce2c5c38b6639b9d49c96d352dd0: Status 404 returned error can't find the container with id e4ae7bc8cf1b4870b8dd5da5386f9252a1bfce2c5c38b6639b9d49c96d352dd0
Jun 03 21:35:35.317444 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:35.317392    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e1b8cc2-61da-4a3c-bada-b8aa83057802" path="/var/lib/kubelet/pods/6e1b8cc2-61da-4a3c-bada-b8aa83057802/volumes"
Jun 03 21:35:35.443368 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:35.443336    2574 generic.go:356] "Generic (PLEG): container finished" podID="bda5e71b-710c-4701-82b3-ec7044b972b2" containerID="28dd8381194bfa3916fe22c342083361d764b7b2979ec84b40a004406976064d" exitCode=0
Jun 03 21:35:35.443581 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:35.443436    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerDied","Data":"28dd8381194bfa3916fe22c342083361d764b7b2979ec84b40a004406976064d"}
Jun 03 21:35:35.443581 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:35.443507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerStarted","Data":"e4ae7bc8cf1b4870b8dd5da5386f9252a1bfce2c5c38b6639b9d49c96d352dd0"}
Jun 03 21:35:36.450597 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:36.450558    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerStarted","Data":"680260d6d4382b95a47e57b759f848980ae9ef5de56942a43da7eaea7fb079eb"}
Jun 03 21:35:36.451013 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:36.450638    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerStarted","Data":"370ac248f39a892dd30bace6ff3539ffa3ac88ebab1589b6dee465028f5976ee"}
Jun 03 21:35:36.451013 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:36.450677    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerStarted","Data":"e12625a620fcb24c13caf5121be84d029a0ece171724e9bad870c88278389850"}
Jun 03 21:35:36.451013 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:36.450716    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerStarted","Data":"3b8db1bb5ad44945975f4f01ed11539af3906a9a6fa7948fd425d49b87c1660d"}
Jun 03 21:35:36.451013 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:36.450753    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerStarted","Data":"43fcae273f958ca7172d4b648ac88177c54b75f909ce6d28507b37e2df5ec62a"}
Jun 03 21:35:36.451013 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:36.450786    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bda5e71b-710c-4701-82b3-ec7044b972b2","Type":"ContainerStarted","Data":"4b25bd1be7b85f0d373c4e98bde6c83fa55c9d323a007a2aab586e48e3b73748"}
Jun 03 21:35:36.486712 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:36.486660    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.465754472 podStartE2EDuration="2.486639213s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.884741ms" isStatefulPod=false podCreationTimestamp="2026-06-03 21:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:35:36.484174001 +0000 UTC m=+307.616351895" watchObservedRunningTime="2026-06-03 21:35:36.486639213 +0000 UTC m=+307.618817076"
Jun 03 21:35:39.828119 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:35:39.828073    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:36:34.828148 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:36:34.828090    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:36:34.844129 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:36:34.844100    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:36:35.681154 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:36:35.681119    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 21:37:50.033450 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.033340    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"]
Jun 03 21:37:50.036753 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.036729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.041518 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.041493    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 21:37:50.041884 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.041849    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nqwwb\""
Jun 03 21:37:50.042034 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.041899    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 21:37:50.042034 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.041901    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 21:37:50.042461 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.042204    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 21:37:50.058809 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.058774    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"]
Jun 03 21:37:50.151404 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.151356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28a34c47-06a9-4ac1-9cd4-4c857af452f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.151404 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.151398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28a34c47-06a9-4ac1-9cd4-4c857af452f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.151649 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.151491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28a34c47-06a9-4ac1-9cd4-4c857af452f0-manifests\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.151649 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.151562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbz9h\" (UniqueName: \"kubernetes.io/projected/28a34c47-06a9-4ac1-9cd4-4c857af452f0-kube-api-access-zbz9h\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.151649 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.151607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a34c47-06a9-4ac1-9cd4-4c857af452f0-tmp\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.252391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.252352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28a34c47-06a9-4ac1-9cd4-4c857af452f0-manifests\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.252391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.252399    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbz9h\" (UniqueName: \"kubernetes.io/projected/28a34c47-06a9-4ac1-9cd4-4c857af452f0-kube-api-access-zbz9h\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.252664 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.252449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a34c47-06a9-4ac1-9cd4-4c857af452f0-tmp\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.252664 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.252480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28a34c47-06a9-4ac1-9cd4-4c857af452f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.252664 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.252495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28a34c47-06a9-4ac1-9cd4-4c857af452f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.252856 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.252827    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/28a34c47-06a9-4ac1-9cd4-4c857af452f0-manifests\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.254726 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.254700    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a34c47-06a9-4ac1-9cd4-4c857af452f0-tmp\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.255052 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.255030    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/28a34c47-06a9-4ac1-9cd4-4c857af452f0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.255096 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.255030    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/28a34c47-06a9-4ac1-9cd4-4c857af452f0-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.264558 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.264525    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbz9h\" (UniqueName: \"kubernetes.io/projected/28a34c47-06a9-4ac1-9cd4-4c857af452f0-kube-api-access-zbz9h\") pod \"opendatahub-operator-controller-manager-64f56cf757-p49bz\" (UID: \"28a34c47-06a9-4ac1-9cd4-4c857af452f0\") " pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.347192 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.347092    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:50.490055 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.490026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"]
Jun 03 21:37:50.492683 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:37:50.492653    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a34c47_06a9_4ac1_9cd4_4c857af452f0.slice/crio-07052f31f48546794cae643823b32fd09e951762293a6a631e6139ebbb69e02f WatchSource:0}: Error finding container 07052f31f48546794cae643823b32fd09e951762293a6a631e6139ebbb69e02f: Status 404 returned error can't find the container with id 07052f31f48546794cae643823b32fd09e951762293a6a631e6139ebbb69e02f
Jun 03 21:37:50.494406 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.494390    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 21:37:50.946430 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:50.946382    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz" event={"ID":"28a34c47-06a9-4ac1-9cd4-4c857af452f0","Type":"ContainerStarted","Data":"07052f31f48546794cae643823b32fd09e951762293a6a631e6139ebbb69e02f"}
Jun 03 21:37:53.961877 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:53.961847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz" event={"ID":"28a34c47-06a9-4ac1-9cd4-4c857af452f0","Type":"ContainerStarted","Data":"61f2ab0f9a3dc15bfb1ef527e8afcdba1b1a375334a4792d5a55c6051a79d434"}
Jun 03 21:37:54.967502 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:54.967452    2574 generic.go:356] "Generic (PLEG): container finished" podID="28a34c47-06a9-4ac1-9cd4-4c857af452f0" containerID="61f2ab0f9a3dc15bfb1ef527e8afcdba1b1a375334a4792d5a55c6051a79d434" exitCode=0
Jun 03 21:37:54.967966 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:54.967524    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz" event={"ID":"28a34c47-06a9-4ac1-9cd4-4c857af452f0","Type":"ContainerDied","Data":"61f2ab0f9a3dc15bfb1ef527e8afcdba1b1a375334a4792d5a55c6051a79d434"}
Jun 03 21:37:55.978238 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:55.978170    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz" event={"ID":"28a34c47-06a9-4ac1-9cd4-4c857af452f0","Type":"ContainerStarted","Data":"fcc27888a6906d6215b211cf5580961e8fb4dbbc5b53df122a67d57e65ff8371"}
Jun 03 21:37:55.978742 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:55.978322    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:37:56.020223 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:37:56.020169    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz" podStartSLOduration=1.804448421 podStartE2EDuration="6.020150868s" totalImagesPullingTime="3.146221833s" totalInitContainerRuntime="1.069480614s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:37:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:37:56.019298693 +0000 UTC m=+447.151476567" watchObservedRunningTime="2026-06-03 21:37:56.020150868 +0000 UTC m=+447.152328731"
Jun 03 21:38:06.984580 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:06.984548    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64f56cf757-p49bz"
Jun 03 21:38:09.612843 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.612802    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"]
Jun 03 21:38:09.622256 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.622219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.625103 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.625079    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 21:38:09.625225 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.625104    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 21:38:09.625406 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.625390    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 21:38:09.625511 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.625475    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 21:38:09.654635 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.654596    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"]
Jun 03 21:38:09.721650 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.721616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d886ea-f4e7-43e0-8ee1-69006c7461e1-tls-certs\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.721837 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.721674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16d886ea-f4e7-43e0-8ee1-69006c7461e1-tmp\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.721837 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.721760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-259z9\" (UniqueName: \"kubernetes.io/projected/16d886ea-f4e7-43e0-8ee1-69006c7461e1-kube-api-access-259z9\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.822577 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.822538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d886ea-f4e7-43e0-8ee1-69006c7461e1-tls-certs\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.822750 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.822625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16d886ea-f4e7-43e0-8ee1-69006c7461e1-tmp\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.822750 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.822662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-259z9\" (UniqueName: \"kubernetes.io/projected/16d886ea-f4e7-43e0-8ee1-69006c7461e1-kube-api-access-259z9\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.825074 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.825044    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16d886ea-f4e7-43e0-8ee1-69006c7461e1-tmp\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.825198 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.825185    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d886ea-f4e7-43e0-8ee1-69006c7461e1-tls-certs\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.841587 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.841550    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-259z9\" (UniqueName: \"kubernetes.io/projected/16d886ea-f4e7-43e0-8ee1-69006c7461e1-kube-api-access-259z9\") pod \"kube-auth-proxy-cc8d6f7f7-kkflg\" (UID: \"16d886ea-f4e7-43e0-8ee1-69006c7461e1\") " pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:09.871598 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.871510    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-g2blh"]
Jun 03 21:38:09.873733 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.873715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:09.876822 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.876789    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-p2z5f\""
Jun 03 21:38:09.876985 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.876966    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 03 21:38:09.892951 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.892917    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-g2blh"]
Jun 03 21:38:09.931403 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:09.931354    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"
Jun 03 21:38:10.024074 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.024031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68zt2\" (UniqueName: \"kubernetes.io/projected/e778268d-828d-4f1d-ba08-49db8e83bc94-kube-api-access-68zt2\") pod \"odh-model-controller-6dc94f689f-g2blh\" (UID: \"e778268d-828d-4f1d-ba08-49db8e83bc94\") " pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.024253 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.024142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e778268d-828d-4f1d-ba08-49db8e83bc94-cert\") pod \"odh-model-controller-6dc94f689f-g2blh\" (UID: \"e778268d-828d-4f1d-ba08-49db8e83bc94\") " pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.077136 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.077110    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg"]
Jun 03 21:38:10.079529 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:10.079499    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d886ea_f4e7_43e0_8ee1_69006c7461e1.slice/crio-41d49db72af081c4d98c9d1cb4fe0091607ea82f199687c8a51a2767acff85b7 WatchSource:0}: Error finding container 41d49db72af081c4d98c9d1cb4fe0091607ea82f199687c8a51a2767acff85b7: Status 404 returned error can't find the container with id 41d49db72af081c4d98c9d1cb4fe0091607ea82f199687c8a51a2767acff85b7
Jun 03 21:38:10.125345 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.125266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68zt2\" (UniqueName: \"kubernetes.io/projected/e778268d-828d-4f1d-ba08-49db8e83bc94-kube-api-access-68zt2\") pod \"odh-model-controller-6dc94f689f-g2blh\" (UID: \"e778268d-828d-4f1d-ba08-49db8e83bc94\") " pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.125345 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.125310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e778268d-828d-4f1d-ba08-49db8e83bc94-cert\") pod \"odh-model-controller-6dc94f689f-g2blh\" (UID: \"e778268d-828d-4f1d-ba08-49db8e83bc94\") " pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.125549 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:38:10.125428    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 03 21:38:10.125549 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:38:10.125482    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e778268d-828d-4f1d-ba08-49db8e83bc94-cert podName:e778268d-828d-4f1d-ba08-49db8e83bc94 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:10.625467152 +0000 UTC m=+461.757644993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e778268d-828d-4f1d-ba08-49db8e83bc94-cert") pod "odh-model-controller-6dc94f689f-g2blh" (UID: "e778268d-828d-4f1d-ba08-49db8e83bc94") : secret "odh-model-controller-webhook-cert" not found
Jun 03 21:38:10.137699 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.137674    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68zt2\" (UniqueName: \"kubernetes.io/projected/e778268d-828d-4f1d-ba08-49db8e83bc94-kube-api-access-68zt2\") pod \"odh-model-controller-6dc94f689f-g2blh\" (UID: \"e778268d-828d-4f1d-ba08-49db8e83bc94\") " pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.629748 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.629687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e778268d-828d-4f1d-ba08-49db8e83bc94-cert\") pod \"odh-model-controller-6dc94f689f-g2blh\" (UID: \"e778268d-828d-4f1d-ba08-49db8e83bc94\") " pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.632125 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.632102    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e778268d-828d-4f1d-ba08-49db8e83bc94-cert\") pod \"odh-model-controller-6dc94f689f-g2blh\" (UID: \"e778268d-828d-4f1d-ba08-49db8e83bc94\") " pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.784928 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.784885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:10.796767 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.796736    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r944h"]
Jun 03 21:38:10.799801 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.799774    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:10.805375 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.805289    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 03 21:38:10.822243 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.822178    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r944h"]
Jun 03 21:38:10.932484 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.932144    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nlws\" (UniqueName: \"kubernetes.io/projected/02a20b3c-641c-4316-b13d-c9756f73dc6b-kube-api-access-9nlws\") pod \"model-serving-api-5dd488fc48-r944h\" (UID: \"02a20b3c-641c-4316-b13d-c9756f73dc6b\") " pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:10.932484 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.932229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02a20b3c-641c-4316-b13d-c9756f73dc6b-tls-certs\") pod \"model-serving-api-5dd488fc48-r944h\" (UID: \"02a20b3c-641c-4316-b13d-c9756f73dc6b\") " pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:10.966155 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:10.965895    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-g2blh"]
Jun 03 21:38:10.969241 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:10.969207    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode778268d_828d_4f1d_ba08_49db8e83bc94.slice/crio-e79f3dc1c709038acfe38746a15d3333d4d26da506229b86b1cbc8830e7e8d04 WatchSource:0}: Error finding container e79f3dc1c709038acfe38746a15d3333d4d26da506229b86b1cbc8830e7e8d04: Status 404 returned error can't find the container with id e79f3dc1c709038acfe38746a15d3333d4d26da506229b86b1cbc8830e7e8d04
Jun 03 21:38:11.033154 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.033116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02a20b3c-641c-4316-b13d-c9756f73dc6b-tls-certs\") pod \"model-serving-api-5dd488fc48-r944h\" (UID: \"02a20b3c-641c-4316-b13d-c9756f73dc6b\") " pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:11.033347 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.033231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nlws\" (UniqueName: \"kubernetes.io/projected/02a20b3c-641c-4316-b13d-c9756f73dc6b-kube-api-access-9nlws\") pod \"model-serving-api-5dd488fc48-r944h\" (UID: \"02a20b3c-641c-4316-b13d-c9756f73dc6b\") " pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:11.033347 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:38:11.033254    2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 03 21:38:11.033347 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:38:11.033334    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a20b3c-641c-4316-b13d-c9756f73dc6b-tls-certs podName:02a20b3c-641c-4316-b13d-c9756f73dc6b nodeName:}" failed. No retries permitted until 2026-06-03 21:38:11.533313927 +0000 UTC m=+462.665491770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/02a20b3c-641c-4316-b13d-c9756f73dc6b-tls-certs") pod "model-serving-api-5dd488fc48-r944h" (UID: "02a20b3c-641c-4316-b13d-c9756f73dc6b") : secret "model-serving-api-tls" not found
Jun 03 21:38:11.039271 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.039234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg" event={"ID":"16d886ea-f4e7-43e0-8ee1-69006c7461e1","Type":"ContainerStarted","Data":"41d49db72af081c4d98c9d1cb4fe0091607ea82f199687c8a51a2767acff85b7"}
Jun 03 21:38:11.040985 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.040922    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-g2blh" event={"ID":"e778268d-828d-4f1d-ba08-49db8e83bc94","Type":"ContainerStarted","Data":"e79f3dc1c709038acfe38746a15d3333d4d26da506229b86b1cbc8830e7e8d04"}
Jun 03 21:38:11.050234 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.050208    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nlws\" (UniqueName: \"kubernetes.io/projected/02a20b3c-641c-4316-b13d-c9756f73dc6b-kube-api-access-9nlws\") pod \"model-serving-api-5dd488fc48-r944h\" (UID: \"02a20b3c-641c-4316-b13d-c9756f73dc6b\") " pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:11.538966 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.538924    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02a20b3c-641c-4316-b13d-c9756f73dc6b-tls-certs\") pod \"model-serving-api-5dd488fc48-r944h\" (UID: \"02a20b3c-641c-4316-b13d-c9756f73dc6b\") " pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:11.542699 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.542582    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02a20b3c-641c-4316-b13d-c9756f73dc6b-tls-certs\") pod \"model-serving-api-5dd488fc48-r944h\" (UID: \"02a20b3c-641c-4316-b13d-c9756f73dc6b\") " pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:11.714794 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:11.714753    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:14.452383 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:14.452354    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-r944h"]
Jun 03 21:38:14.455966 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:14.455942    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a20b3c_641c_4316_b13d_c9756f73dc6b.slice/crio-f70ac964b480b7f24d8a6ed8f2c779842337731508cefc4d00dc72d60ad40121 WatchSource:0}: Error finding container f70ac964b480b7f24d8a6ed8f2c779842337731508cefc4d00dc72d60ad40121: Status 404 returned error can't find the container with id f70ac964b480b7f24d8a6ed8f2c779842337731508cefc4d00dc72d60ad40121
Jun 03 21:38:15.062751 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:15.062704    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-r944h" event={"ID":"02a20b3c-641c-4316-b13d-c9756f73dc6b","Type":"ContainerStarted","Data":"f70ac964b480b7f24d8a6ed8f2c779842337731508cefc4d00dc72d60ad40121"}
Jun 03 21:38:15.064590 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:15.064546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg" event={"ID":"16d886ea-f4e7-43e0-8ee1-69006c7461e1","Type":"ContainerStarted","Data":"c863a5a5ed42d76481f6a963f0935f0f305789228ac443d8010bf83b748894ad"}
Jun 03 21:38:15.066437 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:15.066393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-g2blh" event={"ID":"e778268d-828d-4f1d-ba08-49db8e83bc94","Type":"ContainerStarted","Data":"e41d462b02b339120ce82516d1afede044f004e1c0d0b45e10cbdc8f018449d3"}
Jun 03 21:38:15.066576 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:15.066528    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:15.085216 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:15.085160    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cc8d6f7f7-kkflg" podStartSLOduration=1.839283516 podStartE2EDuration="6.085140599s" totalImagesPullingTime="4.245857083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:15.08277039 +0000 UTC m=+466.214948276" watchObservedRunningTime="2026-06-03 21:38:15.085140599 +0000 UTC m=+466.217318495"
Jun 03 21:38:15.104119 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:15.104059    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-g2blh" podStartSLOduration=2.716621431 podStartE2EDuration="6.104037327s" totalImagesPullingTime="3.387415896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:15.10167728 +0000 UTC m=+466.233855154" watchObservedRunningTime="2026-06-03 21:38:15.104037327 +0000 UTC m=+466.236215192"
Jun 03 21:38:17.076354 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:17.076314    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-r944h" event={"ID":"02a20b3c-641c-4316-b13d-c9756f73dc6b","Type":"ContainerStarted","Data":"610b2e90fc92d70d756742b9be623bf4e4e04e09c0d4ec7546d1acd3449e2155"}
Jun 03 21:38:17.076762 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:17.076430    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:17.134707 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:17.134658    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-r944h" podStartSLOduration=5.317383887 podStartE2EDuration="7.13464022s" totalImagesPullingTime="1.817256333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:17.13361185 +0000 UTC m=+468.265789713" watchObservedRunningTime="2026-06-03 21:38:17.13464022 +0000 UTC m=+468.266818082"
Jun 03 21:38:20.857805 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.857772    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-fml2n"]
Jun 03 21:38:20.860530 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.860507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:20.863662 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.863642    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 03 21:38:20.863662 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.863647    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rvvnr\""
Jun 03 21:38:20.874321 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.874291    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-fml2n"]
Jun 03 21:38:20.880678 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.880651    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"]
Jun 03 21:38:20.883857 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.883836    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:20.887204 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.887182    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 03 21:38:20.887871 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.887849    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m62n7\""
Jun 03 21:38:20.900020 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:20.899997    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"]
Jun 03 21:38:21.020289 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.020249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113cca90-7688-468d-a979-c889512d8ee1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-84lr9\" (UID: \"113cca90-7688-468d-a979-c889512d8ee1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:21.020289 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.020292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-cert\") pod \"kserve-controller-manager-69fc866d76-fml2n\" (UID: \"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.020596 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.020373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwnz8\" (UniqueName: \"kubernetes.io/projected/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-kube-api-access-bwnz8\") pod \"kserve-controller-manager-69fc866d76-fml2n\" (UID: \"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.020596 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.020465    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x82dl\" (UniqueName: \"kubernetes.io/projected/113cca90-7688-468d-a979-c889512d8ee1-kube-api-access-x82dl\") pod \"llmisvc-controller-manager-864bfd7bc9-84lr9\" (UID: \"113cca90-7688-468d-a979-c889512d8ee1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:21.121701 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.121606    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-cert\") pod \"kserve-controller-manager-69fc866d76-fml2n\" (UID: \"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.121701 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.121674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwnz8\" (UniqueName: \"kubernetes.io/projected/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-kube-api-access-bwnz8\") pod \"kserve-controller-manager-69fc866d76-fml2n\" (UID: \"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.121916 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.121724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82dl\" (UniqueName: \"kubernetes.io/projected/113cca90-7688-468d-a979-c889512d8ee1-kube-api-access-x82dl\") pod \"llmisvc-controller-manager-864bfd7bc9-84lr9\" (UID: \"113cca90-7688-468d-a979-c889512d8ee1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:21.121916 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.121763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113cca90-7688-468d-a979-c889512d8ee1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-84lr9\" (UID: \"113cca90-7688-468d-a979-c889512d8ee1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:21.121916 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:38:21.121768    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jun 03 21:38:21.121916 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:38:21.121851    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-cert podName:74f9e480-bcee-498b-9ef8-2ff54e0cbfb6 nodeName:}" failed. No retries permitted until 2026-06-03 21:38:21.621830967 +0000 UTC m=+472.754008822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-cert") pod "kserve-controller-manager-69fc866d76-fml2n" (UID: "74f9e480-bcee-498b-9ef8-2ff54e0cbfb6") : secret "kserve-webhook-server-cert" not found
Jun 03 21:38:21.124126 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.124104    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113cca90-7688-468d-a979-c889512d8ee1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-84lr9\" (UID: \"113cca90-7688-468d-a979-c889512d8ee1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:21.140251 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.140226    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x82dl\" (UniqueName: \"kubernetes.io/projected/113cca90-7688-468d-a979-c889512d8ee1-kube-api-access-x82dl\") pod \"llmisvc-controller-manager-864bfd7bc9-84lr9\" (UID: \"113cca90-7688-468d-a979-c889512d8ee1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:21.140505 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.140487    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwnz8\" (UniqueName: \"kubernetes.io/projected/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-kube-api-access-bwnz8\") pod \"kserve-controller-manager-69fc866d76-fml2n\" (UID: \"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.193765 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.193712    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:21.336163 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.336009    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"]
Jun 03 21:38:21.338195 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:21.338171    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod113cca90_7688_468d_a979_c889512d8ee1.slice/crio-7c02bdfe2238bb8236c3b248c754adedda651834d837ba601aa8f3ef3ea55e8b WatchSource:0}: Error finding container 7c02bdfe2238bb8236c3b248c754adedda651834d837ba601aa8f3ef3ea55e8b: Status 404 returned error can't find the container with id 7c02bdfe2238bb8236c3b248c754adedda651834d837ba601aa8f3ef3ea55e8b
Jun 03 21:38:21.625846 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.625793    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-cert\") pod \"kserve-controller-manager-69fc866d76-fml2n\" (UID: \"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.628235 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.628209    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74f9e480-bcee-498b-9ef8-2ff54e0cbfb6-cert\") pod \"kserve-controller-manager-69fc866d76-fml2n\" (UID: \"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.770908 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.770856    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:21.913688 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:21.913658    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-fml2n"]
Jun 03 21:38:21.930520 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:21.930481    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f9e480_bcee_498b_9ef8_2ff54e0cbfb6.slice/crio-7cdb4b8a590e19ad87088795d53de7a6f4d0666fe25a4e2e9928d3a55aa952dc WatchSource:0}: Error finding container 7cdb4b8a590e19ad87088795d53de7a6f4d0666fe25a4e2e9928d3a55aa952dc: Status 404 returned error can't find the container with id 7cdb4b8a590e19ad87088795d53de7a6f4d0666fe25a4e2e9928d3a55aa952dc
Jun 03 21:38:22.098978 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:22.098940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9" event={"ID":"113cca90-7688-468d-a979-c889512d8ee1","Type":"ContainerStarted","Data":"7c02bdfe2238bb8236c3b248c754adedda651834d837ba601aa8f3ef3ea55e8b"}
Jun 03 21:38:22.100172 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:22.100143    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n" event={"ID":"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6","Type":"ContainerStarted","Data":"7cdb4b8a590e19ad87088795d53de7a6f4d0666fe25a4e2e9928d3a55aa952dc"}
Jun 03 21:38:25.116288 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:25.116248    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9" event={"ID":"113cca90-7688-468d-a979-c889512d8ee1","Type":"ContainerStarted","Data":"9e23738e9f1fa3de9eee08e96d0cdc487b13e4f2195142a2662b393c74e5077b"}
Jun 03 21:38:25.116761 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:25.116403    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:25.117656 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:25.117634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n" event={"ID":"74f9e480-bcee-498b-9ef8-2ff54e0cbfb6","Type":"ContainerStarted","Data":"f0718a4dddfb98d3c527912984bcdc87f9a3569255ac706571edc6cd42239e73"}
Jun 03 21:38:25.117706 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:25.117676    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:38:25.141164 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:25.141112    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9" podStartSLOduration=1.5830482080000001 podStartE2EDuration="5.141095232s" totalImagesPullingTime="3.558047024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:25.140761574 +0000 UTC m=+476.272939439" watchObservedRunningTime="2026-06-03 21:38:25.141095232 +0000 UTC m=+476.273273140"
Jun 03 21:38:25.168812 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:25.168718    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n" podStartSLOduration=2.201627272 podStartE2EDuration="5.168699239s" totalImagesPullingTime="2.967071967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:25.166693411 +0000 UTC m=+476.298871275" watchObservedRunningTime="2026-06-03 21:38:25.168699239 +0000 UTC m=+476.300877105"
Jun 03 21:38:26.073071 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:26.073044    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-g2blh"
Jun 03 21:38:28.086064 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:28.086037    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-r944h"
Jun 03 21:38:29.834844 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.834810    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"]
Jun 03 21:38:29.839873 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.839847    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:29.843200 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.843172    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 03 21:38:29.843378 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.843355    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-9lsxq\""
Jun 03 21:38:29.845762 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.845744    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 03 21:38:29.942508 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.942475    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"]
Jun 03 21:38:29.998882 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.998837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a62f20a4-f91a-40e3-bbc8-b02b1707f56d-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vv2nn\" (UID: \"a62f20a4-f91a-40e3-bbc8-b02b1707f56d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:29.999061 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:29.998906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwhd8\" (UniqueName: \"kubernetes.io/projected/a62f20a4-f91a-40e3-bbc8-b02b1707f56d-kube-api-access-bwhd8\") pod \"servicemesh-operator3-57f65f65fb-vv2nn\" (UID: \"a62f20a4-f91a-40e3-bbc8-b02b1707f56d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:30.099572 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:30.099493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a62f20a4-f91a-40e3-bbc8-b02b1707f56d-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vv2nn\" (UID: \"a62f20a4-f91a-40e3-bbc8-b02b1707f56d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:30.099572 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:30.099567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwhd8\" (UniqueName: \"kubernetes.io/projected/a62f20a4-f91a-40e3-bbc8-b02b1707f56d-kube-api-access-bwhd8\") pod \"servicemesh-operator3-57f65f65fb-vv2nn\" (UID: \"a62f20a4-f91a-40e3-bbc8-b02b1707f56d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:30.102190 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:30.102167    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a62f20a4-f91a-40e3-bbc8-b02b1707f56d-operator-config\") pod \"servicemesh-operator3-57f65f65fb-vv2nn\" (UID: \"a62f20a4-f91a-40e3-bbc8-b02b1707f56d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:30.111273 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:30.111250    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwhd8\" (UniqueName: \"kubernetes.io/projected/a62f20a4-f91a-40e3-bbc8-b02b1707f56d-kube-api-access-bwhd8\") pod \"servicemesh-operator3-57f65f65fb-vv2nn\" (UID: \"a62f20a4-f91a-40e3-bbc8-b02b1707f56d\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:30.149662 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:30.149626    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:30.304395 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:30.304358    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"]
Jun 03 21:38:30.307720 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:30.307694    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62f20a4_f91a_40e3_bbc8_b02b1707f56d.slice/crio-80e7bd46fc13e5ea2028507c44dc49c7373e92b6f72ca3926d69adbea703c3f3 WatchSource:0}: Error finding container 80e7bd46fc13e5ea2028507c44dc49c7373e92b6f72ca3926d69adbea703c3f3: Status 404 returned error can't find the container with id 80e7bd46fc13e5ea2028507c44dc49c7373e92b6f72ca3926d69adbea703c3f3
Jun 03 21:38:31.150093 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:31.150052    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn" event={"ID":"a62f20a4-f91a-40e3-bbc8-b02b1707f56d","Type":"ContainerStarted","Data":"80e7bd46fc13e5ea2028507c44dc49c7373e92b6f72ca3926d69adbea703c3f3"}
Jun 03 21:38:33.167524 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:33.167486    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn" event={"ID":"a62f20a4-f91a-40e3-bbc8-b02b1707f56d","Type":"ContainerStarted","Data":"b9203a796d6d68b6b93818dce5fa8958a625d554467bba9c3b4d476633e320a0"}
Jun 03 21:38:33.167948 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:33.167584    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:33.206075 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:33.206007    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn" podStartSLOduration=1.869252054 podStartE2EDuration="4.205984378s" totalImagesPullingTime="2.336732324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:33.203334998 +0000 UTC m=+484.335512875" watchObservedRunningTime="2026-06-03 21:38:33.205984378 +0000 UTC m=+484.338162241"
Jun 03 21:38:36.722251 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.722212    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"]
Jun 03 21:38:36.725708 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.725686    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.728634 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.728601    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 03 21:38:36.728812 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.728798    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 21:38:36.728866 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.728826    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 03 21:38:36.729002 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.728983    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 03 21:38:36.729047 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.729027    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j9px5\""
Jun 03 21:38:36.742891 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.742854    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"]
Jun 03 21:38:36.763888 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.763849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdqdd\" (UniqueName: \"kubernetes.io/projected/7bf130e6-1169-4f07-8c55-377ca91df72f-kube-api-access-cdqdd\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.764087 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.763905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.764087 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.763987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.764087 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.764011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.764087 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.764048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.764237 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.764097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf130e6-1169-4f07-8c55-377ca91df72f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.764237 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.764138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.865328 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.865280    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.865328 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.865330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.865688 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.865364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.865688 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.865396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf130e6-1169-4f07-8c55-377ca91df72f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.865688 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.865466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.865688 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.865514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdqdd\" (UniqueName: \"kubernetes.io/projected/7bf130e6-1169-4f07-8c55-377ca91df72f-kube-api-access-cdqdd\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.865688 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.865548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.866134 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.866063    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.868483 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.868458    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.868629 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.868485    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bf130e6-1169-4f07-8c55-377ca91df72f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.868629 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.868565    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.868629 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.868597    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7bf130e6-1169-4f07-8c55-377ca91df72f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.875680 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.875647    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bf130e6-1169-4f07-8c55-377ca91df72f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:36.876967 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:36.876945    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdqdd\" (UniqueName: \"kubernetes.io/projected/7bf130e6-1169-4f07-8c55-377ca91df72f-kube-api-access-cdqdd\") pod \"istiod-openshift-gateway-75c67f8887-mscmc\" (UID: \"7bf130e6-1169-4f07-8c55-377ca91df72f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:37.035191 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:37.035090    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:37.181716 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:37.181578    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"]
Jun 03 21:38:37.184053 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:37.184013    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf130e6_1169_4f07_8c55_377ca91df72f.slice/crio-c781f4e412bad43aa441d8b6fc9c6cbce6e07478e7692aa9c1ddab4d90849382 WatchSource:0}: Error finding container c781f4e412bad43aa441d8b6fc9c6cbce6e07478e7692aa9c1ddab4d90849382: Status 404 returned error can't find the container with id c781f4e412bad43aa441d8b6fc9c6cbce6e07478e7692aa9c1ddab4d90849382
Jun 03 21:38:38.192457 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:38.192394    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc" event={"ID":"7bf130e6-1169-4f07-8c55-377ca91df72f","Type":"ContainerStarted","Data":"c781f4e412bad43aa441d8b6fc9c6cbce6e07478e7692aa9c1ddab4d90849382"}
Jun 03 21:38:39.699389 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:39.699346    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 21:38:39.699700 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:39.699435    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 21:38:40.204426 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:40.204374    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc" event={"ID":"7bf130e6-1169-4f07-8c55-377ca91df72f","Type":"ContainerStarted","Data":"fa893d914d4e8bb99aa3379aabe896061607c0e6fe9259f5f6f3f4a4787a4521"}
Jun 03 21:38:40.204630 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:40.204595    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:40.206194 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:40.206158    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-mscmc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 03 21:38:40.206335 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:40.206211    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc" podUID="7bf130e6-1169-4f07-8c55-377ca91df72f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:38:40.231282 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:40.231228    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc" podStartSLOduration=1.71805274 podStartE2EDuration="4.231213161s" totalImagesPullingTime="2.513160421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:40.230760079 +0000 UTC m=+491.362937960" watchObservedRunningTime="2026-06-03 21:38:40.231213161 +0000 UTC m=+491.363391025"
Jun 03 21:38:41.209652 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:41.209614    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-mscmc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 03 21:38:41.210044 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:41.209666    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc" podUID="7bf130e6-1169-4f07-8c55-377ca91df72f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 21:38:44.175358 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:44.175329    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-vv2nn"
Jun 03 21:38:44.210001 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:44.209967    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mscmc"
Jun 03 21:38:46.205466 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.205407    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"]
Jun 03 21:38:46.211197 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.211169    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.214648 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.214619    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 21:38:46.214834 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.214668    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mtgvp\""
Jun 03 21:38:46.246632 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.246587    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"]
Jun 03 21:38:46.256802 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.256772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0eb8e128-414d-4abb-b0e4-3807dc5e72ab-redirect-config\") pod \"dashboard-redirect-5cc66d9bff-lkbdt\" (UID: \"0eb8e128-414d-4abb-b0e4-3807dc5e72ab\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.256972 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.256817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t87w\" (UniqueName: \"kubernetes.io/projected/0eb8e128-414d-4abb-b0e4-3807dc5e72ab-kube-api-access-2t87w\") pod \"dashboard-redirect-5cc66d9bff-lkbdt\" (UID: \"0eb8e128-414d-4abb-b0e4-3807dc5e72ab\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.357628 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.357591    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0eb8e128-414d-4abb-b0e4-3807dc5e72ab-redirect-config\") pod \"dashboard-redirect-5cc66d9bff-lkbdt\" (UID: \"0eb8e128-414d-4abb-b0e4-3807dc5e72ab\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.357806 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.357650    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t87w\" (UniqueName: \"kubernetes.io/projected/0eb8e128-414d-4abb-b0e4-3807dc5e72ab-kube-api-access-2t87w\") pod \"dashboard-redirect-5cc66d9bff-lkbdt\" (UID: \"0eb8e128-414d-4abb-b0e4-3807dc5e72ab\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.358372 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.358352    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0eb8e128-414d-4abb-b0e4-3807dc5e72ab-redirect-config\") pod \"dashboard-redirect-5cc66d9bff-lkbdt\" (UID: \"0eb8e128-414d-4abb-b0e4-3807dc5e72ab\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.376317 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.376289    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t87w\" (UniqueName: \"kubernetes.io/projected/0eb8e128-414d-4abb-b0e4-3807dc5e72ab-kube-api-access-2t87w\") pod \"dashboard-redirect-5cc66d9bff-lkbdt\" (UID: \"0eb8e128-414d-4abb-b0e4-3807dc5e72ab\") " pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.524301 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.524208    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"
Jun 03 21:38:46.692046 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:46.692012    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5cc66d9bff-lkbdt"]
Jun 03 21:38:46.695839 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:38:46.695813    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb8e128_414d_4abb_b0e4_3807dc5e72ab.slice/crio-6f6d47df7e4edf949e3f828820898b87c376cf2a068af5119322958b12eea666 WatchSource:0}: Error finding container 6f6d47df7e4edf949e3f828820898b87c376cf2a068af5119322958b12eea666: Status 404 returned error can't find the container with id 6f6d47df7e4edf949e3f828820898b87c376cf2a068af5119322958b12eea666
Jun 03 21:38:47.238970 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:47.238936    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt" event={"ID":"0eb8e128-414d-4abb-b0e4-3807dc5e72ab","Type":"ContainerStarted","Data":"6f6d47df7e4edf949e3f828820898b87c376cf2a068af5119322958b12eea666"}
Jun 03 21:38:52.264597 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:52.264559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt" event={"ID":"0eb8e128-414d-4abb-b0e4-3807dc5e72ab","Type":"ContainerStarted","Data":"39d127063dfca4aa9e72607ec9dd20466d1f8e0510fb6fcb1019cce8b33bfbf8"}
Jun 03 21:38:52.282649 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:52.282593    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5cc66d9bff-lkbdt" podStartSLOduration=1.702364869 podStartE2EDuration="6.282578941s" totalImagesPullingTime="4.580214072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:38:52.282295518 +0000 UTC m=+503.414473380" watchObservedRunningTime="2026-06-03 21:38:52.282578941 +0000 UTC m=+503.414756841"
Jun 03 21:38:56.125241 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:56.125196    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-84lr9"
Jun 03 21:38:56.128191 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:38:56.128167    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-fml2n"
Jun 03 21:39:43.218544 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.218448    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"]
Jun 03 21:39:43.233496 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.233467    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"
Jun 03 21:39:43.238535 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.238512    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 21:39:43.238685 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.238536    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 21:39:43.244818 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.244798    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-24lpc\""
Jun 03 21:39:43.264651 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.264617    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"]
Jun 03 21:39:43.356089 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.356044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z544s\" (UniqueName: \"kubernetes.io/projected/03265547-ce3f-4060-b17e-b900d851c1df-kube-api-access-z544s\") pod \"authorino-operator-75cc8d5cb7-zcm8h\" (UID: \"03265547-ce3f-4060-b17e-b900d851c1df\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"
Jun 03 21:39:43.456813 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.456771    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z544s\" (UniqueName: \"kubernetes.io/projected/03265547-ce3f-4060-b17e-b900d851c1df-kube-api-access-z544s\") pod \"authorino-operator-75cc8d5cb7-zcm8h\" (UID: \"03265547-ce3f-4060-b17e-b900d851c1df\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"
Jun 03 21:39:43.471902 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.471827    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z544s\" (UniqueName: \"kubernetes.io/projected/03265547-ce3f-4060-b17e-b900d851c1df-kube-api-access-z544s\") pod \"authorino-operator-75cc8d5cb7-zcm8h\" (UID: \"03265547-ce3f-4060-b17e-b900d851c1df\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"
Jun 03 21:39:43.543818 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.543775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"
Jun 03 21:39:43.704224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:43.704194    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"]
Jun 03 21:39:43.706864 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:39:43.706835    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03265547_ce3f_4060_b17e_b900d851c1df.slice/crio-e39fb5e53080cdd8b5a10ee3cd3fb9de00b32c6f0399e44ddb975e3025ac0e40 WatchSource:0}: Error finding container e39fb5e53080cdd8b5a10ee3cd3fb9de00b32c6f0399e44ddb975e3025ac0e40: Status 404 returned error can't find the container with id e39fb5e53080cdd8b5a10ee3cd3fb9de00b32c6f0399e44ddb975e3025ac0e40
Jun 03 21:39:44.496983 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:44.496943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h" event={"ID":"03265547-ce3f-4060-b17e-b900d851c1df","Type":"ContainerStarted","Data":"e39fb5e53080cdd8b5a10ee3cd3fb9de00b32c6f0399e44ddb975e3025ac0e40"}
Jun 03 21:39:46.508084 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:46.508046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h" event={"ID":"03265547-ce3f-4060-b17e-b900d851c1df","Type":"ContainerStarted","Data":"09cf31aa197c66fbb5777bc701d273b1e40e72f21c7e41e3184ecc8e86ad33a9"}
Jun 03 21:39:46.508473 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:46.508122    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"
Jun 03 21:39:46.533728 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:46.533677    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h" podStartSLOduration=1.3870727139999999 podStartE2EDuration="3.53365655s" totalImagesPullingTime="2.146583836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:39:46.532285434 +0000 UTC m=+557.664463297" watchObservedRunningTime="2026-06-03 21:39:46.53365655 +0000 UTC m=+557.665834414"
Jun 03 21:39:57.514662 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:39:57.514632    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zcm8h"
Jun 03 21:40:06.678661 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.678625    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"]
Jun 03 21:40:06.681046 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.681024    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"
Jun 03 21:40:06.684224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.684131    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fpr86\""
Jun 03 21:40:06.695613 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.695588    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"]
Jun 03 21:40:06.869962 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.869923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4587\" (UniqueName: \"kubernetes.io/projected/58a2b441-403f-4829-a8d7-ce5d82b88a11-kube-api-access-x4587\") pod \"limitador-operator-controller-manager-859d7b78bd-fkrl6\" (UID: \"58a2b441-403f-4829-a8d7-ce5d82b88a11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"
Jun 03 21:40:06.970949 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.970856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4587\" (UniqueName: \"kubernetes.io/projected/58a2b441-403f-4829-a8d7-ce5d82b88a11-kube-api-access-x4587\") pod \"limitador-operator-controller-manager-859d7b78bd-fkrl6\" (UID: \"58a2b441-403f-4829-a8d7-ce5d82b88a11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"
Jun 03 21:40:06.980560 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.980534    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4587\" (UniqueName: \"kubernetes.io/projected/58a2b441-403f-4829-a8d7-ce5d82b88a11-kube-api-access-x4587\") pod \"limitador-operator-controller-manager-859d7b78bd-fkrl6\" (UID: \"58a2b441-403f-4829-a8d7-ce5d82b88a11\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"
Jun 03 21:40:06.992005 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:06.991976    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"
Jun 03 21:40:07.123784 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:07.123756    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"]
Jun 03 21:40:07.125837 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:40:07.125810    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a2b441_403f_4829_a8d7_ce5d82b88a11.slice/crio-512638cf6cc86a590382cc5a853a2667bb7a0861dcd57ee1e03736fa11a47864 WatchSource:0}: Error finding container 512638cf6cc86a590382cc5a853a2667bb7a0861dcd57ee1e03736fa11a47864: Status 404 returned error can't find the container with id 512638cf6cc86a590382cc5a853a2667bb7a0861dcd57ee1e03736fa11a47864
Jun 03 21:40:07.605370 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:07.605340    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6" event={"ID":"58a2b441-403f-4829-a8d7-ce5d82b88a11","Type":"ContainerStarted","Data":"512638cf6cc86a590382cc5a853a2667bb7a0861dcd57ee1e03736fa11a47864"}
Jun 03 21:40:09.616334 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:09.616293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6" event={"ID":"58a2b441-403f-4829-a8d7-ce5d82b88a11","Type":"ContainerStarted","Data":"85981266319e3a26fedce35a8d495388131737d0219dd75490f553fe94f34eb6"}
Jun 03 21:40:09.616776 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:09.616434    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"
Jun 03 21:40:09.640493 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:09.640437    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6" podStartSLOduration=2.217543504 podStartE2EDuration="3.640402841s" totalImagesPullingTime="1.422859337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:40:09.639967791 +0000 UTC m=+580.772145655" watchObservedRunningTime="2026-06-03 21:40:09.640402841 +0000 UTC m=+580.772580706"
Jun 03 21:40:20.628380 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:20.628348    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkrl6"
Jun 03 21:40:29.284692 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:29.284661    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:40:29.285151 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:29.284847    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:40:29.288730 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:29.288702    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:40:29.288998 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:40:29.288982    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:42:11.233252 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.233211    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d7ccc8897-57vd5"]
Jun 03 21:42:11.236015 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.235989    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:11.242002 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.241977    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tnbc9\""
Jun 03 21:42:11.243274 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.243250    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 21:42:11.251133 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.251101    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d7ccc8897-57vd5"]
Jun 03 21:42:11.402545 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.402503    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkxzd\" (UniqueName: \"kubernetes.io/projected/75c20f13-ac06-40ad-b214-23d24fffa58e-kube-api-access-jkxzd\") pod \"maas-controller-d7ccc8897-57vd5\" (UID: \"75c20f13-ac06-40ad-b214-23d24fffa58e\") " pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:11.424690 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.424658    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66dc97c488-zbq6f"]
Jun 03 21:42:11.427206 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.427187    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:42:11.437917 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.437886    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66dc97c488-zbq6f"]
Jun 03 21:42:11.503625 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.503526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkxzd\" (UniqueName: \"kubernetes.io/projected/75c20f13-ac06-40ad-b214-23d24fffa58e-kube-api-access-jkxzd\") pod \"maas-controller-d7ccc8897-57vd5\" (UID: \"75c20f13-ac06-40ad-b214-23d24fffa58e\") " pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:11.503625 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.503577    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q9tl\" (UniqueName: \"kubernetes.io/projected/a4fcdbf4-1f77-47be-81bf-7937aaba4981-kube-api-access-8q9tl\") pod \"maas-controller-66dc97c488-zbq6f\" (UID: \"a4fcdbf4-1f77-47be-81bf-7937aaba4981\") " pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:42:11.514212 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.514176    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkxzd\" (UniqueName: \"kubernetes.io/projected/75c20f13-ac06-40ad-b214-23d24fffa58e-kube-api-access-jkxzd\") pod \"maas-controller-d7ccc8897-57vd5\" (UID: \"75c20f13-ac06-40ad-b214-23d24fffa58e\") " pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:11.547186 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.547150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:11.605094 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.605063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q9tl\" (UniqueName: \"kubernetes.io/projected/a4fcdbf4-1f77-47be-81bf-7937aaba4981-kube-api-access-8q9tl\") pod \"maas-controller-66dc97c488-zbq6f\" (UID: \"a4fcdbf4-1f77-47be-81bf-7937aaba4981\") " pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:42:11.616196 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.616161    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q9tl\" (UniqueName: \"kubernetes.io/projected/a4fcdbf4-1f77-47be-81bf-7937aaba4981-kube-api-access-8q9tl\") pod \"maas-controller-66dc97c488-zbq6f\" (UID: \"a4fcdbf4-1f77-47be-81bf-7937aaba4981\") " pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:42:11.682625 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.682594    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d7ccc8897-57vd5"]
Jun 03 21:42:11.685374 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:42:11.685343    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c20f13_ac06_40ad_b214_23d24fffa58e.slice/crio-6e829aa435078c71d547c49c46308130c41e93588be55fcfa15a5be3eca01423 WatchSource:0}: Error finding container 6e829aa435078c71d547c49c46308130c41e93588be55fcfa15a5be3eca01423: Status 404 returned error can't find the container with id 6e829aa435078c71d547c49c46308130c41e93588be55fcfa15a5be3eca01423
Jun 03 21:42:11.738116 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.738077    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:42:11.872441 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:11.872386    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66dc97c488-zbq6f"]
Jun 03 21:42:11.874519 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:42:11.874496    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fcdbf4_1f77_47be_81bf_7937aaba4981.slice/crio-a723d30afddac0669d270a396e064abd9a76e0cfc9cadc613243c5f0f16f580d WatchSource:0}: Error finding container a723d30afddac0669d270a396e064abd9a76e0cfc9cadc613243c5f0f16f580d: Status 404 returned error can't find the container with id a723d30afddac0669d270a396e064abd9a76e0cfc9cadc613243c5f0f16f580d
Jun 03 21:42:12.201573 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:12.201532    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66dc97c488-zbq6f" event={"ID":"a4fcdbf4-1f77-47be-81bf-7937aaba4981","Type":"ContainerStarted","Data":"a723d30afddac0669d270a396e064abd9a76e0cfc9cadc613243c5f0f16f580d"}
Jun 03 21:42:12.202965 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:12.202933    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d7ccc8897-57vd5" event={"ID":"75c20f13-ac06-40ad-b214-23d24fffa58e","Type":"ContainerStarted","Data":"6e829aa435078c71d547c49c46308130c41e93588be55fcfa15a5be3eca01423"}
Jun 03 21:42:15.222105 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:15.222068    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66dc97c488-zbq6f" event={"ID":"a4fcdbf4-1f77-47be-81bf-7937aaba4981","Type":"ContainerStarted","Data":"35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771"}
Jun 03 21:42:15.222581 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:15.222179    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:42:15.223525 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:15.223500    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d7ccc8897-57vd5" event={"ID":"75c20f13-ac06-40ad-b214-23d24fffa58e","Type":"ContainerStarted","Data":"498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b"}
Jun 03 21:42:15.223642 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:15.223551    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:15.251315 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:15.251261    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66dc97c488-zbq6f" podStartSLOduration=1.938859146 podStartE2EDuration="4.251244915s" totalImagesPullingTime="2.312385769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:15.245642851 +0000 UTC m=+706.377820716" watchObservedRunningTime="2026-06-03 21:42:15.251244915 +0000 UTC m=+706.383422815"
Jun 03 21:42:15.270351 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:15.270282    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d7ccc8897-57vd5" podStartSLOduration=1.762107537 podStartE2EDuration="4.270264663s" totalImagesPullingTime="2.508157126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:15.267708314 +0000 UTC m=+706.399886199" watchObservedRunningTime="2026-06-03 21:42:15.270264663 +0000 UTC m=+706.402442527"
Jun 03 21:42:26.233873 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.233793    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:42:26.233873 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.233858    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:26.299350 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.299311    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d7ccc8897-57vd5"]
Jun 03 21:42:26.299548 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.299527    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d7ccc8897-57vd5" podUID="75c20f13-ac06-40ad-b214-23d24fffa58e" containerName="manager" containerID="cri-o://498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b" gracePeriod=30
Jun 03 21:42:26.549969 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.549939    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:26.631215 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.631176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkxzd\" (UniqueName: \"kubernetes.io/projected/75c20f13-ac06-40ad-b214-23d24fffa58e-kube-api-access-jkxzd\") pod \"75c20f13-ac06-40ad-b214-23d24fffa58e\" (UID: \"75c20f13-ac06-40ad-b214-23d24fffa58e\") "
Jun 03 21:42:26.633579 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.633542    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c20f13-ac06-40ad-b214-23d24fffa58e-kube-api-access-jkxzd" (OuterVolumeSpecName: "kube-api-access-jkxzd") pod "75c20f13-ac06-40ad-b214-23d24fffa58e" (UID: "75c20f13-ac06-40ad-b214-23d24fffa58e"). InnerVolumeSpecName "kube-api-access-jkxzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 21:42:26.732042 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:26.732004    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkxzd\" (UniqueName: \"kubernetes.io/projected/75c20f13-ac06-40ad-b214-23d24fffa58e-kube-api-access-jkxzd\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:42:27.279318 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.279283    2574 generic.go:356] "Generic (PLEG): container finished" podID="75c20f13-ac06-40ad-b214-23d24fffa58e" containerID="498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b" exitCode=0
Jun 03 21:42:27.279794 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.279325    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d7ccc8897-57vd5"
Jun 03 21:42:27.279794 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.279358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d7ccc8897-57vd5" event={"ID":"75c20f13-ac06-40ad-b214-23d24fffa58e","Type":"ContainerDied","Data":"498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b"}
Jun 03 21:42:27.279794 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.279406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d7ccc8897-57vd5" event={"ID":"75c20f13-ac06-40ad-b214-23d24fffa58e","Type":"ContainerDied","Data":"6e829aa435078c71d547c49c46308130c41e93588be55fcfa15a5be3eca01423"}
Jun 03 21:42:27.279794 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.279451    2574 scope.go:117] "RemoveContainer" containerID="498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b"
Jun 03 21:42:27.288619 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.288597    2574 scope.go:117] "RemoveContainer" containerID="498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b"
Jun 03 21:42:27.288885 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:42:27.288865    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b\": container with ID starting with 498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b not found: ID does not exist" containerID="498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b"
Jun 03 21:42:27.288932 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.288894    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b"} err="failed to get container status \"498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b\": rpc error: code = NotFound desc = could not find container \"498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b\": container with ID starting with 498f16bc1bd81f360771da0a70fd5f407838641e3924acd1bf0ee02926d9f45b not found: ID does not exist"
Jun 03 21:42:27.305620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.305593    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d7ccc8897-57vd5"]
Jun 03 21:42:27.310923 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.310893    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d7ccc8897-57vd5"]
Jun 03 21:42:27.317866 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:27.317843    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75c20f13-ac06-40ad-b214-23d24fffa58e" path="/var/lib/kubelet/pods/75c20f13-ac06-40ad-b214-23d24fffa58e/volumes"
Jun 03 21:42:45.499487 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.499440    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-59cf5bd49d-cbp2g"]
Jun 03 21:42:45.499972 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.499817    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c20f13-ac06-40ad-b214-23d24fffa58e" containerName="manager"
Jun 03 21:42:45.499972 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.499829    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c20f13-ac06-40ad-b214-23d24fffa58e" containerName="manager"
Jun 03 21:42:45.499972 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.499888    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c20f13-ac06-40ad-b214-23d24fffa58e" containerName="manager"
Jun 03 21:42:45.502556 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.502537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.506766 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.506744    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 03 21:42:45.506981 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.506968    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n2bc7\""
Jun 03 21:42:45.520583 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.520550    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-59cf5bd49d-cbp2g"]
Jun 03 21:42:45.599237 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.599190    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrrz\" (UniqueName: \"kubernetes.io/projected/11803ea1-b529-41ee-886f-762915356ed1-kube-api-access-skrrz\") pod \"maas-api-59cf5bd49d-cbp2g\" (UID: \"11803ea1-b529-41ee-886f-762915356ed1\") " pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.599434 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.599259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11803ea1-b529-41ee-886f-762915356ed1-maas-api-tls\") pod \"maas-api-59cf5bd49d-cbp2g\" (UID: \"11803ea1-b529-41ee-886f-762915356ed1\") " pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.699850 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.699813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrrz\" (UniqueName: \"kubernetes.io/projected/11803ea1-b529-41ee-886f-762915356ed1-kube-api-access-skrrz\") pod \"maas-api-59cf5bd49d-cbp2g\" (UID: \"11803ea1-b529-41ee-886f-762915356ed1\") " pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.700103 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.700082    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11803ea1-b529-41ee-886f-762915356ed1-maas-api-tls\") pod \"maas-api-59cf5bd49d-cbp2g\" (UID: \"11803ea1-b529-41ee-886f-762915356ed1\") " pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.702930 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.702904    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11803ea1-b529-41ee-886f-762915356ed1-maas-api-tls\") pod \"maas-api-59cf5bd49d-cbp2g\" (UID: \"11803ea1-b529-41ee-886f-762915356ed1\") " pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.711464 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.711437    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrrz\" (UniqueName: \"kubernetes.io/projected/11803ea1-b529-41ee-886f-762915356ed1-kube-api-access-skrrz\") pod \"maas-api-59cf5bd49d-cbp2g\" (UID: \"11803ea1-b529-41ee-886f-762915356ed1\") " pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.812693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.812602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:45.931154 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.931121    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-9hl5p"]
Jun 03 21:42:45.934579 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.934542    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-9hl5p"
Jun 03 21:42:45.937736 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.937711    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 03 21:42:45.937915 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.937897    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8xr2q\""
Jun 03 21:42:45.951002 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.950977    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-9hl5p"]
Jun 03 21:42:45.971116 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:45.971082    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-59cf5bd49d-cbp2g"]
Jun 03 21:42:45.973257 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:42:45.973227    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11803ea1_b529_41ee_886f_762915356ed1.slice/crio-b322500dcd07b3cfe8c79a166e81ea6b8b2afd51646a21bc05816ec8eae70989 WatchSource:0}: Error finding container b322500dcd07b3cfe8c79a166e81ea6b8b2afd51646a21bc05816ec8eae70989: Status 404 returned error can't find the container with id b322500dcd07b3cfe8c79a166e81ea6b8b2afd51646a21bc05816ec8eae70989
Jun 03 21:42:46.002705 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:46.002678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bd2\" (UniqueName: \"kubernetes.io/projected/001cfbc6-0797-43b3-bf8d-2ff3db0a5a23-kube-api-access-27bd2\") pod \"payload-processing-7c6c859784-9hl5p\" (UID: \"001cfbc6-0797-43b3-bf8d-2ff3db0a5a23\") " pod="openshift-ingress/payload-processing-7c6c859784-9hl5p"
Jun 03 21:42:46.103320 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:46.103234    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bd2\" (UniqueName: \"kubernetes.io/projected/001cfbc6-0797-43b3-bf8d-2ff3db0a5a23-kube-api-access-27bd2\") pod \"payload-processing-7c6c859784-9hl5p\" (UID: \"001cfbc6-0797-43b3-bf8d-2ff3db0a5a23\") " pod="openshift-ingress/payload-processing-7c6c859784-9hl5p"
Jun 03 21:42:46.112465 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:46.112442    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bd2\" (UniqueName: \"kubernetes.io/projected/001cfbc6-0797-43b3-bf8d-2ff3db0a5a23-kube-api-access-27bd2\") pod \"payload-processing-7c6c859784-9hl5p\" (UID: \"001cfbc6-0797-43b3-bf8d-2ff3db0a5a23\") " pod="openshift-ingress/payload-processing-7c6c859784-9hl5p"
Jun 03 21:42:46.245827 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:46.245795    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-9hl5p"
Jun 03 21:42:46.368663 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:46.368586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-59cf5bd49d-cbp2g" event={"ID":"11803ea1-b529-41ee-886f-762915356ed1","Type":"ContainerStarted","Data":"b322500dcd07b3cfe8c79a166e81ea6b8b2afd51646a21bc05816ec8eae70989"}
Jun 03 21:42:46.390559 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:46.390530    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-9hl5p"]
Jun 03 21:42:46.392045 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:42:46.392013    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001cfbc6_0797_43b3_bf8d_2ff3db0a5a23.slice/crio-56dbc279e266414c17f432e5f84212257a9e0facc1dc567c6a8cdb2885b0470d WatchSource:0}: Error finding container 56dbc279e266414c17f432e5f84212257a9e0facc1dc567c6a8cdb2885b0470d: Status 404 returned error can't find the container with id 56dbc279e266414c17f432e5f84212257a9e0facc1dc567c6a8cdb2885b0470d
Jun 03 21:42:47.378456 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:47.378362    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-9hl5p" event={"ID":"001cfbc6-0797-43b3-bf8d-2ff3db0a5a23","Type":"ContainerStarted","Data":"56dbc279e266414c17f432e5f84212257a9e0facc1dc567c6a8cdb2885b0470d"}
Jun 03 21:42:48.385910 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:48.385865    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-59cf5bd49d-cbp2g" event={"ID":"11803ea1-b529-41ee-886f-762915356ed1","Type":"ContainerStarted","Data":"3e0e0ba22e02620c552f5c3c5d2c8b529f25c0fe89de060ef6e35b1ddac2148a"}
Jun 03 21:42:48.386346 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:48.385937    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:42:48.410262 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:48.410209    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-59cf5bd49d-cbp2g" podStartSLOduration=1.896992432 podStartE2EDuration="3.410190994s" totalImagesPullingTime="1.513198562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:48.408320165 +0000 UTC m=+739.540498030" watchObservedRunningTime="2026-06-03 21:42:48.410190994 +0000 UTC m=+739.542368857"
Jun 03 21:42:49.391910 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:49.391868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-9hl5p" event={"ID":"001cfbc6-0797-43b3-bf8d-2ff3db0a5a23","Type":"ContainerStarted","Data":"24df30574e473f57e93ac017f349cc4c5ef819c29c90849197192bf07c95301e"}
Jun 03 21:42:49.392319 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:49.392080    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-9hl5p"
Jun 03 21:42:49.412684 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:49.412632    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-9hl5p" podStartSLOduration=2.10005133 podStartE2EDuration="4.412616277s" totalImagesPullingTime="2.312564947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:42:49.411426046 +0000 UTC m=+740.543603928" watchObservedRunningTime="2026-06-03 21:42:49.412616277 +0000 UTC m=+740.544794141"
Jun 03 21:42:54.397714 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:42:54.397683    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-59cf5bd49d-cbp2g"
Jun 03 21:43:00.398277 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:00.398250    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-9hl5p"
Jun 03 21:43:43.794564 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.794520    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"]
Jun 03 21:43:43.797451 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.797400    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:43.800843 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.800811    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zbpp4\""
Jun 03 21:43:43.801928 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.801901    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 03 21:43:43.803031 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.803008    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 21:43:43.803366 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.803351    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 21:43:43.815516 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.815485    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"]
Jun 03 21:43:43.909650 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.909607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:43.909837 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.909663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lsd8\" (UniqueName: \"kubernetes.io/projected/9d4700d3-b28c-4e1d-82f8-9686e20febea-kube-api-access-7lsd8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:43.909837 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.909733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:43.909837 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.909777    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4700d3-b28c-4e1d-82f8-9686e20febea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:43.909837 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.909805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:43.909977 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:43.909857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.010572 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.010530    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.010572 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.010581    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4700d3-b28c-4e1d-82f8-9686e20febea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.010820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.010610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.010820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.010627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.010820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.010667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.010820 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.010714    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lsd8\" (UniqueName: \"kubernetes.io/projected/9d4700d3-b28c-4e1d-82f8-9686e20febea-kube-api-access-7lsd8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.011090 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.011011    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.011090 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.011048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.011090 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.011065    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.012968 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.012944    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d4700d3-b28c-4e1d-82f8-9686e20febea-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.013254 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.013235    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d4700d3-b28c-4e1d-82f8-9686e20febea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.020072 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.020050    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lsd8\" (UniqueName: \"kubernetes.io/projected/9d4700d3-b28c-4e1d-82f8-9686e20febea-kube-api-access-7lsd8\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8\" (UID: \"9d4700d3-b28c-4e1d-82f8-9686e20febea\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.114353 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.114250    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:44.256837 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.256807    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"]
Jun 03 21:43:44.258693 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:43:44.258666    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4700d3_b28c_4e1d_82f8_9686e20febea.slice/crio-b175fb096d17d587deba5fbcb266389c70d0b0bc15fa787ff0827c994686c33e WatchSource:0}: Error finding container b175fb096d17d587deba5fbcb266389c70d0b0bc15fa787ff0827c994686c33e: Status 404 returned error can't find the container with id b175fb096d17d587deba5fbcb266389c70d0b0bc15fa787ff0827c994686c33e
Jun 03 21:43:44.261022 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.261000    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 21:43:44.649429 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:44.649379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8" event={"ID":"9d4700d3-b28c-4e1d-82f8-9686e20febea","Type":"ContainerStarted","Data":"b175fb096d17d587deba5fbcb266389c70d0b0bc15fa787ff0827c994686c33e"}
Jun 03 21:43:48.673471 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:48.673408    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8" event={"ID":"9d4700d3-b28c-4e1d-82f8-9686e20febea","Type":"ContainerStarted","Data":"ae11886503a847add87e5c3a4fa7192845f1af960feea92f479aa0f1bb511237"}
Jun 03 21:43:49.680776 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:49.680684    2574 generic.go:356] "Generic (PLEG): container finished" podID="9d4700d3-b28c-4e1d-82f8-9686e20febea" containerID="ae11886503a847add87e5c3a4fa7192845f1af960feea92f479aa0f1bb511237" exitCode=0
Jun 03 21:43:49.680776 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:49.680734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8" event={"ID":"9d4700d3-b28c-4e1d-82f8-9686e20febea","Type":"ContainerDied","Data":"ae11886503a847add87e5c3a4fa7192845f1af960feea92f479aa0f1bb511237"}
Jun 03 21:43:51.212488 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.212451    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"]
Jun 03 21:43:51.216520 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.216494    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.219244 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.219218    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 03 21:43:51.241330 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.241294    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"]
Jun 03 21:43:51.280427 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.280368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.280620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.280438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvgfb\" (UniqueName: \"kubernetes.io/projected/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-kube-api-access-jvgfb\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.280620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.280471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.280620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.280499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.280620 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.280610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.280823 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.280651    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382006 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.381960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382111    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382147    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvgfb\" (UniqueName: \"kubernetes.io/projected/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-kube-api-access-jvgfb\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382224 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382544 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382350    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382544 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382536    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382813 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382780    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.382939 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.382797    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.384390 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.384371    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.384693 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.384673    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.408171 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.408136    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvgfb\" (UniqueName: \"kubernetes.io/projected/7f8d1f26-ed3a-424b-9cc9-7542b739a5a2-kube-api-access-jvgfb\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ln49x\" (UID: \"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.528712 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.528607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:43:51.680346 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.680317    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"]
Jun 03 21:43:51.680791 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:43:51.680763    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8d1f26_ed3a_424b_9cc9_7542b739a5a2.slice/crio-27ca66c6bbf761dae17227b219f5c6c9e1a0de9f8cd4e17410036751bb6c3326 WatchSource:0}: Error finding container 27ca66c6bbf761dae17227b219f5c6c9e1a0de9f8cd4e17410036751bb6c3326: Status 404 returned error can't find the container with id 27ca66c6bbf761dae17227b219f5c6c9e1a0de9f8cd4e17410036751bb6c3326
Jun 03 21:43:51.693519 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.693465    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8" event={"ID":"9d4700d3-b28c-4e1d-82f8-9686e20febea","Type":"ContainerStarted","Data":"4647077e51a834cbcb8c0f89ca7c28c49b44ef1f9475dc7ce1e5c152ed644e88"}
Jun 03 21:43:51.694745 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.694722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x" event={"ID":"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2","Type":"ContainerStarted","Data":"27ca66c6bbf761dae17227b219f5c6c9e1a0de9f8cd4e17410036751bb6c3326"}
Jun 03 21:43:51.723495 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:51.723389    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8" podStartSLOduration=2.502311609 podStartE2EDuration="8.723370598s" totalImagesPullingTime="4.867366764s" totalInitContainerRuntime="1.353692225s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:43:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:43:51.720668624 +0000 UTC m=+802.852846488" watchObservedRunningTime="2026-06-03 21:43:51.723370598 +0000 UTC m=+802.855548460"
Jun 03 21:43:52.701534 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:52.701486    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x" event={"ID":"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2","Type":"ContainerStarted","Data":"eedb421ee09fe83fef97c77788d87da1731f80cf5315fb952ca9804b630d444c"}
Jun 03 21:43:53.707992 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:53.707954    2574 generic.go:356] "Generic (PLEG): container finished" podID="7f8d1f26-ed3a-424b-9cc9-7542b739a5a2" containerID="eedb421ee09fe83fef97c77788d87da1731f80cf5315fb952ca9804b630d444c" exitCode=0
Jun 03 21:43:53.708400 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:53.708043    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x" event={"ID":"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2","Type":"ContainerDied","Data":"eedb421ee09fe83fef97c77788d87da1731f80cf5315fb952ca9804b630d444c"}
Jun 03 21:43:54.114567 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:54.114519    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:54.114754 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:54.114586    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:54.127628 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:54.127597    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:54.715335 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:54.715293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x" event={"ID":"7f8d1f26-ed3a-424b-9cc9-7542b739a5a2","Type":"ContainerStarted","Data":"b1255ee924b50ba07c5aa0f411925a6677b6d512ad4e8a8bed0668d849b684ee"}
Jun 03 21:43:54.727402 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:54.727372    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8"
Jun 03 21:43:54.739283 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:43:54.739231    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x" podStartSLOduration=2.182865907 podStartE2EDuration="3.739213204s" totalImagesPullingTime="221.635309ms" totalInitContainerRuntime="1.334711988s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:43:54.737808307 +0000 UTC m=+805.869986185" watchObservedRunningTime="2026-06-03 21:43:54.739213204 +0000 UTC m=+805.871391065"
Jun 03 21:44:01.528862 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:01.528814    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:44:01.529360 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:01.528886    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:44:01.541488 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:01.541459    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:44:01.761812 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:01.761781    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ln49x"
Jun 03 21:44:13.510516 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.510478    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"]
Jun 03 21:44:13.524033 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.523994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.526112 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.526086    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"]
Jun 03 21:44:13.527047 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.527029    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 03 21:44:13.590851 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.590813    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.590851 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.590856    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh2x5\" (UniqueName: \"kubernetes.io/projected/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-kube-api-access-wh2x5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.591098 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.590894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.591098 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.590909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.591098 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.590926    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.591098 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.591015    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.691691 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.691649    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.691691 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.691694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2x5\" (UniqueName: \"kubernetes.io/projected/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-kube-api-access-wh2x5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.691897 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.691737    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.691897 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.691754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.691897 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.691770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.691897 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.691816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.692147 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.692124    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.692206 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.692124    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.692255 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.692203    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.693987 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.693960    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.694264 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.694246    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.702552 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.702532    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh2x5\" (UniqueName: \"kubernetes.io/projected/33e14a4c-8181-47f6-8e9e-8b8e018ddbcb-kube-api-access-wh2x5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29\" (UID: \"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.835081 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.835004    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:13.978446 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:13.978403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"]
Jun 03 21:44:13.981319 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:44:13.981294    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e14a4c_8181_47f6_8e9e_8b8e018ddbcb.slice/crio-3d672178aa53e931ae819fb16ee37b90ccc82f689184a7d3b8e5b5b4d2e45edc WatchSource:0}: Error finding container 3d672178aa53e931ae819fb16ee37b90ccc82f689184a7d3b8e5b5b4d2e45edc: Status 404 returned error can't find the container with id 3d672178aa53e931ae819fb16ee37b90ccc82f689184a7d3b8e5b5b4d2e45edc
Jun 03 21:44:14.815513 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:14.815481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29" event={"ID":"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb","Type":"ContainerStarted","Data":"66dd60dba5ffce192ad01d7327d146ac536bb2ba94cee99ded44508063a5ca79"}
Jun 03 21:44:14.815889 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:14.815540    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29" event={"ID":"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb","Type":"ContainerStarted","Data":"3d672178aa53e931ae819fb16ee37b90ccc82f689184a7d3b8e5b5b4d2e45edc"}
Jun 03 21:44:15.821805 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:15.821770    2574 generic.go:356] "Generic (PLEG): container finished" podID="33e14a4c-8181-47f6-8e9e-8b8e018ddbcb" containerID="66dd60dba5ffce192ad01d7327d146ac536bb2ba94cee99ded44508063a5ca79" exitCode=0
Jun 03 21:44:15.822190 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:15.821857    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29" event={"ID":"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb","Type":"ContainerDied","Data":"66dd60dba5ffce192ad01d7327d146ac536bb2ba94cee99ded44508063a5ca79"}
Jun 03 21:44:16.829119 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:16.829076    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29" event={"ID":"33e14a4c-8181-47f6-8e9e-8b8e018ddbcb","Type":"ContainerStarted","Data":"c9471b178d72536839cc4f133b66373c2eaa1cfeb9203c02f05b2832b9da0647"}
Jun 03 21:44:16.853014 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:16.852963    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29" podStartSLOduration=2.360773213 podStartE2EDuration="3.852948196s" totalImagesPullingTime="225.851818ms" totalInitContainerRuntime="1.266323165s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:44:16.851644151 +0000 UTC m=+827.983822055" watchObservedRunningTime="2026-06-03 21:44:16.852948196 +0000 UTC m=+827.985126059"
Jun 03 21:44:23.835203 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:23.835166    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:23.835629 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:23.835233    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:23.847809 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:23.847774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:23.880002 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:23.879965    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29"
Jun 03 21:44:36.109230 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.109193    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"]
Jun 03 21:44:36.113292 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.113272    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.116573 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.116556    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 03 21:44:36.124162 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.124138    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"]
Jun 03 21:44:36.189362 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.189325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.189566 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.189378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.189566 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.189447    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.189566 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.189487    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.189566 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.189537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dnbm\" (UniqueName: \"kubernetes.io/projected/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-kube-api-access-7dnbm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.189796 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.189672    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290398 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290587 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dnbm\" (UniqueName: \"kubernetes.io/projected/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-kube-api-access-7dnbm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290587 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290488    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290587 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290587 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290587 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290836 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290796    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290907 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290884    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.290907 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.290898    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.292767 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.292745    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.292913 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.292895    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.299002 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.298979    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dnbm\" (UniqueName: \"kubernetes.io/projected/81483c7d-1fc9-4f3f-90b0-e8a5ef2690de-kube-api-access-7dnbm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd\" (UID: \"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.424965 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.424926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:36.772472 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.772445    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"]
Jun 03 21:44:36.774977 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:44:36.774947    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81483c7d_1fc9_4f3f_90b0_e8a5ef2690de.slice/crio-f0169fc8afe0658cd0ccfa924a5a35056cfaea574dec3dab280f404632f977a0 WatchSource:0}: Error finding container f0169fc8afe0658cd0ccfa924a5a35056cfaea574dec3dab280f404632f977a0: Status 404 returned error can't find the container with id f0169fc8afe0658cd0ccfa924a5a35056cfaea574dec3dab280f404632f977a0
Jun 03 21:44:36.936993 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.936950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd" event={"ID":"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de","Type":"ContainerStarted","Data":"f777abe09d39d8519c77184406752b0bf313a061dd8e8cb448ae81e68c0affdb"}
Jun 03 21:44:36.937152 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:36.937014    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd" event={"ID":"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de","Type":"ContainerStarted","Data":"f0169fc8afe0658cd0ccfa924a5a35056cfaea574dec3dab280f404632f977a0"}
Jun 03 21:44:38.947511 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:38.947475    2574 generic.go:356] "Generic (PLEG): container finished" podID="81483c7d-1fc9-4f3f-90b0-e8a5ef2690de" containerID="f777abe09d39d8519c77184406752b0bf313a061dd8e8cb448ae81e68c0affdb" exitCode=0
Jun 03 21:44:38.947877 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:38.947546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd" event={"ID":"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de","Type":"ContainerDied","Data":"f777abe09d39d8519c77184406752b0bf313a061dd8e8cb448ae81e68c0affdb"}
Jun 03 21:44:39.954178 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:39.954138    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd" event={"ID":"81483c7d-1fc9-4f3f-90b0-e8a5ef2690de","Type":"ContainerStarted","Data":"d01d08f44fa1cbf1362e27a9c0cac210ff20b5f6127acc56216834fb0cf864ff"}
Jun 03 21:44:39.977957 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:39.977909    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd" podStartSLOduration=2.583342037 podStartE2EDuration="3.97789476s" totalImagesPullingTime="196.683172ms" totalInitContainerRuntime="1.197869551s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:44:39.97601803 +0000 UTC m=+851.108195893" watchObservedRunningTime="2026-06-03 21:44:39.97789476 +0000 UTC m=+851.110072622"
Jun 03 21:44:46.425602 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:46.425559    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:46.426030 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:46.425670    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:46.438092 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:46.438062    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:44:47.001746 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:44:47.001709    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd"
Jun 03 21:45:29.329738 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:45:29.329654    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:45:29.330270 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:45:29.330148    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:45:29.334070 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:45:29.334043    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:45:29.334472 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:45:29.334456    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:47:10.341717 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.341679    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66dc97c488-zbq6f"]
Jun 03 21:47:10.342241 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.341891    2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-66dc97c488-zbq6f" podUID="a4fcdbf4-1f77-47be-81bf-7937aaba4981" containerName="manager" containerID="cri-o://35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771" gracePeriod=30
Jun 03 21:47:10.591240 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.591214    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:47:10.650391 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.650359    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q9tl\" (UniqueName: \"kubernetes.io/projected/a4fcdbf4-1f77-47be-81bf-7937aaba4981-kube-api-access-8q9tl\") pod \"a4fcdbf4-1f77-47be-81bf-7937aaba4981\" (UID: \"a4fcdbf4-1f77-47be-81bf-7937aaba4981\") "
Jun 03 21:47:10.652373 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.652346    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4fcdbf4-1f77-47be-81bf-7937aaba4981-kube-api-access-8q9tl" (OuterVolumeSpecName: "kube-api-access-8q9tl") pod "a4fcdbf4-1f77-47be-81bf-7937aaba4981" (UID: "a4fcdbf4-1f77-47be-81bf-7937aaba4981"). InnerVolumeSpecName "kube-api-access-8q9tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 21:47:10.722487 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.722455    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4fcdbf4-1f77-47be-81bf-7937aaba4981" containerID="35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771" exitCode=0
Jun 03 21:47:10.722631 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.722503    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66dc97c488-zbq6f"
Jun 03 21:47:10.722631 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.722496    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66dc97c488-zbq6f" event={"ID":"a4fcdbf4-1f77-47be-81bf-7937aaba4981","Type":"ContainerDied","Data":"35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771"}
Jun 03 21:47:10.722631 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.722624    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66dc97c488-zbq6f" event={"ID":"a4fcdbf4-1f77-47be-81bf-7937aaba4981","Type":"ContainerDied","Data":"a723d30afddac0669d270a396e064abd9a76e0cfc9cadc613243c5f0f16f580d"}
Jun 03 21:47:10.722772 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.722652    2574 scope.go:117] "RemoveContainer" containerID="35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771"
Jun 03 21:47:10.733086 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.731676    2574 scope.go:117] "RemoveContainer" containerID="35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771"
Jun 03 21:47:10.733086 ip-10-0-140-77 kubenswrapper[2574]: E0603 21:47:10.731985    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771\": container with ID starting with 35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771 not found: ID does not exist" containerID="35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771"
Jun 03 21:47:10.733086 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.732017    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771"} err="failed to get container status \"35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771\": rpc error: code = NotFound desc = could not find container \"35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771\": container with ID starting with 35980fcd56e6a653bc194ed159d49f8dcd062de0617838c8406db37c4ef01771 not found: ID does not exist"
Jun 03 21:47:10.745692 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.745664    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66dc97c488-zbq6f"]
Jun 03 21:47:10.749868 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.749848    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66dc97c488-zbq6f"]
Jun 03 21:47:10.752065 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:10.752045    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q9tl\" (UniqueName: \"kubernetes.io/projected/a4fcdbf4-1f77-47be-81bf-7937aaba4981-kube-api-access-8q9tl\") on node \"ip-10-0-140-77.ec2.internal\" DevicePath \"\""
Jun 03 21:47:11.319227 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.319190    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4fcdbf4-1f77-47be-81bf-7937aaba4981" path="/var/lib/kubelet/pods/a4fcdbf4-1f77-47be-81bf-7937aaba4981/volumes"
Jun 03 21:47:11.518309 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.518274    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66dc97c488-569rm"]
Jun 03 21:47:11.518840 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.518813    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4fcdbf4-1f77-47be-81bf-7937aaba4981" containerName="manager"
Jun 03 21:47:11.519018 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.518998    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4fcdbf4-1f77-47be-81bf-7937aaba4981" containerName="manager"
Jun 03 21:47:11.519125 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.519115    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4fcdbf4-1f77-47be-81bf-7937aaba4981" containerName="manager"
Jun 03 21:47:11.523275 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.523261    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66dc97c488-569rm"
Jun 03 21:47:11.526068 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.526045    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 21:47:11.526175 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.526085    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tnbc9\""
Jun 03 21:47:11.530987 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.530968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66dc97c488-569rm"]
Jun 03 21:47:11.561017 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.560987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctd5t\" (UniqueName: \"kubernetes.io/projected/0243e67f-3393-440e-a513-03095deb6d17-kube-api-access-ctd5t\") pod \"maas-controller-66dc97c488-569rm\" (UID: \"0243e67f-3393-440e-a513-03095deb6d17\") " pod="opendatahub/maas-controller-66dc97c488-569rm"
Jun 03 21:47:11.662544 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.662515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctd5t\" (UniqueName: \"kubernetes.io/projected/0243e67f-3393-440e-a513-03095deb6d17-kube-api-access-ctd5t\") pod \"maas-controller-66dc97c488-569rm\" (UID: \"0243e67f-3393-440e-a513-03095deb6d17\") " pod="opendatahub/maas-controller-66dc97c488-569rm"
Jun 03 21:47:11.670770 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.670745    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctd5t\" (UniqueName: \"kubernetes.io/projected/0243e67f-3393-440e-a513-03095deb6d17-kube-api-access-ctd5t\") pod \"maas-controller-66dc97c488-569rm\" (UID: \"0243e67f-3393-440e-a513-03095deb6d17\") " pod="opendatahub/maas-controller-66dc97c488-569rm"
Jun 03 21:47:11.834334 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.834285    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66dc97c488-569rm"
Jun 03 21:47:11.969556 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:11.969525    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66dc97c488-569rm"]
Jun 03 21:47:11.970425 ip-10-0-140-77 kubenswrapper[2574]: W0603 21:47:11.970383    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0243e67f_3393_440e_a513_03095deb6d17.slice/crio-30aea5103e2029e549f1b6b57b49724efcd0921c55bdcd317207322f3d18f061 WatchSource:0}: Error finding container 30aea5103e2029e549f1b6b57b49724efcd0921c55bdcd317207322f3d18f061: Status 404 returned error can't find the container with id 30aea5103e2029e549f1b6b57b49724efcd0921c55bdcd317207322f3d18f061
Jun 03 21:47:12.734813 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:12.734723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66dc97c488-569rm" event={"ID":"0243e67f-3393-440e-a513-03095deb6d17","Type":"ContainerStarted","Data":"f5b3c950a9a3cb8908720ae44accb5c82e291d220e6f53d76782160ffcb6f48c"}
Jun 03 21:47:12.734813 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:12.734781    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66dc97c488-569rm" event={"ID":"0243e67f-3393-440e-a513-03095deb6d17","Type":"ContainerStarted","Data":"30aea5103e2029e549f1b6b57b49724efcd0921c55bdcd317207322f3d18f061"}
Jun 03 21:47:12.735252 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:12.734842    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66dc97c488-569rm"
Jun 03 21:47:12.753265 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:12.753213    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66dc97c488-569rm" podStartSLOduration=1.289023258 podStartE2EDuration="1.753197448s" totalImagesPullingTime="464.17419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 21:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 21:47:12.751102013 +0000 UTC m=+1003.883279896" watchObservedRunningTime="2026-06-03 21:47:12.753197448 +0000 UTC m=+1003.885375310"
Jun 03 21:47:23.747323 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:47:23.747291    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66dc97c488-569rm"
Jun 03 21:50:29.359792 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:50:29.359762    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:50:29.362181 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:50:29.362156    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:50:29.363641 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:50:29.363618    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:50:29.366210 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:50:29.366191    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:55:29.391445 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:55:29.391396    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:55:29.395576 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:55:29.395550    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 21:55:29.396122 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:55:29.396096    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 21:55:29.400260 ip-10-0-140-77 kubenswrapper[2574]: I0603 21:55:29.400237    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 22:00:29.423524 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:00:29.423496    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 22:00:29.434547 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:00:29.434518    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 22:00:29.437406 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:00:29.437375    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 22:00:29.441399 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:00:29.441381    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 22:05:29.461825 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:05:29.461796    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 22:05:29.465581 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:05:29.465549    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 22:05:29.469795 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:05:29.469770    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 22:05:29.473531 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:05:29.473515    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 22:08:45.880095 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:45.880050    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc66d9bff-lkbdt_0eb8e128-414d-4abb-b0e4-3807dc5e72ab/nginx/0.log"
Jun 03 22:08:45.986023 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:45.985984    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-fml2n_74f9e480-bcee-498b-9ef8-2ff54e0cbfb6/manager/0.log"
Jun 03 22:08:46.107870 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:46.107826    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-84lr9_113cca90-7688-468d-a979-c889512d8ee1/manager/0.log"
Jun 03 22:08:46.229644 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:46.229610    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-59cf5bd49d-cbp2g_11803ea1-b529-41ee-886f-762915356ed1/maas-api/0.log"
Jun 03 22:08:46.566360 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:46.566257    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66dc97c488-569rm_0243e67f-3393-440e-a513-03095deb6d17/manager/0.log"
Jun 03 22:08:46.677855 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:46.677821    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-r944h_02a20b3c-641c-4316-b13d-c9756f73dc6b/server/0.log"
Jun 03 22:08:46.800264 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:46.800228    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-g2blh_e778268d-828d-4f1d-ba08-49db8e83bc94/manager/0.log"
Jun 03 22:08:47.155569 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:47.155540    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-p49bz_28a34c47-06a9-4ac1-9cd4-4c857af452f0/copy-manifests/0.log"
Jun 03 22:08:47.162871 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:47.162839    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-p49bz_28a34c47-06a9-4ac1-9cd4-4c857af452f0/manager/0.log"
Jun 03 22:08:48.659029 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:48.658979    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zcm8h_03265547-ce3f-4060-b17e-b900d851c1df/manager/0.log"
Jun 03 22:08:49.345743 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:49.345705    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fkrl6_58a2b441-403f-4829-a8d7-ce5d82b88a11/manager/0.log"
Jun 03 22:08:49.798278 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:49.798242    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mscmc_7bf130e6-1169-4f07-8c55-377ca91df72f/discovery/0.log"
Jun 03 22:08:49.902785 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:49.902752    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc8d6f7f7-kkflg_16d886ea-f4e7-43e0-8ee1-69006c7461e1/kube-auth-proxy/0.log"
Jun 03 22:08:50.277743 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:50.277712    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9hl5p_001cfbc6-0797-43b3-bf8d-2ff3db0a5a23/payload-processing/0.log"
Jun 03 22:08:50.740841 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:50.740807    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8_9d4700d3-b28c-4e1d-82f8-9686e20febea/storage-initializer/0.log"
Jun 03 22:08:50.748839 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:50.748807    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ktjw8_9d4700d3-b28c-4e1d-82f8-9686e20febea/main/0.log"
Jun 03 22:08:50.860397 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:50.860365    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ln49x_7f8d1f26-ed3a-424b-9cc9-7542b739a5a2/storage-initializer/0.log"
Jun 03 22:08:50.870045 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:50.870012    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ln49x_7f8d1f26-ed3a-424b-9cc9-7542b739a5a2/main/0.log"
Jun 03 22:08:50.981360 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:50.981316    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29_33e14a4c-8181-47f6-8e9e-8b8e018ddbcb/storage-initializer/0.log"
Jun 03 22:08:50.988870 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:50.988844    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wqk29_33e14a4c-8181-47f6-8e9e-8b8e018ddbcb/main/0.log"
Jun 03 22:08:51.209622 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:51.209595    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd_81483c7d-1fc9-4f3f-90b0-e8a5ef2690de/storage-initializer/0.log"
Jun 03 22:08:51.217499 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:51.217472    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-b9vqd_81483c7d-1fc9-4f3f-90b0-e8a5ef2690de/main/0.log"
Jun 03 22:08:58.430430 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:58.430380    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v4jr7_f3768a2b-b041-454c-8d77-0960f70fcecf/global-pull-secret-syncer/0.log"
Jun 03 22:08:58.512149 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:58.512112    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gkndg_e723e70c-2b23-470d-88b2-b47bb1d6ef6d/konnectivity-agent/0.log"
Jun 03 22:08:58.586882 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:08:58.586850    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-77.ec2.internal_d4d1ad5559533687ca686434a0c4ede6/haproxy/0.log"
Jun 03 22:09:01.372038 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:01.372007    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-vv2nn_a62f20a4-f91a-40e3-bbc8-b02b1707f56d/sail-operator/0.log"
Jun 03 22:09:03.570402 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:03.570363    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zcm8h_03265547-ce3f-4060-b17e-b900d851c1df/manager/0.log"
Jun 03 22:09:03.825846 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:03.825749    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fkrl6_58a2b441-403f-4829-a8d7-ce5d82b88a11/manager/0.log"
Jun 03 22:09:05.560464 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:05.560428    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-57769895dd-k2542_76bd295a-c44e-4253-8edb-42f4b787d6f1/cluster-monitoring-operator/0.log"
Jun 03 22:09:05.778725 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:05.778690    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfh5l_7b6f78f6-66e5-49e8-8078-be2ad5318f88/node-exporter/0.log"
Jun 03 22:09:05.799594 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:05.799537    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfh5l_7b6f78f6-66e5-49e8-8078-be2ad5318f88/kube-rbac-proxy/0.log"
Jun 03 22:09:05.819220 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:05.819188    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfh5l_7b6f78f6-66e5-49e8-8078-be2ad5318f88/init-textfile/0.log"
Jun 03 22:09:05.972431 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:05.972382    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bda5e71b-710c-4701-82b3-ec7044b972b2/prometheus/0.log"
Jun 03 22:09:05.992689 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:05.992593    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bda5e71b-710c-4701-82b3-ec7044b972b2/config-reloader/0.log"
Jun 03 22:09:06.016915 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:06.016876    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bda5e71b-710c-4701-82b3-ec7044b972b2/thanos-sidecar/0.log"
Jun 03 22:09:06.038353 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:06.038322    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bda5e71b-710c-4701-82b3-ec7044b972b2/kube-rbac-proxy-web/0.log"
Jun 03 22:09:06.058533 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:06.058502    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bda5e71b-710c-4701-82b3-ec7044b972b2/kube-rbac-proxy/0.log"
Jun 03 22:09:06.078247 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:06.078209    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bda5e71b-710c-4701-82b3-ec7044b972b2/kube-rbac-proxy-thanos/0.log"
Jun 03 22:09:06.095593 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:06.095553    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bda5e71b-710c-4701-82b3-ec7044b972b2/init-config-reloader/0.log"
Jun 03 22:09:06.125235 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:06.125204    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mwj8f_c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c/prometheus-operator/0.log"
Jun 03 22:09:06.138910 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:06.138883    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-mwj8f_c2b4d1ec-095f-40d4-9ebf-8fdeb9ea5e8c/kube-rbac-proxy/0.log"
Jun 03 22:09:08.677713 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:08.677676    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/1.log"
Jun 03 22:09:08.688143 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:08.688108    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-qbkbq_d944768e-e7a8-481c-85d5-dc9a24c4cf78/console-operator/2.log"
Jun 03 22:09:11.006178 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.006142    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"]
Jun 03 22:09:11.009989 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.009966    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.012599 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.012574    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zmnb\"/\"kube-root-ca.crt\""
Jun 03 22:09:11.012762 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.012665    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zmnb\"/\"openshift-service-ca.crt\""
Jun 03 22:09:11.012762 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.012726    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8zmnb\"/\"default-dockercfg-85wb2\""
Jun 03 22:09:11.020686 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.020656    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"]
Jun 03 22:09:11.146770 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.146717    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-lib-modules\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.146987 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.146791    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-proc\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.146987 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.146873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-podres\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.146987 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.146901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-sys\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.146987 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.146918    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlcsl\" (UniqueName: \"kubernetes.io/projected/161bd80f-aa86-4584-b85a-075c73f6eee1-kube-api-access-vlcsl\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248477 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-lib-modules\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248699 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-proc\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248699 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-podres\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248699 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-sys\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248699 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlcsl\" (UniqueName: \"kubernetes.io/projected/161bd80f-aa86-4584-b85a-075c73f6eee1-kube-api-access-vlcsl\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248699 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248621    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-proc\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248699 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248619    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-lib-modules\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248966 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248755    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-sys\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.248966 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.248781    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/161bd80f-aa86-4584-b85a-075c73f6eee1-podres\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.256842 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.256764    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlcsl\" (UniqueName: \"kubernetes.io/projected/161bd80f-aa86-4584-b85a-075c73f6eee1-kube-api-access-vlcsl\") pod \"perf-node-gather-daemonset-rj4xg\" (UID: \"161bd80f-aa86-4584-b85a-075c73f6eee1\") " pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.316428 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.316376    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsrlp_6b99cda7-8109-4787-920b-b524c81814db/dns/0.log"
Jun 03 22:09:11.321056 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.321027    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:11.335688 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.335638    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zsrlp_6b99cda7-8109-4787-920b-b524c81814db/kube-rbac-proxy/0.log"
Jun 03 22:09:11.413212 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.413175    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7ls5z_3a88d3f4-f42c-4197-be27-3ae842050c7b/dns-node-resolver/0.log"
Jun 03 22:09:11.468812 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.468786    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"]
Jun 03 22:09:11.472179 ip-10-0-140-77 kubenswrapper[2574]: W0603 22:09:11.472137    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod161bd80f_aa86_4584_b85a_075c73f6eee1.slice/crio-b4ffc84edb86bfc33c546a55132c6f9dc369c1bbf2eebc1159a377a6f230502a WatchSource:0}: Error finding container b4ffc84edb86bfc33c546a55132c6f9dc369c1bbf2eebc1159a377a6f230502a: Status 404 returned error can't find the container with id b4ffc84edb86bfc33c546a55132c6f9dc369c1bbf2eebc1159a377a6f230502a
Jun 03 22:09:11.937647 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.937616    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-597f9cc6dc-gtjjm_23d3ed37-d00f-42f1-96dd-331a0512923d/registry/0.log"
Jun 03 22:09:11.952726 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:11.952685    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-597f9cc6dc-gtjjm_23d3ed37-d00f-42f1-96dd-331a0512923d/registry/1.log"
Jun 03 22:09:12.014896 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:12.014870    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzkc7_c3a6c923-856d-40f5-a0d0-674ebaf12949/node-ca/0.log"
Jun 03 22:09:12.449237 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:12.449193    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg" event={"ID":"161bd80f-aa86-4584-b85a-075c73f6eee1","Type":"ContainerStarted","Data":"d4d88a5934c9b5b88a59f1a37e4bf219e2e85e1f86e6a235fab481453ed30a6a"}
Jun 03 22:09:12.449443 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:12.449249    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg" event={"ID":"161bd80f-aa86-4584-b85a-075c73f6eee1","Type":"ContainerStarted","Data":"b4ffc84edb86bfc33c546a55132c6f9dc369c1bbf2eebc1159a377a6f230502a"}
Jun 03 22:09:12.449443 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:12.449272    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:12.467361 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:12.467305    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg" podStartSLOduration=2.467285518 podStartE2EDuration="2.467285518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 22:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 22:09:12.466663834 +0000 UTC m=+2323.598841718" watchObservedRunningTime="2026-06-03 22:09:12.467285518 +0000 UTC m=+2323.599463449"
Jun 03 22:09:13.074349 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:13.074313    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mscmc_7bf130e6-1169-4f07-8c55-377ca91df72f/discovery/0.log"
Jun 03 22:09:13.093307 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:13.093267    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc8d6f7f7-kkflg_16d886ea-f4e7-43e0-8ee1-69006c7461e1/kube-auth-proxy/0.log"
Jun 03 22:09:13.275998 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:13.275956    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9hl5p_001cfbc6-0797-43b3-bf8d-2ff3db0a5a23/payload-processing/0.log"
Jun 03 22:09:13.912297 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:13.912257    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pkczs_ab289959-f3e9-4378-8150-1aee4cfab20a/serve-healthcheck-canary/0.log"
Jun 03 22:09:14.532581 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:14.532544    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swzhv_2a07dae1-d085-4f3b-a06d-978b71a6741a/kube-rbac-proxy/0.log"
Jun 03 22:09:14.551039 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:14.550997    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swzhv_2a07dae1-d085-4f3b-a06d-978b71a6741a/exporter/0.log"
Jun 03 22:09:14.571021 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:14.570990    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swzhv_2a07dae1-d085-4f3b-a06d-978b71a6741a/extractor/0.log"
Jun 03 22:09:16.850655 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:16.850569    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5cc66d9bff-lkbdt_0eb8e128-414d-4abb-b0e4-3807dc5e72ab/nginx/0.log"
Jun 03 22:09:16.873179 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:16.873143    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-fml2n_74f9e480-bcee-498b-9ef8-2ff54e0cbfb6/manager/0.log"
Jun 03 22:09:16.996260 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:16.996223    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-84lr9_113cca90-7688-468d-a979-c889512d8ee1/manager/0.log"
Jun 03 22:09:17.049748 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:17.049714    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-59cf5bd49d-cbp2g_11803ea1-b529-41ee-886f-762915356ed1/maas-api/0.log"
Jun 03 22:09:17.197087 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:17.197032    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66dc97c488-569rm_0243e67f-3393-440e-a513-03095deb6d17/manager/0.log"
Jun 03 22:09:17.216428 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:17.216396    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-r944h_02a20b3c-641c-4316-b13d-c9756f73dc6b/server/0.log"
Jun 03 22:09:17.285678 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:17.285635    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-g2blh_e778268d-828d-4f1d-ba08-49db8e83bc94/manager/0.log"
Jun 03 22:09:17.501233 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:17.501144    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-p49bz_28a34c47-06a9-4ac1-9cd4-4c857af452f0/manager/0.log"
Jun 03 22:09:17.517991 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:17.517965    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f56cf757-p49bz_28a34c47-06a9-4ac1-9cd4-4c857af452f0/copy-manifests/0.log"
Jun 03 22:09:18.465516 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:18.465489    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8zmnb/perf-node-gather-daemonset-rj4xg"
Jun 03 22:09:23.590470 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:23.590431    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mscmc_7bf130e6-1169-4f07-8c55-377ca91df72f/discovery/0.log"
Jun 03 22:09:23.601601 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:23.601570    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc8d6f7f7-kkflg_16d886ea-f4e7-43e0-8ee1-69006c7461e1/kube-auth-proxy/0.log"
Jun 03 22:09:23.775509 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:23.775468    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9hl5p_001cfbc6-0797-43b3-bf8d-2ff3db0a5a23/payload-processing/0.log"
Jun 03 22:09:24.617567 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:24.617537    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vzkrv_680b1d6f-91bd-4f4f-a503-7b643a4e5a89/migrator/0.log"
Jun 03 22:09:24.649362 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:24.649333    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vzkrv_680b1d6f-91bd-4f4f-a503-7b643a4e5a89/graceful-termination/0.log"
Jun 03 22:09:25.076515 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:25.076475    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mscmc_7bf130e6-1169-4f07-8c55-377ca91df72f/discovery/0.log"
Jun 03 22:09:25.093674 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:25.093625    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc8d6f7f7-kkflg_16d886ea-f4e7-43e0-8ee1-69006c7461e1/kube-auth-proxy/0.log"
Jun 03 22:09:25.285522 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:25.285492    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9hl5p_001cfbc6-0797-43b3-bf8d-2ff3db0a5a23/payload-processing/0.log"
Jun 03 22:09:26.236547 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.236517    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-44pnt_fda6aa3f-d98c-4b83-8959-201f42d98ca3/kube-multus/0.log"
Jun 03 22:09:26.392471 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.392441    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nb8lg_8ae31969-b86a-4ea1-9f71-6e15f2e3c69e/kube-multus-additional-cni-plugins/0.log"
Jun 03 22:09:26.412470 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.412431    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nb8lg_8ae31969-b86a-4ea1-9f71-6e15f2e3c69e/egress-router-binary-copy/0.log"
Jun 03 22:09:26.429788 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.429758    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nb8lg_8ae31969-b86a-4ea1-9f71-6e15f2e3c69e/cni-plugins/0.log"
Jun 03 22:09:26.448464 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.448428    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nb8lg_8ae31969-b86a-4ea1-9f71-6e15f2e3c69e/bond-cni-plugin/0.log"
Jun 03 22:09:26.467500 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.467464    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nb8lg_8ae31969-b86a-4ea1-9f71-6e15f2e3c69e/routeoverride-cni/0.log"
Jun 03 22:09:26.485308 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.485280    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nb8lg_8ae31969-b86a-4ea1-9f71-6e15f2e3c69e/whereabouts-cni-bincopy/0.log"
Jun 03 22:09:26.501773 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.501699    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nb8lg_8ae31969-b86a-4ea1-9f71-6e15f2e3c69e/whereabouts-cni/0.log"
Jun 03 22:09:26.828152 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.828064    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xjfjq_cf5f89fc-4c76-42fb-9c67-2c541ff27e55/network-metrics-daemon/0.log"
Jun 03 22:09:26.848127 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:26.848098    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xjfjq_cf5f89fc-4c76-42fb-9c67-2c541ff27e55/kube-rbac-proxy/0.log"
Jun 03 22:09:27.080765 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.080657    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mscmc_7bf130e6-1169-4f07-8c55-377ca91df72f/discovery/0.log"
Jun 03 22:09:27.093422 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.093374    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc8d6f7f7-kkflg_16d886ea-f4e7-43e0-8ee1-69006c7461e1/kube-auth-proxy/0.log"
Jun 03 22:09:27.263267 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.263231    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-9hl5p_001cfbc6-0797-43b3-bf8d-2ff3db0a5a23/payload-processing/0.log"
Jun 03 22:09:27.823137 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.823098    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-controller/0.log"
Jun 03 22:09:27.837301 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.837265    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/1.log"
Jun 03 22:09:27.837301 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.837283    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovn-acl-logging/0.log"
Jun 03 22:09:27.858260 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.858222    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/kube-rbac-proxy-node/0.log"
Jun 03 22:09:27.878882 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.878845    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/kube-rbac-proxy-ovn-metrics/0.log"
Jun 03 22:09:27.898755 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.898722    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/northd/0.log"
Jun 03 22:09:27.918224 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.918193    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/nbdb/0.log"
Jun 03 22:09:27.936716 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.936686    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/sbdb/0.log"
Jun 03 22:09:27.997707 ip-10-0-140-77 kubenswrapper[2574]: I0603 22:09:27.997669    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vtbbn_92408cb9-19d9-4f9c-b5a9-de7b535b7f81/ovnkube-controller/0.log"