Sep 07 20:55:19.931808 ip-10-0-138-24 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 07 20:55:19.931819 ip-10-0-138-24 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 07 20:55:19.931828 ip-10-0-138-24 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 07 20:55:19.932040 ip-10-0-138-24 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 07 20:55:29.300092 ip-10-0-138-24 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 07 20:55:29.300105 ip-10-0-138-24 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 68c27d9cf660481f89dad5e27721a9a4 --
Sep 07 20:57:14.079735 ip-10-0-138-24 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 20:57:14.474512 ip-10-0-138-24 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 20:57:14.474512 ip-10-0-138-24 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 20:57:14.474512 ip-10-0-138-24 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 20:57:14.475676 ip-10-0-138-24 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 20:57:14.475676 ip-10-0-138-24 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 20:57:14.476886 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.476799    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 20:57:14.481180 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481165    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 20:57:14.481180 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481180    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481183    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481187    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481189    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481193    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481195    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481198    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481201    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481204    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481206    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481209    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481212    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481214    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481220    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481223    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481226    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481230    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481234    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481238    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481241    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 20:57:14.481241 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481243    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481247    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481250    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481253    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481256    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481259    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481261    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481264    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481266    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481269    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481271    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481274    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481277    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481279    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481282    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481284    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481287    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481289    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481292    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481295    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 20:57:14.481743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481298    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481300    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481303    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481305    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481308    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481310    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481313    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481315    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481318    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481321    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481324    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481326    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481329    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481332    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481335    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481338    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481341    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481343    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481346    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481348    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 20:57:14.482230 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481351    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481353    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481357    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481361    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481363    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481366    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481368    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481371    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481374    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481378    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481382    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481386    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481388    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481391    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481394    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481397    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481400    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481402    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481405    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 20:57:14.482734 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481407    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481410    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481414    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481416    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481419    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481421    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481424    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481427    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481430    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481433    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481436    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481438    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481441    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481444    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481447    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481449    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481452    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481455    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.481469    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482152    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 20:57:14.483193 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482159    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482161    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482165    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482167    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482171    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482174    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482177    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482180    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482182    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482185    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482187    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482190    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482193    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482195    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482198    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482200    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482203    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482206    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482210    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 20:57:14.483743 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482213    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482216    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482219    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482221    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482224    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482227    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482230    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482232    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482235    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482238    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482241    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482243    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482246    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482249    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482251    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482254    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482256    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482259    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482262    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482265    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 20:57:14.484217 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482267    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482270    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482272    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482275    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482277    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482280    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482282    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482285    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482287    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482291    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482293    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482296    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482300    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482302    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482305    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482307    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482310    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482313    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482316    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482318    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 20:57:14.484723 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482321    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482323    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482326    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482329    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482331    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482333    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482336    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482339    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482341    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482344    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482346    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482349    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482354    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482357    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482360    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482363    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482366    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482368    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482371    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 20:57:14.485290 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482373    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482376    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482378    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482382    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482385    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482389    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482391    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482394    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482396    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482399    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482402    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482406    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482410    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482413    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482417    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482420    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482423    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482425    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482429    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 20:57:14.485781 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482432    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482802    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482807    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482810    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482812    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482815    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482819    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482822    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482824    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482827    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482830    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482833    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482836    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482838    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482841    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482843    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482846    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482849    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482852    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 20:57:14.486239 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482855    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482857    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482860    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482863    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482865    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482868    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482872    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482876    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482879    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482882    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482885    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482888    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482891    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482894    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482897    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482900    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482903    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482905    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482908    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 20:57:14.486721 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482911    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482914    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482916    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482919    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482921    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482924    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482927    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482929    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482932    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482934    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482937    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482940    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482943    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482946    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482949    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482951    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482955    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482959    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482962    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 20:57:14.487178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482965    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482969    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482973    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482976    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482979    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482982    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482985    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482987    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482990    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482993    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482995    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.482998    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483001    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483003    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483006    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483009    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483012    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483015    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483017    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483020    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 20:57:14.487662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483023    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483025    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483028    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483031    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483034    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483036    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483039    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483042    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483044    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483047    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483049    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483052    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483054    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483057    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483060    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483062    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483064    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483067    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483069    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483072    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 20:57:14.488145 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483075    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483077    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483079    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483146    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483190    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483197    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483201    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483208    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483211    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483217    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483223    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483226    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483229    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483233    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483238    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483241    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483244    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483247    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483250    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483253    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483256    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483260    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483263    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483266    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 20:57:14.488687 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483269    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483272    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483276    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483279    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483282    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483285    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483288    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483291    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483294    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483297    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483300    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483304    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483307    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483310    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483312    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483315    2564 flags.go:64] FLAG: --enable-server="true"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483319    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483323    2564 flags.go:64] FLAG: --event-burst="100"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483326    2564 flags.go:64] FLAG: --event-qps="50"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483329    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483332    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483335    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483340    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483343    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483345    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 20:57:14.489269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483348    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483351    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483354    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483357    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483360    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483363    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483366    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483369    2564 flags.go:64] FLAG: --feature-gates=""
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483372    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483375    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483378    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483381    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483384    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483387    2564 flags.go:64] FLAG: --help="false"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483390    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483393    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483396    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483398    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483402    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483405    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483408    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483411    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483414    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 20:57:14.489903 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483416    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483420    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483423    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483426    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483430    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483433    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483437    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483440    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483443    2564 flags.go:64] FLAG: --lock-file=""
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483446    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483448    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483452    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483469    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483472    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483475    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483478    2564 flags.go:64] FLAG: --logging-format="text"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483481    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483485    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483488    2564 flags.go:64] FLAG: --manifest-url=""
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483491    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483495    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483498    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483502    2564 flags.go:64] FLAG: --max-pods="110"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483505    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483508    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 20:57:14.490491 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483511    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483514    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483517    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483520    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483523    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483531    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483534    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483537    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483540    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483544    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483550    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483553    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483556    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483560    2564 flags.go:64] FLAG: --port="10250"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483563    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483566    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0431e7ae03fc46d0e"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483569    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483572    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483575    2564 flags.go:64] FLAG: --register-node="true"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483578    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483582    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483585    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483588    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483591    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483594    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 20:57:14.491105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483597    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483600    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483603    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483606    2564 flags.go:64] FLAG: --runonce="false"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483609    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483613    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483616    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483619    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483622    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483625    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483628    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483631    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483634    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483637    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483639    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483642    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483645    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483649    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483652    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483657    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483661    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483664    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483668    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483671    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483673    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 20:57:14.491735 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483676    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483679    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483682    2564 flags.go:64] FLAG: --v="2"
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483686    2564 flags.go:64] FLAG: --version="false"
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483690    2564 flags.go:64] FLAG: --vmodule=""
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483693    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.483697    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483803    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483807    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483810    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483812    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483815    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483817    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483820    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483823    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483826    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483831    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483833    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483836    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483840    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483844    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 20:57:14.492373 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483846    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483849    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483853    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483857    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483863    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483865    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483869    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483872    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483875    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483878    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483880    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483883    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483885    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483888    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483890    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483893    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483896    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483898    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483901    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 20:57:14.492905 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483904    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483906    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483909    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483912    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483914    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483917    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483920    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483922    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483926    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483929    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483931    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483934    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483936    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483948    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483952    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483955    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483957    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483960    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483963    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 20:57:14.493376 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483967    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483970    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483972    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483975    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483978    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483981    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483983    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483986    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483989    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483991    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483994    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.483997    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484000    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484002    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484005    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484007    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484010    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484013    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484015    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484018    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 20:57:14.493858 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484021    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484026    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484028    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484031    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484033    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484036    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484039    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484041    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484044    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484046    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484049    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484052    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484055    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484057    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484060    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484062    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484065    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484067    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484070    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 20:57:14.494541 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484072    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484075    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484078    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484081    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484083    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484086    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484089    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.484091    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.484827    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.491715    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.491729    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.492611    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.492619    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492673    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492679    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 20:57:14.495185 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492683    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492689    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492692    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492695    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492699    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492702    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492705    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492707    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492710    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492713    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492716    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492719    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492721    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492724    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492727    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492729    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492732    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492735    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492737    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492740    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 20:57:14.495719 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492742    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492745    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492748    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492750    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492753    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492756    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492759    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492763    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492766    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492769    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492772    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492774    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492777    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492779    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492782    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492784    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492787    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492790    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492792    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492796    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 20:57:14.496287 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492800    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492803    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492805    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492808    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492811    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492813    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492816    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492818    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492821    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492823    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492826    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492828    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492831    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492834    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492836    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492839    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492841    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492844    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492847    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492850    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 20:57:14.496796 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492853    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492857    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492861    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492863    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492867    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492869    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492872    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492875    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492877    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492880    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492883    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492885    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492888    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492890    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492893    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492895    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492898    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492900    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492903    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 20:57:14.497336 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492905    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492908    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492911    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492913    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492916    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492919    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492921    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492924    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492926    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492929    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492932    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492935    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492939    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492943    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492946    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492949    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492952    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 20:57:14.497953 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.492955    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.492960    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493075    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493080    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493083    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493087    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493090    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493093    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493096    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493098    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493101    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493104    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493106    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493109    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493112    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 20:57:14.498492 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493114    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493117    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493120    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493123    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493125    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493127    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493130    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493133    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493135    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493138    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493140    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493143    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493146    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493148    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493151    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493154    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493157    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493159    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493162    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493164    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 20:57:14.498870 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493167    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493169    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493172    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493175    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493177    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493180    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493182    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493185    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493187    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493190    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493193    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493195    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493198    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493200    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493203    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493206    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493208    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493211    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493213    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493216    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 20:57:14.499642 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493218    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493221    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493223    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493226    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493229    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493232    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493234    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493237    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493240    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493242    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493245    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493247    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493250    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493252    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493255    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493258    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493260    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493263    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493266    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 20:57:14.500340 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493270    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493272    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493276    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493279    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493282    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493286    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493289    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493291    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493294    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493297    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493299    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493302    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493304    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493306    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493309    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493312    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493314    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493317    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493320    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 20:57:14.500880 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493323    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493325    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493328    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493331    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493334    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493337    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493341    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:14.493343    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.493349    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.493443    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.496893    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.497975    2564 server.go:1019] "Starting client certificate rotation"
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.498095    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 20:57:14.501348 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.498137    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 20:57:14.501739 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.500389    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 20:57:14.501739 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.501485    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 20:57:14.510483 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.510456    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 07 20:57:14.514720 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.514699    2564 log.go:25] "Validated CRI v1 image API"
Sep 07 20:57:14.515870 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.515854    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 20:57:14.518911 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.518887    2564 fs.go:135] Filesystem UUIDs: map[75b4c857-7e60-4ef4-824b-30711c1acd94:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ea30702d-3dce-4024-a73f-b1d877a72c37:/dev/nvme0n1p4]
Sep 07 20:57:14.518985 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.518909    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 20:57:14.524013 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.523910    2564 manager.go:216] Machine: {Timestamp:2026-09-07 20:57:14.522535473 +0000 UTC m=+0.329446008 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099664 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2429b16017dd27dd6beb9b863682d6 SystemUUID:ec2429b1-6017-dd27-dd6b-eb9b863682d6 BootID:68c27d9c-f660-481f-89da-d5e27721a9a4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e3:66:c8:01:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e3:66:c8:01:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:55:21:44:95:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 20:57:14.524013 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.524010    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 20:57:14.524123 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.524079    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 20:57:14.527440 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.527421    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 20:57:14.527609 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.527442    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 20:57:14.528172 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.528162    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 20:57:14.528206 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.528174    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 20:57:14.528206 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.528187    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 20:57:14.528206 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.528199    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 20:57:14.529306 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.529296    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 20:57:14.533115 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533104    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 20:57:14.533228 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533219    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 20:57:14.533261 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533252    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 20:57:14.533328 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533267    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 20:57:14.533328 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533282    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 20:57:14.533328 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533290    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 07 20:57:14.533328 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533298    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 20:57:14.533646 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533630    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 20:57:14.533646 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.533649    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 20:57:14.537240 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.537207    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 20:57:14.539372 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539357    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 20:57:14.539429 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539388    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 20:57:14.539552 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539542    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 20:57:14.539604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539556    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 20:57:14.539604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539562    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 20:57:14.539604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539568    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 20:57:14.539604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539576    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 20:57:14.539604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.539582    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 20:57:14.540210 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.540202    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 20:57:14.540239 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.540211    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 20:57:14.540239 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.540218    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 20:57:14.540239 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.540223    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 20:57:14.540239 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.540230    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 20:57:14.540239 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.540238    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 20:57:14.541030 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.541019    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 20:57:14.541030 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.541030    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 20:57:14.544541 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.544522    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 20:57:14.545214 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.545200    2564 server.go:1268] "Started kubelet"
Sep 07 20:57:14.545358 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.545307    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 20:57:14.545445 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.545379    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 20:57:14.545445 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.545432    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 20:57:14.546034 ip-10-0-138-24 systemd[1]: Started Kubernetes Kubelet.
Sep 07 20:57:14.547127 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.546614    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 20:57:14.548699 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.547697    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 20:57:14.548699 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.547742    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 20:57:14.548699 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.547850    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 20:57:14.548699 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.548084    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 20:57:14.549982 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.549967    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 20:57:14.551698 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.551680    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 20:57:14.552240 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.552224    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 20:57:14.552334 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.552317    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:14.552737 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.552717    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 20:57:14.552737 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.552719    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 20:57:14.552737 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.552740    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 20:57:14.552925 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.552853    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 20:57:14.552925 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.552860    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 20:57:14.553016 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.551616    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-24.ec2.internal.18d3256ebd15c764  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-24.ec2.internal,UID:ip-10-0-138-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-24.ec2.internal,},FirstTimestamp:2026-09-07 20:57:14.545170276 +0000 UTC m=+0.352080817,LastTimestamp:2026-09-07 20:57:14.545170276 +0000 UTC m=+0.352080817,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-24.ec2.internal,}"
Sep 07 20:57:14.553016 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553012    2564 factory.go:55] Registering systemd factory
Sep 07 20:57:14.553160 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553028    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 07 20:57:14.553265 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553249    2564 factory.go:153] Registering CRI-O factory
Sep 07 20:57:14.553317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553268    2564 factory.go:223] Registration of the crio container factory successfully
Sep 07 20:57:14.553365 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553316    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 20:57:14.553365 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553330    2564 factory.go:103] Registering Raw factory
Sep 07 20:57:14.553365 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553341    2564 manager.go:1196] Started watching for new ooms in manager
Sep 07 20:57:14.553627 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.553616    2564 manager.go:349] Starting recovery of all containers
Sep 07 20:57:14.555491 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.555457    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 20:57:14.555593 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.555572    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 20:57:14.566323 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.565519    2564 manager.go:354] Recovery completed
Sep 07 20:57:14.570337 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.570318    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 20:57:14.571971 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.571950    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 20:57:14.572031 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.571982    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 20:57:14.572031 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.571991    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Sep 07 20:57:14.572555 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.572539    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 20:57:14.572555 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.572554    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 20:57:14.572683 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.572559    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 20:57:14.572683 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.572572    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 20:57:14.573223 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.573202    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 20:57:14.573324 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.573237    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 20:57:14.573324 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.573251    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Sep 07 20:57:14.574005 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.573925    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-24.ec2.internal.18d3256ebeaeb6d4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-24.ec2.internal,UID:ip-10-0-138-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-24.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-24.ec2.internal,},FirstTimestamp:2026-09-07 20:57:14.57197026 +0000 UTC m=+0.378880775,LastTimestamp:2026-09-07 20:57:14.57197026 +0000 UTC m=+0.378880775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-24.ec2.internal,}"
Sep 07 20:57:14.574756 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.574739    2564 policy_none.go:49] "None policy: Start"
Sep 07 20:57:14.574756 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.574757    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 20:57:14.574855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.574766    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 20:57:14.576772 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.576759    2564 policy_none.go:47] "Start"
Sep 07 20:57:14.580486 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.580300    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qgsjs"
Sep 07 20:57:14.582554 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.582479    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-24.ec2.internal.18d3256ebeaef637  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-24.ec2.internal,UID:ip-10-0-138-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-24.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-24.ec2.internal,},FirstTimestamp:2026-09-07 20:57:14.571986487 +0000 UTC m=+0.378897002,LastTimestamp:2026-09-07 20:57:14.571986487 +0000 UTC m=+0.378897002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-24.ec2.internal,}"
Sep 07 20:57:14.584247 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.584192    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-24.ec2.internal.18d3256ebeaf196c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-24.ec2.internal,UID:ip-10-0-138-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-24.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-24.ec2.internal,},FirstTimestamp:2026-09-07 20:57:14.5719955 +0000 UTC m=+0.378906014,LastTimestamp:2026-09-07 20:57:14.5719955 +0000 UTC m=+0.378906014,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-24.ec2.internal,}"
Sep 07 20:57:14.586792 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.586774    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qgsjs"
Sep 07 20:57:14.601027 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.601013    2564 manager.go:337] "Starting Device Plugin manager"
Sep 07 20:57:14.601144 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.601058    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 20:57:14.601144 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.601068    2564 server.go:87] "Starting device plugin registration server"
Sep 07 20:57:14.601355 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.601338    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 20:57:14.601443 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.601354    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 20:57:14.601512 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.601452    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 20:57:14.601634 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.601540    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 20:57:14.601634 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.601550    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 20:57:14.602786 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.602747    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 20:57:14.630775 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.602796    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:14.646693 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.646668    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 20:57:14.647868 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.647855    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 20:57:14.647924 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.647906    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 20:57:14.647967 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.647930    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 20:57:14.648018 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.648002    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 20:57:14.650171 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.650154    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 20:57:14.701652 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.701634    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 20:57:14.703287 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.703271    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 20:57:14.703360 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.703302    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 20:57:14.703360 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.703317    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Sep 07 20:57:14.703360 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.703346    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.712705 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.712688    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.712786 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.712713    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-24.ec2.internal\": node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:14.728012 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.727949    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:14.748660 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.748623    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"]
Sep 07 20:57:14.748732 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.748712    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 20:57:14.749545 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.749529    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 20:57:14.749623 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.749556    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 20:57:14.749623 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.749574    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Sep 07 20:57:14.753928 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.753915    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 20:57:14.754050 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.754091 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754066    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 20:57:14.754598 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754582    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 20:57:14.754672 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754609    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 20:57:14.754672 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754619    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Sep 07 20:57:14.754672 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754582    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 20:57:14.754812 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754703    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 20:57:14.754812 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.754722    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Sep 07 20:57:14.757928 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.757909    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.758002 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.757939    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 20:57:14.758559 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.758542    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 20:57:14.758633 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.758572    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 20:57:14.758633 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.758582    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Sep 07 20:57:14.782962 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.782942    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-24.ec2.internal\" not found" node="ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.787329 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.787314    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-24.ec2.internal\" not found" node="ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.828515 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.828496    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:14.854452 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.854433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd25d00ecfdc6dacba0fd37c82f3213c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-24.ec2.internal\" (UID: \"cd25d00ecfdc6dacba0fd37c82f3213c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.854523 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.854455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66cb9e031b7b9c207b808a77c3fd55dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"66cb9e031b7b9c207b808a77c3fd55dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.854523 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.854487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66cb9e031b7b9c207b808a77c3fd55dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"66cb9e031b7b9c207b808a77c3fd55dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.928894 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:14.928871    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:14.955203 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.955180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd25d00ecfdc6dacba0fd37c82f3213c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-24.ec2.internal\" (UID: \"cd25d00ecfdc6dacba0fd37c82f3213c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.955281 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.955206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66cb9e031b7b9c207b808a77c3fd55dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"66cb9e031b7b9c207b808a77c3fd55dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.955281 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.955222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66cb9e031b7b9c207b808a77c3fd55dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"66cb9e031b7b9c207b808a77c3fd55dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.955281 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.955265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66cb9e031b7b9c207b808a77c3fd55dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"66cb9e031b7b9c207b808a77c3fd55dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.955281 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.955271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd25d00ecfdc6dacba0fd37c82f3213c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-24.ec2.internal\" (UID: \"cd25d00ecfdc6dacba0fd37c82f3213c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:14.955418 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:14.955308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66cb9e031b7b9c207b808a77c3fd55dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"66cb9e031b7b9c207b808a77c3fd55dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:15.029499 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:15.029445    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:15.086100 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.086068    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:15.089788 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.089764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:15.130471 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:15.130433    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:15.230958 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:15.230934    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:15.331707 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:15.331684    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:15.363675 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.363646    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 20:57:15.432436 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:15.432411    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:15.497945 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.497915    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 20:57:15.498405 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.498058    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 20:57:15.498405 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.498091    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 20:57:15.533396 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:15.533371    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Sep 07 20:57:15.589406 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.589298    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 20:52:15 +0000 UTC" deadline="2028-05-02 20:57:19.088720482 +0000 UTC"
Sep 07 20:57:15.589406 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.589360    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14472h0m3.499364305s"
Sep 07 20:57:15.589406 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.589341    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 20:57:15.653161 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.653128    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:15.665264 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.665240    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 20:57:15.670991 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.670968    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Sep 07 20:57:15.680905 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.680881    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 20:57:15.693490 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:15.693451    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd25d00ecfdc6dacba0fd37c82f3213c.slice/crio-9aa4a26f107e2a8b362ba213ffeb2828db8a4e0450731109cf2d5a9dc8d4d339 WatchSource:0}: Error finding container 9aa4a26f107e2a8b362ba213ffeb2828db8a4e0450731109cf2d5a9dc8d4d339: Status 404 returned error can't find the container with id 9aa4a26f107e2a8b362ba213ffeb2828db8a4e0450731109cf2d5a9dc8d4d339
Sep 07 20:57:15.694005 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:15.693974    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66cb9e031b7b9c207b808a77c3fd55dc.slice/crio-6bdee50927e62bf009e87a9cfc729960bd43a82e33e3fd7caf2764c17b71df62 WatchSource:0}: Error finding container 6bdee50927e62bf009e87a9cfc729960bd43a82e33e3fd7caf2764c17b71df62: Status 404 returned error can't find the container with id 6bdee50927e62bf009e87a9cfc729960bd43a82e33e3fd7caf2764c17b71df62
Sep 07 20:57:15.699376 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.699360    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 20:57:15.972060 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:15.972035    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 20:57:16.317938 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.317858    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 20:57:16.534259 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.534227    2564 apiserver.go:52] "Watching apiserver"
Sep 07 20:57:16.542590 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.542565    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 20:57:16.543701 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.543677    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fzg2r","kube-system/konnectivity-agent-mjw6l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b","openshift-cluster-node-tuning-operator/tuned-zw46w","openshift-image-registry/node-ca-pbj6b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal","openshift-network-diagnostics/network-check-target-n2cg2","openshift-network-operator/iptables-alerter-k9n2r","kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal","openshift-dns/node-resolver-l6n5g","openshift-multus/multus-additional-cni-plugins-pxwjt","openshift-multus/multus-msnms","openshift-multus/network-metrics-daemon-gh894","openshift-ovn-kubernetes/ovnkube-node-dhlpq"]
Sep 07 20:57:16.546345 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.546320    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:16.546451 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.546417    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:16.548681 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.548653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:16.548797 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.548736    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:16.553759 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.553734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.553964 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.553747    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 20:57:16.554077 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.554012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.555910 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.555874    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.556483 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.556463    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-frrll\""
Sep 07 20:57:16.556483 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.556479    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 20:57:16.556634 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.556470    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 20:57:16.556736 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.556719    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 20:57:16.556981 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.556962    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 20:57:16.557062 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.557048    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j8vpc\""
Sep 07 20:57:16.557396 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.557375    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 20:57:16.558539 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.558516    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 20:57:16.558656 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.558516    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 20:57:16.558656 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.558548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.559157 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.559132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9m7f\""
Sep 07 20:57:16.559272 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.559188    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 20:57:16.561476 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.561459    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 20:57:16.561581 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.561500    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 20:57:16.561764 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.561746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.562477 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.562441    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-87d8n\""
Sep 07 20:57:16.562477 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.562463    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 20:57:16.562660 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.562465    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 20:57:16.562660 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.562465    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 20:57:16.562660 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.562444    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 20:57:16.564056 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.564008    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 20:57:16.564188 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.564063    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 20:57:16.564327 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.564308    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.564394 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.564375    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:16.564450 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.564399    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bj7ms\""
Sep 07 20:57:16.564549 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.564315    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 20:57:16.566708 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.566688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.566881 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.566861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-device-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.566973 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.566897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-sys-fs\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.566973 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.566939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysconfig\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567065 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.566979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysctl-conf\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567065 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-socket-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.567170 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.567170 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-modprobe-d\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567170 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-lib-modules\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567384 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-tuned\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567384 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89ee16e1-5a2a-4c48-85a0-914b047ce40a-tmp\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567544 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-864p4\" (UniqueName: \"kubernetes.io/projected/89ee16e1-5a2a-4c48-85a0-914b047ce40a-kube-api-access-864p4\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567630 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:16.567684 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:16.567747 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-registration-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.567803 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdnrq\" (UniqueName: \"kubernetes.io/projected/92cebb43-3e89-490f-ba75-3d022306b1c3-kube-api-access-rdnrq\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.567803 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-kubernetes\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.567803 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567794    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 20:57:16.568000 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysctl-d\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.568000 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-systemd\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.568000 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-run\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.568000 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-sys\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.568000 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.567993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-var-lib-kubelet\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.568318 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.568021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-host\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.568318 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.568176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdb5t\" (UniqueName: \"kubernetes.io/projected/23809825-6a88-483c-8baa-5625142fb636-kube-api-access-gdb5t\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:16.568318 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.568206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.569103 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.569075    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h6st4\""
Sep 07 20:57:16.569267 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.569229    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 20:57:16.569357 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.569312    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 20:57:16.571649 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.571530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.573848 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.573828    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 20:57:16.573944 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.573875    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89hk9\""
Sep 07 20:57:16.573944 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.573890    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 20:57:16.574628 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.574609    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.577189 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.577166    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 20:57:16.577325 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.577309    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.577395 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.577379    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 20:57:16.577455 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.577405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rqx49\""
Sep 07 20:57:16.577734 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.577717    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 20:57:16.577845 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.577784    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 20:57:16.578149 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.578132    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 20:57:16.580015 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.579994    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 20:57:16.580257 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.580236    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5sk6\""
Sep 07 20:57:16.589744 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.589723    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lr8l"
Sep 07 20:57:16.598552 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.598531    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9lr8l"
Sep 07 20:57:16.652585 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.652536    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" event={"ID":"66cb9e031b7b9c207b808a77c3fd55dc","Type":"ContainerStarted","Data":"6bdee50927e62bf009e87a9cfc729960bd43a82e33e3fd7caf2764c17b71df62"}
Sep 07 20:57:16.653690 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.653666    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 20:57:16.653956 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.653932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal" event={"ID":"cd25d00ecfdc6dacba0fd37c82f3213c","Type":"ContainerStarted","Data":"9aa4a26f107e2a8b362ba213ffeb2828db8a4e0450731109cf2d5a9dc8d4d339"}
Sep 07 20:57:16.668423 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovnkube-config\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.668539 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5259364-ddc0-4760-a336-7c8975913c1f-tmp-dir\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.668539 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-multus-certs\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.668621 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-modprobe-d\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.668621 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89ee16e1-5a2a-4c48-85a0-914b047ce40a-tmp\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.668621 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-864p4\" (UniqueName: \"kubernetes.io/projected/89ee16e1-5a2a-4c48-85a0-914b047ce40a-kube-api-access-864p4\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.668806 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-modprobe-d\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.668863 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-kubelet\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.668863 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-cnibin\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.668966 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-run\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.668966 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-sys\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.668966 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-var-lib-kubelet\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.669104 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.668979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.669104 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-log-socket\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.669104 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-run\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.669104 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43bba16a-d690-4864-9e1e-428bd4eb88b8-host\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.669104 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llj54\" (UniqueName: \"kubernetes.io/projected/e68a83b8-94a6-4e4d-a339-50244b63ea5e-kube-api-access-llj54\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.669104 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-var-lib-kubelet\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.669104 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-node-log\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e345f2dc-607f-4cb2-b6a6-1d748e1d486e-konnectivity-ca\") pod \"konnectivity-agent-mjw6l\" (UID: \"e345f2dc-607f-4cb2-b6a6-1d748e1d486e\") " pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669139    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-device-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669176    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-sys\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwct\" (UniqueName: \"kubernetes.io/projected/43bba16a-d690-4864-9e1e-428bd4eb88b8-kube-api-access-cpwct\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-system-cni-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-cni-multus\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-daemon-config\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-socket-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-device-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.669426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-lib-modules\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-run-netns\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669557    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-socket-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-env-overrides\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vv5p\" (UniqueName: \"kubernetes.io/projected/366e76df-a042-4064-8eb8-a5dd7d5c888a-kube-api-access-9vv5p\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da7e5605-1bc3-46bd-8151-d5e32f37e05e-dbus\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-systemd\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5259364-ddc0-4760-a336-7c8975913c1f-hosts-file\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29z9k\" (UniqueName: \"kubernetes.io/projected/f3c058ba-708e-4132-9368-4023998fe884-kube-api-access-29z9k\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-k8s-cni-cncf-io\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-host\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-host\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.670137 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e68a83b8-94a6-4e4d-a339-50244b63ea5e-cni-binary-copy\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-kubelet\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-conf-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670082    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysconfig\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.669682    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-lib-modules\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-systemd-units\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysconfig\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tqkp\" (UniqueName: \"kubernetes.io/projected/c5259364-ddc0-4760-a336-7c8975913c1f-kube-api-access-8tqkp\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-cnibin\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670287    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-netns\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670319    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-hostroot\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670353    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovn-node-metrics-cert\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovnkube-script-lib\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-registration-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-etc-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.670878 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-registration-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.670553    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-cni-netd\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.670639    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs podName:23809825-6a88-483c-8baa-5625142fb636 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:17.170600085 +0000 UTC m=+2.977510595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs") pod "network-metrics-daemon-gh894" (UID: "23809825-6a88-483c-8baa-5625142fb636") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf9a1e0-b26d-448e-9953-a0520ab0a825-iptables-alerter-script\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43bba16a-d690-4864-9e1e-428bd4eb88b8-serviceca\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-var-lib-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e345f2dc-607f-4cb2-b6a6-1d748e1d486e-agent-certs\") pod \"konnectivity-agent-mjw6l\" (UID: \"e345f2dc-607f-4cb2-b6a6-1d748e1d486e\") " pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdb5t\" (UniqueName: \"kubernetes.io/projected/23809825-6a88-483c-8baa-5625142fb636-kube-api-access-gdb5t\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-sys-fs\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysctl-conf\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-ovn\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-tuned\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-slash\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-sys-fs\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.671657 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-cni-bin\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.670960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/92cebb43-3e89-490f-ba75-3d022306b1c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.671125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysctl-conf\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.671878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf9a1e0-b26d-448e-9953-a0520ab0a825-host-slash\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.671909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.671932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-etc-kubernetes\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.671964    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdnrq\" (UniqueName: \"kubernetes.io/projected/92cebb43-3e89-490f-ba75-3d022306b1c3-kube-api-access-rdnrq\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.671987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-kubernetes\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysctl-d\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-systemd\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlgr\" (UniqueName: \"kubernetes.io/projected/adf9a1e0-b26d-448e-9953-a0520ab0a825-kube-api-access-jhlgr\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-cni-bin\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da7e5605-1bc3-46bd-8151-d5e32f37e05e-kubelet-config\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-system-cni-dir\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.672253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-cni-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.673046 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-socket-dir-parent\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.673046 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672404    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-sysctl-d\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.673046 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-systemd\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.673046 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.672812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-kubernetes\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.673269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.673254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89ee16e1-5a2a-4c48-85a0-914b047ce40a-tmp\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.675174 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.675143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89ee16e1-5a2a-4c48-85a0-914b047ce40a-etc-tuned\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.676699 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.676672    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 20:57:16.676699 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.676694    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 20:57:16.676879 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.676705    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tkgkr for pod openshift-network-diagnostics/network-check-target-n2cg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:16.676879 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.676780    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr podName:d9fcc1ec-54d7-49d8-962e-35651197929e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:17.176763637 +0000 UTC m=+2.983674141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tkgkr" (UniqueName: "kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr") pod "network-check-target-n2cg2" (UID: "d9fcc1ec-54d7-49d8-962e-35651197929e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:16.677845 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.677824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-864p4\" (UniqueName: \"kubernetes.io/projected/89ee16e1-5a2a-4c48-85a0-914b047ce40a-kube-api-access-864p4\") pod \"tuned-zw46w\" (UID: \"89ee16e1-5a2a-4c48-85a0-914b047ce40a\") " pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.680463 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.680438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdnrq\" (UniqueName: \"kubernetes.io/projected/92cebb43-3e89-490f-ba75-3d022306b1c3-kube-api-access-rdnrq\") pod \"aws-ebs-csi-driver-node-tdl4b\" (UID: \"92cebb43-3e89-490f-ba75-3d022306b1c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.680576 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.680445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdb5t\" (UniqueName: \"kubernetes.io/projected/23809825-6a88-483c-8baa-5625142fb636-kube-api-access-gdb5t\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:16.772609 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-var-lib-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772609 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e345f2dc-607f-4cb2-b6a6-1d748e1d486e-agent-certs\") pod \"konnectivity-agent-mjw6l\" (UID: \"e345f2dc-607f-4cb2-b6a6-1d748e1d486e\") " pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-ovn\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-slash\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-cni-bin\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf9a1e0-b26d-448e-9953-a0520ab0a825-host-slash\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-slash\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-ovn\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-cni-bin\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adf9a1e0-b26d-448e-9953-a0520ab0a825-host-slash\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-etc-kubernetes\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.772855 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlgr\" (UniqueName: \"kubernetes.io/projected/adf9a1e0-b26d-448e-9953-a0520ab0a825-kube-api-access-jhlgr\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-etc-kubernetes\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-cni-bin\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da7e5605-1bc3-46bd-8151-d5e32f37e05e-kubelet-config\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-system-cni-dir\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-cni-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-socket-dir-parent\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.772832    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovnkube-config\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-cni-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.773170    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da7e5605-1bc3-46bd-8151-d5e32f37e05e-kubelet-config\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:16.773239    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret podName:da7e5605-1bc3-46bd-8151-d5e32f37e05e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:17.273219748 +0000 UTC m=+3.080130265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret") pod "global-pull-secret-syncer-fzg2r" (UID: "da7e5605-1bc3-46bd-8151-d5e32f37e05e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-system-cni-dir\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773274    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-socket-dir-parent\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.773507 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-cni-bin\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-var-lib-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5259364-ddc0-4760-a336-7c8975913c1f-tmp-dir\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-multus-certs\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-multus-certs\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-kubelet\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-cnibin\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-kubelet\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovnkube-config\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-cnibin\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-log-socket\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-log-socket\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43bba16a-d690-4864-9e1e-428bd4eb88b8-host\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llj54\" (UniqueName: \"kubernetes.io/projected/e68a83b8-94a6-4e4d-a339-50244b63ea5e-kube-api-access-llj54\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-node-log\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5259364-ddc0-4760-a336-7c8975913c1f-tmp-dir\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.774317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e345f2dc-607f-4cb2-b6a6-1d748e1d486e-konnectivity-ca\") pod \"konnectivity-agent-mjw6l\" (UID: \"e345f2dc-607f-4cb2-b6a6-1d748e1d486e\") " pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43bba16a-d690-4864-9e1e-428bd4eb88b8-host\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773886    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-node-log\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.773972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwct\" (UniqueName: \"kubernetes.io/projected/43bba16a-d690-4864-9e1e-428bd4eb88b8-kube-api-access-cpwct\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-system-cni-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-cni-multus\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-daemon-config\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-run-netns\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-env-overrides\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-run-netns\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-cni-multus\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vv5p\" (UniqueName: \"kubernetes.io/projected/366e76df-a042-4064-8eb8-a5dd7d5c888a-kube-api-access-9vv5p\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-system-cni-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e345f2dc-607f-4cb2-b6a6-1d748e1d486e-konnectivity-ca\") pod \"konnectivity-agent-mjw6l\" (UID: \"e345f2dc-607f-4cb2-b6a6-1d748e1d486e\") " pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.775283 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da7e5605-1bc3-46bd-8151-d5e32f37e05e-dbus\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-systemd\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da7e5605-1bc3-46bd-8151-d5e32f37e05e-dbus\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5259364-ddc0-4760-a336-7c8975913c1f-hosts-file\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774749    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-run-systemd\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5259364-ddc0-4760-a336-7c8975913c1f-hosts-file\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774830    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-env-overrides\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-daemon-config\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.774997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29z9k\" (UniqueName: \"kubernetes.io/projected/f3c058ba-708e-4132-9368-4023998fe884-kube-api-access-29z9k\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-k8s-cni-cncf-io\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-k8s-cni-cncf-io\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e68a83b8-94a6-4e4d-a339-50244b63ea5e-cni-binary-copy\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-kubelet\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-conf-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-systemd-units\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tqkp\" (UniqueName: \"kubernetes.io/projected/c5259364-ddc0-4760-a336-7c8975913c1f-kube-api-access-8tqkp\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-cnibin\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775495    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-netns\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-hostroot\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovn-node-metrics-cert\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775441    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f3c058ba-708e-4132-9368-4023998fe884-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovnkube-script-lib\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-etc-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3c058ba-708e-4132-9368-4023998fe884-cnibin\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-cni-netd\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-run-netns\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf9a1e0-b26d-448e-9953-a0520ab0a825-iptables-alerter-script\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43bba16a-d690-4864-9e1e-428bd4eb88b8-serviceca\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-hostroot\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775765    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e68a83b8-94a6-4e4d-a339-50244b63ea5e-cni-binary-copy\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-etc-openvswitch\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.776995 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-multus-conf-dir\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.777685 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.775819    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-systemd-units\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.777685 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.776307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovnkube-script-lib\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.777685 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.776368    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e68a83b8-94a6-4e4d-a339-50244b63ea5e-host-var-lib-kubelet\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.777685 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.776394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/adf9a1e0-b26d-448e-9953-a0520ab0a825-iptables-alerter-script\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.777685 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.776429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43bba16a-d690-4864-9e1e-428bd4eb88b8-serviceca\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.777685 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.776457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/366e76df-a042-4064-8eb8-a5dd7d5c888a-host-cni-netd\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.777685 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.776844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e345f2dc-607f-4cb2-b6a6-1d748e1d486e-agent-certs\") pod \"konnectivity-agent-mjw6l\" (UID: \"e345f2dc-607f-4cb2-b6a6-1d748e1d486e\") " pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.778478 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.778455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/366e76df-a042-4064-8eb8-a5dd7d5c888a-ovn-node-metrics-cert\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.783696 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.783483    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlgr\" (UniqueName: \"kubernetes.io/projected/adf9a1e0-b26d-448e-9953-a0520ab0a825-kube-api-access-jhlgr\") pod \"iptables-alerter-k9n2r\" (UID: \"adf9a1e0-b26d-448e-9953-a0520ab0a825\") " pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.783696 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.783653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llj54\" (UniqueName: \"kubernetes.io/projected/e68a83b8-94a6-4e4d-a339-50244b63ea5e-kube-api-access-llj54\") pod \"multus-msnms\" (UID: \"e68a83b8-94a6-4e4d-a339-50244b63ea5e\") " pod="openshift-multus/multus-msnms"
Sep 07 20:57:16.784047 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.784026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwct\" (UniqueName: \"kubernetes.io/projected/43bba16a-d690-4864-9e1e-428bd4eb88b8-kube-api-access-cpwct\") pod \"node-ca-pbj6b\" (UID: \"43bba16a-d690-4864-9e1e-428bd4eb88b8\") " pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.785044 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.785004    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29z9k\" (UniqueName: \"kubernetes.io/projected/f3c058ba-708e-4132-9368-4023998fe884-kube-api-access-29z9k\") pod \"multus-additional-cni-plugins-pxwjt\" (UID: \"f3c058ba-708e-4132-9368-4023998fe884\") " pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.785513 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.785493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tqkp\" (UniqueName: \"kubernetes.io/projected/c5259364-ddc0-4760-a336-7c8975913c1f-kube-api-access-8tqkp\") pod \"node-resolver-l6n5g\" (UID: \"c5259364-ddc0-4760-a336-7c8975913c1f\") " pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.785598 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.785518    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vv5p\" (UniqueName: \"kubernetes.io/projected/366e76df-a042-4064-8eb8-a5dd7d5c888a-kube-api-access-9vv5p\") pod \"ovnkube-node-dhlpq\" (UID: \"366e76df-a042-4064-8eb8-a5dd7d5c888a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.866913 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.866824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b"
Sep 07 20:57:16.873869 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.873844    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zw46w"
Sep 07 20:57:16.882845 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.882819    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pbj6b"
Sep 07 20:57:16.888764 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.888743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:16.895609 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.895590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k9n2r"
Sep 07 20:57:16.902310 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.902287    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:16.909976 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.909956    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l6n5g"
Sep 07 20:57:16.916860 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.916840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxwjt"
Sep 07 20:57:16.921915 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:16.921897    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-msnms"
Sep 07 20:57:17.178973 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.178937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:17.178973 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.178983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:17.179218 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.179087    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:17.179218 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.179111    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 20:57:17.179218 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.179135    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 20:57:17.179218 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.179150    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tkgkr for pod openshift-network-diagnostics/network-check-target-n2cg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:17.179218 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.179161    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs podName:23809825-6a88-483c-8baa-5625142fb636 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:18.179139047 +0000 UTC m=+3.986049584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs") pod "network-metrics-daemon-gh894" (UID: "23809825-6a88-483c-8baa-5625142fb636") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:17.179218 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.179207    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr podName:d9fcc1ec-54d7-49d8-962e-35651197929e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:18.179187087 +0000 UTC m=+3.986097605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkgkr" (UniqueName: "kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr") pod "network-check-target-n2cg2" (UID: "d9fcc1ec-54d7-49d8-962e-35651197929e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:17.279786 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.279758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:17.279949 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.279895    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:17.279994 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.279952    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret podName:da7e5605-1bc3-46bd-8151-d5e32f37e05e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:18.279938258 +0000 UTC m=+4.086848762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret") pod "global-pull-secret-syncer-fzg2r" (UID: "da7e5605-1bc3-46bd-8151-d5e32f37e05e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:17.602353 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.602266    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:52:17 +0000 UTC" deadline="2028-06-14 01:27:50.621901188 +0000 UTC"
Sep 07 20:57:17.602353 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.602301    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15484h30m33.019603965s"
Sep 07 20:57:17.648931 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.648747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:17.649155 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:17.649116    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:17.649801 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.649776    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf9a1e0_b26d_448e_9953_a0520ab0a825.slice/crio-35ce45275c4ee55e8204baf3cbbefe019df6a486be52e394d930c1f2cf9bde4a WatchSource:0}: Error finding container 35ce45275c4ee55e8204baf3cbbefe019df6a486be52e394d930c1f2cf9bde4a: Status 404 returned error can't find the container with id 35ce45275c4ee55e8204baf3cbbefe019df6a486be52e394d930c1f2cf9bde4a
Sep 07 20:57:17.651126 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.651106    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ee16e1_5a2a_4c48_85a0_914b047ce40a.slice/crio-559e2bc3874ea1aecf896e091ff74c14ef8c4815805ca291f10f3ae36033bec2 WatchSource:0}: Error finding container 559e2bc3874ea1aecf896e091ff74c14ef8c4815805ca291f10f3ae36033bec2: Status 404 returned error can't find the container with id 559e2bc3874ea1aecf896e091ff74c14ef8c4815805ca291f10f3ae36033bec2
Sep 07 20:57:17.652439 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.652384    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68a83b8_94a6_4e4d_a339_50244b63ea5e.slice/crio-620bfa61f1149bc1743728b3e775e059f0b7979aeaaaacdb872aa0c39f7cb898 WatchSource:0}: Error finding container 620bfa61f1149bc1743728b3e775e059f0b7979aeaaaacdb872aa0c39f7cb898: Status 404 returned error can't find the container with id 620bfa61f1149bc1743728b3e775e059f0b7979aeaaaacdb872aa0c39f7cb898
Sep 07 20:57:17.653665 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.653646    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode345f2dc_607f_4cb2_b6a6_1d748e1d486e.slice/crio-651d0b79aa111b2005f8c68088bdd02b1bd69dd39a94fce68af40923d223d42d WatchSource:0}: Error finding container 651d0b79aa111b2005f8c68088bdd02b1bd69dd39a94fce68af40923d223d42d: Status 404 returned error can't find the container with id 651d0b79aa111b2005f8c68088bdd02b1bd69dd39a94fce68af40923d223d42d
Sep 07 20:57:17.656200 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.656168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-msnms" event={"ID":"e68a83b8-94a6-4e4d-a339-50244b63ea5e","Type":"ContainerStarted","Data":"620bfa61f1149bc1743728b3e775e059f0b7979aeaaaacdb872aa0c39f7cb898"}
Sep 07 20:57:17.657308 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.657279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zw46w" event={"ID":"89ee16e1-5a2a-4c48-85a0-914b047ce40a","Type":"ContainerStarted","Data":"559e2bc3874ea1aecf896e091ff74c14ef8c4815805ca291f10f3ae36033bec2"}
Sep 07 20:57:17.658427 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.658405    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k9n2r" event={"ID":"adf9a1e0-b26d-448e-9953-a0520ab0a825","Type":"ContainerStarted","Data":"35ce45275c4ee55e8204baf3cbbefe019df6a486be52e394d930c1f2cf9bde4a"}
Sep 07 20:57:17.659617 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:17.659527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjw6l" event={"ID":"e345f2dc-607f-4cb2-b6a6-1d748e1d486e","Type":"ContainerStarted","Data":"651d0b79aa111b2005f8c68088bdd02b1bd69dd39a94fce68af40923d223d42d"}
Sep 07 20:57:17.677449 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.677423    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5259364_ddc0_4760_a336_7c8975913c1f.slice/crio-d1aa3b38245e4401026b7533a3216caa439791cdb5b6533456b66ff84c1003fd WatchSource:0}: Error finding container d1aa3b38245e4401026b7533a3216caa439791cdb5b6533456b66ff84c1003fd: Status 404 returned error can't find the container with id d1aa3b38245e4401026b7533a3216caa439791cdb5b6533456b66ff84c1003fd
Sep 07 20:57:17.678189 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.678166    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43bba16a_d690_4864_9e1e_428bd4eb88b8.slice/crio-02887c7005cab527170b9cdef9db819aa9ba5cd541e0630d3ab520e979932e7d WatchSource:0}: Error finding container 02887c7005cab527170b9cdef9db819aa9ba5cd541e0630d3ab520e979932e7d: Status 404 returned error can't find the container with id 02887c7005cab527170b9cdef9db819aa9ba5cd541e0630d3ab520e979932e7d
Sep 07 20:57:17.679023 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.679003    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92cebb43_3e89_490f_ba75_3d022306b1c3.slice/crio-934beae94b148e2629433f9084677a6d665e5cd6e290db83c84efe282da9e6a1 WatchSource:0}: Error finding container 934beae94b148e2629433f9084677a6d665e5cd6e290db83c84efe282da9e6a1: Status 404 returned error can't find the container with id 934beae94b148e2629433f9084677a6d665e5cd6e290db83c84efe282da9e6a1
Sep 07 20:57:17.680128 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.679880    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366e76df_a042_4064_8eb8_a5dd7d5c888a.slice/crio-7fe49b97d8dc9fee3aced4d8ca82dd05ef6df0a9ba0567ee8b0783a0495f9e8e WatchSource:0}: Error finding container 7fe49b97d8dc9fee3aced4d8ca82dd05ef6df0a9ba0567ee8b0783a0495f9e8e: Status 404 returned error can't find the container with id 7fe49b97d8dc9fee3aced4d8ca82dd05ef6df0a9ba0567ee8b0783a0495f9e8e
Sep 07 20:57:17.680929 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:17.680820    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c058ba_708e_4132_9368_4023998fe884.slice/crio-59890ce650246b23951814da434b39d41c0c276cdc8613e5854f7aec8e86820f WatchSource:0}: Error finding container 59890ce650246b23951814da434b39d41c0c276cdc8613e5854f7aec8e86820f: Status 404 returned error can't find the container with id 59890ce650246b23951814da434b39d41c0c276cdc8613e5854f7aec8e86820f
Sep 07 20:57:18.185972 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.185932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:18.186158 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.186041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:18.186225 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.186194    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 20:57:18.186225 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.186213    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 20:57:18.186225 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.186226    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tkgkr for pod openshift-network-diagnostics/network-check-target-n2cg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:18.186390 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.186287    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr podName:d9fcc1ec-54d7-49d8-962e-35651197929e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:20.186267128 +0000 UTC m=+5.993177652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkgkr" (UniqueName: "kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr") pod "network-check-target-n2cg2" (UID: "d9fcc1ec-54d7-49d8-962e-35651197929e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:18.186730 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.186710    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:18.186871 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.186766    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs podName:23809825-6a88-483c-8baa-5625142fb636 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:20.186749911 +0000 UTC m=+5.993660420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs") pod "network-metrics-daemon-gh894" (UID: "23809825-6a88-483c-8baa-5625142fb636") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:18.286896 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.286854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:18.287097 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.287019    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:18.287097 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.287085    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret podName:da7e5605-1bc3-46bd-8151-d5e32f37e05e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:20.287065198 +0000 UTC m=+6.093975702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret") pod "global-pull-secret-syncer-fzg2r" (UID: "da7e5605-1bc3-46bd-8151-d5e32f37e05e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:18.439647 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.439566    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 20:57:18.602563 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.602492    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 20:52:17 +0000 UTC" deadline="2028-06-15 02:21:57.981730408 +0000 UTC"
Sep 07 20:57:18.602563 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.602561    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15509h24m39.379174013s"
Sep 07 20:57:18.649686 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.649657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:18.649686 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.649683    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:18.650091 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.649814    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:18.650091 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:18.649961    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:18.673165 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.673134    2564 generic.go:356] "Generic (PLEG): container finished" podID="66cb9e031b7b9c207b808a77c3fd55dc" containerID="3ebab2f5da46a40aa702492b69a488fe0adbcb6bc9e16e583f355c0d7abbd7e7" exitCode=0
Sep 07 20:57:18.673303 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.673228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" event={"ID":"66cb9e031b7b9c207b808a77c3fd55dc","Type":"ContainerDied","Data":"3ebab2f5da46a40aa702492b69a488fe0adbcb6bc9e16e583f355c0d7abbd7e7"}
Sep 07 20:57:18.685940 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.685915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"7fe49b97d8dc9fee3aced4d8ca82dd05ef6df0a9ba0567ee8b0783a0495f9e8e"}
Sep 07 20:57:18.690030 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.689918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b" event={"ID":"92cebb43-3e89-490f-ba75-3d022306b1c3","Type":"ContainerStarted","Data":"934beae94b148e2629433f9084677a6d665e5cd6e290db83c84efe282da9e6a1"}
Sep 07 20:57:18.706296 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.705676    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal" event={"ID":"cd25d00ecfdc6dacba0fd37c82f3213c","Type":"ContainerStarted","Data":"c6d0c0a701c3d4497be134806f62188922d80231ffc10cd40dd2d9af4c28f848"}
Sep 07 20:57:18.725460 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.725408    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerStarted","Data":"59890ce650246b23951814da434b39d41c0c276cdc8613e5854f7aec8e86820f"}
Sep 07 20:57:18.726622 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.726357    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal" podStartSLOduration=2.726338252 podStartE2EDuration="2.726338252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:18.72427894 +0000 UTC m=+4.531189493" watchObservedRunningTime="2026-09-07 20:57:18.726338252 +0000 UTC m=+4.533248782"
Sep 07 20:57:18.737870 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.737842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pbj6b" event={"ID":"43bba16a-d690-4864-9e1e-428bd4eb88b8","Type":"ContainerStarted","Data":"02887c7005cab527170b9cdef9db819aa9ba5cd541e0630d3ab520e979932e7d"}
Sep 07 20:57:18.761205 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:18.761174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6n5g" event={"ID":"c5259364-ddc0-4760-a336-7c8975913c1f","Type":"ContainerStarted","Data":"d1aa3b38245e4401026b7533a3216caa439791cdb5b6533456b66ff84c1003fd"}
Sep 07 20:57:19.649057 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:19.649010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:19.649771 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:19.649190    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:19.786963 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:19.786919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" event={"ID":"66cb9e031b7b9c207b808a77c3fd55dc","Type":"ContainerStarted","Data":"b8322202d28abb8750309bb85a66c0c1959001302e3fc2a5ab3437c80b48907a"}
Sep 07 20:57:19.804589 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:19.804481    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" podStartSLOduration=3.804458136 podStartE2EDuration="3.804458136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:19.804221775 +0000 UTC m=+5.611132327" watchObservedRunningTime="2026-09-07 20:57:19.804458136 +0000 UTC m=+5.611368665"
Sep 07 20:57:20.205743 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:20.205691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:20.205946 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:20.205764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:20.206032 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.205960    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:20.206032 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.206030    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs podName:23809825-6a88-483c-8baa-5625142fb636 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:24.206011166 +0000 UTC m=+10.012921672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs") pod "network-metrics-daemon-gh894" (UID: "23809825-6a88-483c-8baa-5625142fb636") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:20.206544 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.206495    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 20:57:20.206544 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.206525    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 20:57:20.206709 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.206552    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tkgkr for pod openshift-network-diagnostics/network-check-target-n2cg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:20.206709 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.206604    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr podName:d9fcc1ec-54d7-49d8-962e-35651197929e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:24.206586084 +0000 UTC m=+10.013496590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkgkr" (UniqueName: "kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr") pod "network-check-target-n2cg2" (UID: "d9fcc1ec-54d7-49d8-962e-35651197929e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:20.306497 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:20.306456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:20.306696 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.306621    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:20.306696 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.306685    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret podName:da7e5605-1bc3-46bd-8151-d5e32f37e05e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:24.30666471 +0000 UTC m=+10.113575219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret") pod "global-pull-secret-syncer-fzg2r" (UID: "da7e5605-1bc3-46bd-8151-d5e32f37e05e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:20.648562 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:20.648165    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:20.648562 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:20.648246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:20.648562 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.648376    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:20.652527 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:20.649040    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:21.648806 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:21.648761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:21.649008 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:21.648896    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:22.649171 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:22.649139    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:22.649697 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:22.649139    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:22.649697 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:22.649291    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:22.649697 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:22.649393    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:23.649123 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:23.649092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:23.649299 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:23.649234    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:24.240837 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:24.240796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:24.241025 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:24.240859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:24.241025 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.241004    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:24.241189 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.241018    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 20:57:24.241189 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.241049    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 20:57:24.241189 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.241063    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tkgkr for pod openshift-network-diagnostics/network-check-target-n2cg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:24.241189 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.241075    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs podName:23809825-6a88-483c-8baa-5625142fb636 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:32.24105456 +0000 UTC m=+18.047965069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs") pod "network-metrics-daemon-gh894" (UID: "23809825-6a88-483c-8baa-5625142fb636") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:24.241189 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.241116    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr podName:d9fcc1ec-54d7-49d8-962e-35651197929e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:32.241096943 +0000 UTC m=+18.048007461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkgkr" (UniqueName: "kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr") pod "network-check-target-n2cg2" (UID: "d9fcc1ec-54d7-49d8-962e-35651197929e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:24.342189 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:24.342108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:24.342365 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.342265    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:24.342365 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.342334    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret podName:da7e5605-1bc3-46bd-8151-d5e32f37e05e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:32.342314859 +0000 UTC m=+18.149225382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret") pod "global-pull-secret-syncer-fzg2r" (UID: "da7e5605-1bc3-46bd-8151-d5e32f37e05e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:24.649209 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:24.649176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:24.649396 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.649299    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:24.649800 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:24.649682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:24.649862 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:24.649794    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:25.648562 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:25.648527    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:25.648758 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:25.648691    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:26.649261 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:26.649225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:26.649727 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:26.649225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:26.649727 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:26.649368    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:26.649727 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:26.649450    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:27.648724 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:27.648689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:27.648884 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:27.648806    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:28.648446 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:28.648411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:28.648446 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:28.648451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:28.648953 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:28.648557    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:28.648953 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:28.648697    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:29.648514 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:29.648477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:29.648989 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:29.648615    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:30.648768 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:30.648726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:30.649199 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:30.648726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:30.649199 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:30.648877    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:30.649199 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:30.648947    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:31.648724 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:31.648684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:31.648930 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:31.648805    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:32.302324 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:32.302295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:32.302503 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:32.302343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:32.302503 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.302454    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:32.302503 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.302478    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 20:57:32.302503 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.302502    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 20:57:32.302709 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.302519    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tkgkr for pod openshift-network-diagnostics/network-check-target-n2cg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:32.302709 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.302534    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs podName:23809825-6a88-483c-8baa-5625142fb636 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:48.302515634 +0000 UTC m=+34.109426142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs") pod "network-metrics-daemon-gh894" (UID: "23809825-6a88-483c-8baa-5625142fb636") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:32.302709 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.302557    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr podName:d9fcc1ec-54d7-49d8-962e-35651197929e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:48.302544982 +0000 UTC m=+34.109455488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkgkr" (UniqueName: "kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr") pod "network-check-target-n2cg2" (UID: "d9fcc1ec-54d7-49d8-962e-35651197929e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:32.403254 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:32.403223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:32.403416 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.403349    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:32.403416 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.403411    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret podName:da7e5605-1bc3-46bd-8151-d5e32f37e05e nodeName:}" failed. No retries permitted until 2026-09-07 20:57:48.403393265 +0000 UTC m=+34.210303770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret") pod "global-pull-secret-syncer-fzg2r" (UID: "da7e5605-1bc3-46bd-8151-d5e32f37e05e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:32.649017 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:32.648988    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:32.649417 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:32.649036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:32.649417 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.649120    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:32.649417 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:32.649214    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:33.649233 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:33.649009    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:33.649690 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:33.649320    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:34.649145 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:34.649109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:34.649327 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:34.649223    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:34.649327 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:34.649276    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:34.649748 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:34.649407    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:35.648342 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:35.648311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:35.648505 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:35.648401    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:36.648851 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.648598    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:36.649593 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.648624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:36.649593 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:36.648985    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:36.649593 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:36.649121    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:36.858318 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.858281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-msnms" event={"ID":"e68a83b8-94a6-4e4d-a339-50244b63ea5e","Type":"ContainerStarted","Data":"3b278e0d1282ac51bcf79c12114283a468374323969ff17ba84cdeb404c8aca6"}
Sep 07 20:57:36.859695 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.859670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zw46w" event={"ID":"89ee16e1-5a2a-4c48-85a0-914b047ce40a","Type":"ContainerStarted","Data":"91d437389d12188bf1a70b6a4022ade24cdb3366836a4178ba670a8e3e586dfe"}
Sep 07 20:57:36.862711 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.862690    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"fe50143cef729b9e97752df9564109a629422bb516c10a5e485b76dbdc8dc142"}
Sep 07 20:57:36.862814 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.862762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"0d82abb57904e991222e9e65a934fba98e90a1f255463757e70608baceecf30a"}
Sep 07 20:57:36.862876 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.862810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"aa75f0cd0d04fc3318422154d8116411815fe5aa6399cf2355c7d7a03832deca"}
Sep 07 20:57:36.862876 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.862847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"cbe3cafaa0c936bd557469486d59e2886dda10e1798ef8fe9533c206fc8d7ada"}
Sep 07 20:57:36.862947 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.862882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"b62147493d190b5307cddfc4cfe2e4e5686ec49135f8884f7c89bb29f3e03c5c"}
Sep 07 20:57:36.862947 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.862926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"edb56034992234f4a6663866d5202843e26dcb6f9233d96b1cf54837a7745c20"}
Sep 07 20:57:36.864072 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.864053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b" event={"ID":"92cebb43-3e89-490f-ba75-3d022306b1c3","Type":"ContainerStarted","Data":"668bacce556e7a4747928946049b5dce7aaae1f1575f1362c846d9f7ef567089"}
Sep 07 20:57:36.865501 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.865477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjw6l" event={"ID":"e345f2dc-607f-4cb2-b6a6-1d748e1d486e","Type":"ContainerStarted","Data":"333032ad0aa26142e13d1935e10d6a39ba01f9f10e4c1b558e0dc9d479be4540"}
Sep 07 20:57:36.866897 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.866873    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3c058ba-708e-4132-9368-4023998fe884" containerID="006c91fd7d910f33354c399fe57a314a138ab601873002fda8a0426f3a4d5152" exitCode=0
Sep 07 20:57:36.866977 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.866920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerDied","Data":"006c91fd7d910f33354c399fe57a314a138ab601873002fda8a0426f3a4d5152"}
Sep 07 20:57:36.868294 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.868276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pbj6b" event={"ID":"43bba16a-d690-4864-9e1e-428bd4eb88b8","Type":"ContainerStarted","Data":"431a6d956a45f8984bbda5e63ce1043e79b1a510fa039b240071e8b1bd75bfdf"}
Sep 07 20:57:36.869665 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.869644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l6n5g" event={"ID":"c5259364-ddc0-4760-a336-7c8975913c1f","Type":"ContainerStarted","Data":"33760c0029d274469e9884ce491e9358fae6d9c36c49615fe54375553dfc1f82"}
Sep 07 20:57:36.879065 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.879027    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-msnms" podStartSLOduration=3.774368361 podStartE2EDuration="21.879014332s" totalImagesPullingTime="18.104645971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:36.878608068 +0000 UTC m=+22.685518609" watchObservedRunningTime="2026-09-07 20:57:36.879014332 +0000 UTC m=+22.685924855"
Sep 07 20:57:36.893013 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.892967    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pbj6b" podStartSLOduration=3.854272615 podStartE2EDuration="21.892954831s" totalImagesPullingTime="18.038682216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:36.892512261 +0000 UTC m=+22.699422796" watchObservedRunningTime="2026-09-07 20:57:36.892954831 +0000 UTC m=+22.699865354"
Sep 07 20:57:36.927163 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.927123    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zw46w" podStartSLOduration=3.879429843 podStartE2EDuration="21.927111419s" totalImagesPullingTime="18.047681576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:36.926917954 +0000 UTC m=+22.733828510" watchObservedRunningTime="2026-09-07 20:57:36.927111419 +0000 UTC m=+22.734021943"
Sep 07 20:57:36.941141 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:36.941100    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mjw6l" podStartSLOduration=7.540828125 podStartE2EDuration="21.941088388s" totalImagesPullingTime="14.400260263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:36.940760098 +0000 UTC m=+22.747670635" watchObservedRunningTime="2026-09-07 20:57:36.941088388 +0000 UTC m=+22.747998913"
Sep 07 20:57:37.118770 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.118741    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 20:57:37.613276 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.613165    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T20:57:37.118765488Z","UUID":"b51d8003-7797-4c54-a893-2e5b686a8952","Handler":null,"Name":"","Endpoint":""}
Sep 07 20:57:37.615428 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.615400    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 20:57:37.615574 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.615473    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 20:57:37.649120 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.649092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:37.649675 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:37.649205    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:37.875015 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.874903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b" event={"ID":"92cebb43-3e89-490f-ba75-3d022306b1c3","Type":"ContainerStarted","Data":"01a926886abffc7defc14e5a9c368192f8bfe5442dae9251ab59bc3c27aee90a"}
Sep 07 20:57:37.876789 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.876749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k9n2r" event={"ID":"adf9a1e0-b26d-448e-9953-a0520ab0a825","Type":"ContainerStarted","Data":"d7f374c18694367740c288a3babb73bf33af3955ffa72249f68595b8025c15ad"}
Sep 07 20:57:37.892136 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.892083    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k9n2r" podStartSLOduration=4.823413004 podStartE2EDuration="22.892063827s" totalImagesPullingTime="18.068650823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:37.891954641 +0000 UTC m=+23.698865183" watchObservedRunningTime="2026-09-07 20:57:37.892063827 +0000 UTC m=+23.698974352"
Sep 07 20:57:37.892286 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:37.892208    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l6n5g" podStartSLOduration=8.499104146 podStartE2EDuration="22.892202369s" totalImagesPullingTime="14.393098223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:36.957142441 +0000 UTC m=+22.764052981" watchObservedRunningTime="2026-09-07 20:57:37.892202369 +0000 UTC m=+23.699112892"
Sep 07 20:57:38.648522 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:38.648280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:38.648635 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:38.648290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:38.648702 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:38.648644    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:38.648702 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:38.648674    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:38.883447 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:38.883369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"e0d535d3bb3c47d507ec64d0e49db0d52d3761acee5c4d1a564024f2819dd2e6"}
Sep 07 20:57:38.885692 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:38.885664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b" event={"ID":"92cebb43-3e89-490f-ba75-3d022306b1c3","Type":"ContainerStarted","Data":"db2d9c77e4d258543b25c24c0eb230c7e0102be1b4fc2e4eb8a61f5a7a01de11"}
Sep 07 20:57:38.904131 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:38.904084    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdl4b" podStartSLOduration=3.969511003 podStartE2EDuration="23.904069362s" totalImagesPullingTime="19.934558359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:38.90352276 +0000 UTC m=+24.710433309" watchObservedRunningTime="2026-09-07 20:57:38.904069362 +0000 UTC m=+24.710979886"
Sep 07 20:57:39.648772 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:39.648744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:39.648969 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:39.648853    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:40.648169 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:40.648139    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:40.648628 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:40.648173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:40.648628 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:40.648283    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:40.648628 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:40.648414    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:40.681531 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:40.681500    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:40.682206 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:40.682179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:40.889365 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:40.889331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:40.889823 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:40.889807    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mjw6l"
Sep 07 20:57:41.649202 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:41.649041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:41.649568 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:41.649272    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:41.895189 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:41.895156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" event={"ID":"366e76df-a042-4064-8eb8-a5dd7d5c888a","Type":"ContainerStarted","Data":"58a01516ae54d1cf1ffe011dd90eaa81088f3adcade20945e6c5d0b6e38e6b9c"}
Sep 07 20:57:41.895443 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:41.895370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:41.897082 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:41.897057    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3c058ba-708e-4132-9368-4023998fe884" containerID="867b4f93e92ba1c308db6ae18b26b8911c8b14fff60514a6a4100bb8de423c70" exitCode=0
Sep 07 20:57:41.897181 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:41.897136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerDied","Data":"867b4f93e92ba1c308db6ae18b26b8911c8b14fff60514a6a4100bb8de423c70"}
Sep 07 20:57:41.910866 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:41.910847    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:41.924169 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:41.924130    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" podStartSLOduration=8.81515274 podStartE2EDuration="26.924118091s" totalImagesPullingTime="18.108965351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:41.923839325 +0000 UTC m=+27.730749875" watchObservedRunningTime="2026-09-07 20:57:41.924118091 +0000 UTC m=+27.731028652"
Sep 07 20:57:42.648643 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.648556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:42.648643 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.648571    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:42.648934 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:42.648693    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:42.649120 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:42.649090    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:42.901639 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.901602    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3c058ba-708e-4132-9368-4023998fe884" containerID="d336f19397f300a4e3ca10bdb877b768c1f84d445498f4e5fdd7a49ad08b25f8" exitCode=0
Sep 07 20:57:42.902357 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.901694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerDied","Data":"d336f19397f300a4e3ca10bdb877b768c1f84d445498f4e5fdd7a49ad08b25f8"}
Sep 07 20:57:42.902357 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.901813    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 20:57:42.902500 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.902426    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:42.904176 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.904154    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh894"]
Sep 07 20:57:42.904282 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.904267    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:42.904440 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:42.904419    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:42.907924 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.907769    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2cg2"]
Sep 07 20:57:42.907924 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.907861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:42.908079 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:42.907947    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:42.908584 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.908566    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzg2r"]
Sep 07 20:57:42.908691 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.908658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:42.908770 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:42.908741    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:42.919527 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:42.919506    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:43.906038 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:43.905781    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3c058ba-708e-4132-9368-4023998fe884" containerID="b97c444f8f2106b4babe88a93454926ad0379a5700fd7641c555aa731b49ae3b" exitCode=0
Sep 07 20:57:43.906425 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:43.905864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerDied","Data":"b97c444f8f2106b4babe88a93454926ad0379a5700fd7641c555aa731b49ae3b"}
Sep 07 20:57:43.906425 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:43.906191    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 20:57:44.649217 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:44.649177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:44.649403 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:44.649263    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:44.649403 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:44.649296    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:44.649403 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:44.649344    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:44.649403 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:44.649388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:44.649639 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:44.649486    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:44.909240 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:44.909138    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 20:57:46.055699 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:46.055669    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:57:46.056102 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:46.055877    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 20:57:46.066475 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:46.066424    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" podUID="366e76df-a042-4064-8eb8-a5dd7d5c888a" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 07 20:57:46.075603 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:46.075568    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq" podUID="366e76df-a042-4064-8eb8-a5dd7d5c888a" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 07 20:57:46.649231 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:46.649196    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:46.649492 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:46.649196    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:46.649492 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:46.649345    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:46.649492 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:46.649455    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:46.649492 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:46.649485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:46.649743 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:46.649584    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:48.317072 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.317029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:48.317478 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.317130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:48.317478 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.317198    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:48.317478 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.317258    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 20:57:48.317478 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.317276    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 20:57:48.317478 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.317290    2564 projected.go:196] Error preparing data for projected volume kube-api-access-tkgkr for pod openshift-network-diagnostics/network-check-target-n2cg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:48.317478 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.317262    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs podName:23809825-6a88-483c-8baa-5625142fb636 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.317245696 +0000 UTC m=+66.124156198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs") pod "network-metrics-daemon-gh894" (UID: "23809825-6a88-483c-8baa-5625142fb636") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 20:57:48.317478 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.317350    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr podName:d9fcc1ec-54d7-49d8-962e-35651197929e nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.317332989 +0000 UTC m=+66.124243494 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tkgkr" (UniqueName: "kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr") pod "network-check-target-n2cg2" (UID: "d9fcc1ec-54d7-49d8-962e-35651197929e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 20:57:48.418171 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.418136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:48.418285 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.418270    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:48.418346 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.418339    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret podName:da7e5605-1bc3-46bd-8151-d5e32f37e05e nodeName:}" failed. No retries permitted until 2026-09-07 20:58:20.418318188 +0000 UTC m=+66.225228697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret") pod "global-pull-secret-syncer-fzg2r" (UID: "da7e5605-1bc3-46bd-8151-d5e32f37e05e") : object "kube-system"/"original-pull-secret" not registered
Sep 07 20:57:48.649086 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.649060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:48.649221 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.649072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:48.649221 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.649155    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n2cg2" podUID="d9fcc1ec-54d7-49d8-962e-35651197929e"
Sep 07 20:57:48.649310 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.649260    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh894" podUID="23809825-6a88-483c-8baa-5625142fb636"
Sep 07 20:57:48.649310 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.649293    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:48.649386 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:48.649365    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzg2r" podUID="da7e5605-1bc3-46bd-8151-d5e32f37e05e"
Sep 07 20:57:48.922514 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.922428    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3c058ba-708e-4132-9368-4023998fe884" containerID="23de99fd44db21abc3b6b89252918e909967ffa814e87adb7c8f9cb735520c7c" exitCode=0
Sep 07 20:57:48.922514 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:48.922499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerDied","Data":"23de99fd44db21abc3b6b89252918e909967ffa814e87adb7c8f9cb735520c7c"}
Sep 07 20:57:49.467382 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.467353    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeReady"
Sep 07 20:57:49.467856 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.467518    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 20:57:49.511285 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.511256    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b4fcb5787-7nqbt"]
Sep 07 20:57:49.524223 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.524197    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cns7p"]
Sep 07 20:57:49.524350 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.524314    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.526653 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.526620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 20:57:49.526958 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.526935    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 20:57:49.527331 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.527307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47zm6\""
Sep 07 20:57:49.527454 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.527428    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 20:57:49.531792 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.531772    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 20:57:49.540402 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.540378    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s2v5r"]
Sep 07 20:57:49.541199 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.540822    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.543317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.543292    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 20:57:49.543420 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.543349    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 20:57:49.543569 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.543548    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdcf7\""
Sep 07 20:57:49.556668 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.556614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4fcb5787-7nqbt"]
Sep 07 20:57:49.556668 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.556648    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cns7p"]
Sep 07 20:57:49.556806 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.556674    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2v5r"]
Sep 07 20:57:49.556806 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.556759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.559253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.559235    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 20:57:49.559778 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.559761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 20:57:49.559864 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.559785    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 20:57:49.559864 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.559824    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sswpn\""
Sep 07 20:57:49.626758 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-installation-pull-secrets\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.626758 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/564e38f2-90ac-472d-b9d5-ed594696fbc3-config-volume\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.626954 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.626954 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-image-registry-private-configuration\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.626954 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-bound-sa-token\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.626954 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsrw\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-kube-api-access-svsrw\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.626954 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f71f4522-bf8d-428a-8898-1308fec33628-ca-trust-extracted\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.626954 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-trusted-ca\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.627169 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.626958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6r44\" (UniqueName: \"kubernetes.io/projected/564e38f2-90ac-472d-b9d5-ed594696fbc3-kube-api-access-m6r44\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.627169 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.627019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.627169 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.627076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-registry-certificates\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.627169 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.627101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/564e38f2-90ac-472d-b9d5-ed594696fbc3-tmp-dir\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.728125 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-trusted-ca\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.728125 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6r44\" (UniqueName: \"kubernetes.io/projected/564e38f2-90ac-472d-b9d5-ed594696fbc3-kube-api-access-m6r44\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.728368 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.728368 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-registry-certificates\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.728368 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7c9w\" (UniqueName: \"kubernetes.io/projected/5c830036-e3ca-4886-b4c6-384893d64ca9-kube-api-access-t7c9w\") pod \"ingress-canary-s2v5r\" (UID: \"5c830036-e3ca-4886-b4c6-384893d64ca9\") " pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.728368 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/564e38f2-90ac-472d-b9d5-ed594696fbc3-tmp-dir\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.728368 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:49.728280    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 20:57:49.728368 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:49.728300    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4fcb5787-7nqbt: secret "image-registry-tls" not found
Sep 07 20:57:49.728368 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-installation-pull-secrets\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.728712 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/564e38f2-90ac-472d-b9d5-ed594696fbc3-config-volume\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.728712 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.728712 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:49.728481    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls podName:f71f4522-bf8d-428a-8898-1308fec33628 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.228439425 +0000 UTC m=+36.035349943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls") pod "image-registry-7b4fcb5787-7nqbt" (UID: "f71f4522-bf8d-428a-8898-1308fec33628") : secret "image-registry-tls" not found
Sep 07 20:57:49.728712 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:49.728509    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 20:57:49.728712 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-image-registry-private-configuration\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.728712 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:49.728555    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls podName:564e38f2-90ac-472d-b9d5-ed594696fbc3 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:50.228539472 +0000 UTC m=+36.035449979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls") pod "dns-default-cns7p" (UID: "564e38f2-90ac-472d-b9d5-ed594696fbc3") : secret "dns-default-metrics-tls" not found
Sep 07 20:57:49.728918 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-bound-sa-token\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.728953 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsrw\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-kube-api-access-svsrw\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.728993 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728715    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/564e38f2-90ac-472d-b9d5-ed594696fbc3-tmp-dir\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.729042 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f71f4522-bf8d-428a-8898-1308fec33628-ca-trust-extracted\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.729042 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.728844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-registry-certificates\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.729042 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.729033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c830036-e3ca-4886-b4c6-384893d64ca9-cert\") pod \"ingress-canary-s2v5r\" (UID: \"5c830036-e3ca-4886-b4c6-384893d64ca9\") " pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.729232 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.729211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-trusted-ca\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.729295 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.729281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f71f4522-bf8d-428a-8898-1308fec33628-ca-trust-extracted\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.729362 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.729348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/564e38f2-90ac-472d-b9d5-ed594696fbc3-config-volume\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.733659 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.733634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-image-registry-private-configuration\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.733741 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.733637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-installation-pull-secrets\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.737529 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.737500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6r44\" (UniqueName: \"kubernetes.io/projected/564e38f2-90ac-472d-b9d5-ed594696fbc3-kube-api-access-m6r44\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:49.738253 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.738230    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsrw\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-kube-api-access-svsrw\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.738344 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.738312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-bound-sa-token\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:49.830281 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.830194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c830036-e3ca-4886-b4c6-384893d64ca9-cert\") pod \"ingress-canary-s2v5r\" (UID: \"5c830036-e3ca-4886-b4c6-384893d64ca9\") " pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.830281 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.830265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7c9w\" (UniqueName: \"kubernetes.io/projected/5c830036-e3ca-4886-b4c6-384893d64ca9-kube-api-access-t7c9w\") pod \"ingress-canary-s2v5r\" (UID: \"5c830036-e3ca-4886-b4c6-384893d64ca9\") " pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.832582 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.832552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c830036-e3ca-4886-b4c6-384893d64ca9-cert\") pod \"ingress-canary-s2v5r\" (UID: \"5c830036-e3ca-4886-b4c6-384893d64ca9\") " pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.846130 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.846109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7c9w\" (UniqueName: \"kubernetes.io/projected/5c830036-e3ca-4886-b4c6-384893d64ca9-kube-api-access-t7c9w\") pod \"ingress-canary-s2v5r\" (UID: \"5c830036-e3ca-4886-b4c6-384893d64ca9\") " pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.865117 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.865055    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2v5r"
Sep 07 20:57:49.928309 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.928279    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3c058ba-708e-4132-9368-4023998fe884" containerID="de781c0f79c560590d6bf06bdc26bdcba9a30010a2cfa84b3427777074dcf192" exitCode=0
Sep 07 20:57:49.928453 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:49.928338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerDied","Data":"de781c0f79c560590d6bf06bdc26bdcba9a30010a2cfa84b3427777074dcf192"}
Sep 07 20:57:50.170897 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.170870    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2v5r"]
Sep 07 20:57:50.174050 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:50.174025    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c830036_e3ca_4886_b4c6_384893d64ca9.slice/crio-9a951afac862d124f34bc4a99667649c20484965ac2481e512652c970c654737 WatchSource:0}: Error finding container 9a951afac862d124f34bc4a99667649c20484965ac2481e512652c970c654737: Status 404 returned error can't find the container with id 9a951afac862d124f34bc4a99667649c20484965ac2481e512652c970c654737
Sep 07 20:57:50.233677 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.233653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:50.233811 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.233704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:50.233811 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:50.233788    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 20:57:50.233811 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:50.233794    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 20:57:50.233811 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:50.233811    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4fcb5787-7nqbt: secret "image-registry-tls" not found
Sep 07 20:57:50.233967 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:50.233835    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls podName:564e38f2-90ac-472d-b9d5-ed594696fbc3 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:51.233822184 +0000 UTC m=+37.040732706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls") pod "dns-default-cns7p" (UID: "564e38f2-90ac-472d-b9d5-ed594696fbc3") : secret "dns-default-metrics-tls" not found
Sep 07 20:57:50.233967 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:50.233909    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls podName:f71f4522-bf8d-428a-8898-1308fec33628 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:51.233889551 +0000 UTC m=+37.040800059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls") pod "image-registry-7b4fcb5787-7nqbt" (UID: "f71f4522-bf8d-428a-8898-1308fec33628") : secret "image-registry-tls" not found
Sep 07 20:57:50.649134 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.649096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:57:50.650156 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.649096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:57:50.650156 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.649108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:57:50.652489 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.652251    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 20:57:50.652489 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.652305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qbj94\""
Sep 07 20:57:50.652489 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.652320    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 20:57:50.652489 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.652255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zznrj\""
Sep 07 20:57:50.652489 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.652256    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 20:57:50.652489 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.652309    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 20:57:50.933131 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.933049    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2v5r" event={"ID":"5c830036-e3ca-4886-b4c6-384893d64ca9","Type":"ContainerStarted","Data":"9a951afac862d124f34bc4a99667649c20484965ac2481e512652c970c654737"}
Sep 07 20:57:50.937026 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.936990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" event={"ID":"f3c058ba-708e-4132-9368-4023998fe884","Type":"ContainerStarted","Data":"53f85cea8264ac0667fcccbcae08f2f5fadfbb44cda8df262a407c913133f788"}
Sep 07 20:57:50.959427 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:50.959382    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pxwjt" podStartSLOduration=8.202704004 podStartE2EDuration="35.959367152s" totalImagesPullingTime="27.756663148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:50.958616009 +0000 UTC m=+36.765526563" watchObservedRunningTime="2026-09-07 20:57:50.959367152 +0000 UTC m=+36.766277675"
Sep 07 20:57:51.242962 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:51.242883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:51.242962 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:51.242952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:51.243164 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:51.243050    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 20:57:51.243164 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:51.243136    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls podName:564e38f2-90ac-472d-b9d5-ed594696fbc3 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:53.243114729 +0000 UTC m=+39.050025234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls") pod "dns-default-cns7p" (UID: "564e38f2-90ac-472d-b9d5-ed594696fbc3") : secret "dns-default-metrics-tls" not found
Sep 07 20:57:51.243164 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:51.243055    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 20:57:51.243164 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:51.243158    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4fcb5787-7nqbt: secret "image-registry-tls" not found
Sep 07 20:57:51.243352 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:51.243210    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls podName:f71f4522-bf8d-428a-8898-1308fec33628 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:53.243194134 +0000 UTC m=+39.050104650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls") pod "image-registry-7b4fcb5787-7nqbt" (UID: "f71f4522-bf8d-428a-8898-1308fec33628") : secret "image-registry-tls" not found
Sep 07 20:57:52.943837 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:52.943619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2v5r" event={"ID":"5c830036-e3ca-4886-b4c6-384893d64ca9","Type":"ContainerStarted","Data":"37d39616f04673fa40c0870b24bf88092aa0514959ee13933bb9cbb92f997844"}
Sep 07 20:57:52.959624 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:52.959580    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s2v5r" podStartSLOduration=1.6198776000000001 podStartE2EDuration="3.959565788s" totalImagesPullingTime="2.339688188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:57:52.958628273 +0000 UTC m=+38.765538797" watchObservedRunningTime="2026-09-07 20:57:52.959565788 +0000 UTC m=+38.766476312"
Sep 07 20:57:53.260314 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:53.260282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:53.260497 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:53.260347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:53.260497 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:53.260442    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 20:57:53.260497 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:53.260476    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4fcb5787-7nqbt: secret "image-registry-tls" not found
Sep 07 20:57:53.260497 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:53.260485    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 20:57:53.260629 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:53.260535    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls podName:564e38f2-90ac-472d-b9d5-ed594696fbc3 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:57.260521517 +0000 UTC m=+43.067432019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls") pod "dns-default-cns7p" (UID: "564e38f2-90ac-472d-b9d5-ed594696fbc3") : secret "dns-default-metrics-tls" not found
Sep 07 20:57:53.260629 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:53.260549    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls podName:f71f4522-bf8d-428a-8898-1308fec33628 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:57.260543071 +0000 UTC m=+43.067453573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls") pod "image-registry-7b4fcb5787-7nqbt" (UID: "f71f4522-bf8d-428a-8898-1308fec33628") : secret "image-registry-tls" not found
Sep 07 20:57:57.287833 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:57.287791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:57:57.288244 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:57.287863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:57:57.288244 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:57.287948    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 20:57:57.288244 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:57.287950    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 20:57:57.288244 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:57.288016    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls podName:564e38f2-90ac-472d-b9d5-ed594696fbc3 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:05.28800031 +0000 UTC m=+51.094910826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls") pod "dns-default-cns7p" (UID: "564e38f2-90ac-472d-b9d5-ed594696fbc3") : secret "dns-default-metrics-tls" not found
Sep 07 20:57:57.288244 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:57.287958    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4fcb5787-7nqbt: secret "image-registry-tls" not found
Sep 07 20:57:57.288244 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:57.288090    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls podName:f71f4522-bf8d-428a-8898-1308fec33628 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:05.288077112 +0000 UTC m=+51.094987614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls") pod "image-registry-7b4fcb5787-7nqbt" (UID: "f71f4522-bf8d-428a-8898-1308fec33628") : secret "image-registry-tls" not found
Sep 07 20:57:58.431240 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.431208    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x9bj9"]
Sep 07 20:57:58.458085 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.458057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9bj9"]
Sep 07 20:57:58.458217 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.458164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.460604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.460578    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 20:57:58.460604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.460604    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 20:57:58.460792 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.460712    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 20:57:58.461767 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.461750    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 20:57:58.461877 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.461838    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n9fsr\""
Sep 07 20:57:58.594436 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.594404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.594603 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.594453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.594603 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.594571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87td5\" (UniqueName: \"kubernetes.io/projected/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-api-access-87td5\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.594676 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.594605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b900ab94-d771-4414-bb1b-1b5af9aea8f2-data-volume\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.594676 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.594631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b900ab94-d771-4414-bb1b-1b5af9aea8f2-crio-socket\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.695911 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.695833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87td5\" (UniqueName: \"kubernetes.io/projected/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-api-access-87td5\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.695911 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.695872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b900ab94-d771-4414-bb1b-1b5af9aea8f2-data-volume\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.695911 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.695909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b900ab94-d771-4414-bb1b-1b5af9aea8f2-crio-socket\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.696160 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.695933    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.696160 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.695966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.696160 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:58.696042    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 20:57:58.696160 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:58.696086    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 20:57:58.696160 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.696113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b900ab94-d771-4414-bb1b-1b5af9aea8f2-crio-socket\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.696160 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:58.696120    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:59.196099122 +0000 UTC m=+45.003009648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : configmap "kube-rbac-proxy" not found
Sep 07 20:57:58.696160 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:58.696161    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:57:59.196147204 +0000 UTC m=+45.003057706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : secret "insights-runtime-extractor-tls" not found
Sep 07 20:57:58.696536 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.696284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b900ab94-d771-4414-bb1b-1b5af9aea8f2-data-volume\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:58.705729 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:58.705700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87td5\" (UniqueName: \"kubernetes.io/projected/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-api-access-87td5\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:59.010570 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.010494    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"]
Sep 07 20:57:59.037250 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.037213    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"]
Sep 07 20:57:59.037431 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.037329    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"
Sep 07 20:57:59.039890 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.039865    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 07 20:57:59.040005 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.039916    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 07 20:57:59.040923 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.040908    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4vqlm\""
Sep 07 20:57:59.098716 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.098687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q2kh\" (UniqueName: \"kubernetes.io/projected/8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba-kube-api-access-6q2kh\") pod \"migrator-fdbb8fdff-72nt2\" (UID: \"8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"
Sep 07 20:57:59.199085 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.199057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:59.199219 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.199157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:57:59.199219 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:59.199163    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 20:57:59.199219 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.199176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2kh\" (UniqueName: \"kubernetes.io/projected/8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba-kube-api-access-6q2kh\") pod \"migrator-fdbb8fdff-72nt2\" (UID: \"8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"
Sep 07 20:57:59.199314 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:59.199238    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:00.199222828 +0000 UTC m=+46.006133334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : configmap "kube-rbac-proxy" not found
Sep 07 20:57:59.199314 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:59.199288    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 20:57:59.199387 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:57:59.199347    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:00.199332006 +0000 UTC m=+46.006242518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : secret "insights-runtime-extractor-tls" not found
Sep 07 20:57:59.212745 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.212718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q2kh\" (UniqueName: \"kubernetes.io/projected/8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba-kube-api-access-6q2kh\") pod \"migrator-fdbb8fdff-72nt2\" (UID: \"8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"
Sep 07 20:57:59.345591 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.345511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"
Sep 07 20:57:59.629885 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.629809    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2"]
Sep 07 20:57:59.632601 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:57:59.632571    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecd5e56_d9a9_49bd_84fe_4f0f08a1f8ba.slice/crio-386afd85a7f9436d34fce08d41ed167d8fbbe2b7448dacf05e86a7dd29c5d528 WatchSource:0}: Error finding container 386afd85a7f9436d34fce08d41ed167d8fbbe2b7448dacf05e86a7dd29c5d528: Status 404 returned error can't find the container with id 386afd85a7f9436d34fce08d41ed167d8fbbe2b7448dacf05e86a7dd29c5d528
Sep 07 20:57:59.960331 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:57:59.960303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2" event={"ID":"8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba","Type":"ContainerStarted","Data":"386afd85a7f9436d34fce08d41ed167d8fbbe2b7448dacf05e86a7dd29c5d528"}
Sep 07 20:58:00.184129 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:00.184103    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6n5g_c5259364-ddc0-4760-a336-7c8975913c1f/dns-node-resolver/0.log"
Sep 07 20:58:00.204500 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:00.204451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:00.204500 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:00.204509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:00.204500 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:00.204580    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 20:58:00.204500 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:00.204624    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 20:58:00.204500 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:00.204642    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:02.204626505 +0000 UTC m=+48.011537025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : configmap "kube-rbac-proxy" not found
Sep 07 20:58:00.204500 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:00.204685    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:02.204667419 +0000 UTC m=+48.011577936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : secret "insights-runtime-extractor-tls" not found
Sep 07 20:58:00.797471 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:00.797433    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pbj6b_43bba16a-d690-4864-9e1e-428bd4eb88b8/node-ca/0.log"
Sep 07 20:58:01.782335 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:01.782307    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2v5r_5c830036-e3ca-4886-b4c6-384893d64ca9/serve-healthcheck-canary/0.log"
Sep 07 20:58:01.967224 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:01.967188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2" event={"ID":"8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba","Type":"ContainerStarted","Data":"f2d3c2a271752af8d4ee9a5f85f10b39b8e87e14630b0f0483ee04a593438d1c"}
Sep 07 20:58:01.967615 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:01.967255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2" event={"ID":"8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba","Type":"ContainerStarted","Data":"24426d6d5bd541d4943a735467886e10c3dd852ce0594f0a0e4365fd5f801121"}
Sep 07 20:58:01.987981 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:01.987928    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-72nt2" podStartSLOduration=2.468084988 podStartE2EDuration="3.987911766s" totalImagesPullingTime="1.519826778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:01.987603643 +0000 UTC m=+47.794514188" watchObservedRunningTime="2026-09-07 20:58:01.987911766 +0000 UTC m=+47.794822292"
Sep 07 20:58:02.220778 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:02.220745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:02.220944 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:02.220787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:02.220944 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:02.220897    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 20:58:02.221032 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:02.220956    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:06.220941434 +0000 UTC m=+52.027851936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : configmap "kube-rbac-proxy" not found
Sep 07 20:58:02.221032 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:02.220897    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 20:58:02.221032 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:02.220994    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:06.220983367 +0000 UTC m=+52.027893871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : secret "insights-runtime-extractor-tls" not found
Sep 07 20:58:05.341261 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:05.341211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:58:05.341669 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:05.341301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:58:05.341669 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:05.341363    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 07 20:58:05.341669 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:05.341384    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4fcb5787-7nqbt: secret "image-registry-tls" not found
Sep 07 20:58:05.341669 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:05.341400    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 20:58:05.341669 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:05.341440    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls podName:f71f4522-bf8d-428a-8898-1308fec33628 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:21.341423928 +0000 UTC m=+67.148334453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls") pod "image-registry-7b4fcb5787-7nqbt" (UID: "f71f4522-bf8d-428a-8898-1308fec33628") : secret "image-registry-tls" not found
Sep 07 20:58:05.341669 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:05.341455    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls podName:564e38f2-90ac-472d-b9d5-ed594696fbc3 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:21.341448461 +0000 UTC m=+67.148358962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls") pod "dns-default-cns7p" (UID: "564e38f2-90ac-472d-b9d5-ed594696fbc3") : secret "dns-default-metrics-tls" not found
Sep 07 20:58:06.247426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:06.247393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:06.247622 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:06.247434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:06.247622 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:06.247575    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 20:58:06.247734 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:06.247654    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls podName:b900ab94-d771-4414-bb1b-1b5af9aea8f2 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:14.247633002 +0000 UTC m=+60.054543525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x9bj9" (UID: "b900ab94-d771-4414-bb1b-1b5af9aea8f2") : secret "insights-runtime-extractor-tls" not found
Sep 07 20:58:06.247940 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:06.247919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b900ab94-d771-4414-bb1b-1b5af9aea8f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:14.303858 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:14.303817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:14.306097 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:14.306074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b900ab94-d771-4414-bb1b-1b5af9aea8f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x9bj9\" (UID: \"b900ab94-d771-4414-bb1b-1b5af9aea8f2\") " pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:14.367186 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:14.367161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x9bj9"
Sep 07 20:58:14.636207 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:14.636130    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x9bj9"]
Sep 07 20:58:14.639695 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:14.639661    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb900ab94_d771_4414_bb1b_1b5af9aea8f2.slice/crio-c468f4f837f049ca5e012c951325259b148d65a1b320e2b75b11b5f2b5e7fcdf WatchSource:0}: Error finding container c468f4f837f049ca5e012c951325259b148d65a1b320e2b75b11b5f2b5e7fcdf: Status 404 returned error can't find the container with id c468f4f837f049ca5e012c951325259b148d65a1b320e2b75b11b5f2b5e7fcdf
Sep 07 20:58:14.998887 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:14.998848    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9bj9" event={"ID":"b900ab94-d771-4414-bb1b-1b5af9aea8f2","Type":"ContainerStarted","Data":"f383c3ed2d37fbe8a2c739333be49a3efe9eb9f4eb004fc2b20839284839a9cc"}
Sep 07 20:58:14.999063 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:14.998944    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9bj9" event={"ID":"b900ab94-d771-4414-bb1b-1b5af9aea8f2","Type":"ContainerStarted","Data":"c468f4f837f049ca5e012c951325259b148d65a1b320e2b75b11b5f2b5e7fcdf"}
Sep 07 20:58:16.003743 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:16.003699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9bj9" event={"ID":"b900ab94-d771-4414-bb1b-1b5af9aea8f2","Type":"ContainerStarted","Data":"9d082ba8fa1129990f61a566c358969a1f1d50d43fc5011b7d2eb053bf41609b"}
Sep 07 20:58:16.077677 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:16.077645    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhlpq"
Sep 07 20:58:17.007732 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:17.007693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x9bj9" event={"ID":"b900ab94-d771-4414-bb1b-1b5af9aea8f2","Type":"ContainerStarted","Data":"a90db63264c4e58a121769c9c0eb56c2b2efc2dc77eeb19a392c7bffd94d080d"}
Sep 07 20:58:17.025912 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:17.025866    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x9bj9" podStartSLOduration=17.183053411 podStartE2EDuration="19.025852719s" totalImagesPullingTime="1.842799308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:17.025116326 +0000 UTC m=+62.832026890" watchObservedRunningTime="2026-09-07 20:58:17.025852719 +0000 UTC m=+62.832763243"
Sep 07 20:58:20.349756 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.349713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:58:20.349756 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.349760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:58:20.352473 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.352432    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 20:58:20.352594 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.352502    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 20:58:20.362498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.362478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23809825-6a88-483c-8baa-5625142fb636-metrics-certs\") pod \"network-metrics-daemon-gh894\" (UID: \"23809825-6a88-483c-8baa-5625142fb636\") " pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:58:20.362589 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.362516    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 20:58:20.370426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.370409    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zznrj\""
Sep 07 20:58:20.372562 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.372546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkgkr\" (UniqueName: \"kubernetes.io/projected/d9fcc1ec-54d7-49d8-962e-35651197929e-kube-api-access-tkgkr\") pod \"network-check-target-n2cg2\" (UID: \"d9fcc1ec-54d7-49d8-962e-35651197929e\") " pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:58:20.378950 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.378931    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh894"
Sep 07 20:58:20.450419 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.450390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:58:20.453245 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.453223    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 20:58:20.463334 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.463316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da7e5605-1bc3-46bd-8151-d5e32f37e05e-original-pull-secret\") pod \"global-pull-secret-syncer-fzg2r\" (UID: \"da7e5605-1bc3-46bd-8151-d5e32f37e05e\") " pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:58:20.644260 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.644187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh894"]
Sep 07 20:58:20.647105 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:20.647079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23809825_6a88_483c_8baa_5625142fb636.slice/crio-ff9d76718d5c2a103c66aa3591b34be23f51ce8dba9790dc60f7c9098760e2aa WatchSource:0}: Error finding container ff9d76718d5c2a103c66aa3591b34be23f51ce8dba9790dc60f7c9098760e2aa: Status 404 returned error can't find the container with id ff9d76718d5c2a103c66aa3591b34be23f51ce8dba9790dc60f7c9098760e2aa
Sep 07 20:58:20.663567 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.663550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qbj94\""
Sep 07 20:58:20.671639 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.671622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:58:20.672864 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.672850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzg2r"
Sep 07 20:58:20.939864 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.939832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzg2r"]
Sep 07 20:58:20.942585 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:20.942554    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7e5605_1bc3_46bd_8151_d5e32f37e05e.slice/crio-a0810c4f4d0bc0d6db3b30a54c305d446a5f84a46c3cd81218c96d3753102094 WatchSource:0}: Error finding container a0810c4f4d0bc0d6db3b30a54c305d446a5f84a46c3cd81218c96d3753102094: Status 404 returned error can't find the container with id a0810c4f4d0bc0d6db3b30a54c305d446a5f84a46c3cd81218c96d3753102094
Sep 07 20:58:20.944231 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:20.944208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n2cg2"]
Sep 07 20:58:20.947662 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:20.947645    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fcc1ec_54d7_49d8_962e_35651197929e.slice/crio-2f9322bd6c7a449dea33da8aa9dd39ca9d3bc18b147056ec7279c6203fc847fb WatchSource:0}: Error finding container 2f9322bd6c7a449dea33da8aa9dd39ca9d3bc18b147056ec7279c6203fc847fb: Status 404 returned error can't find the container with id 2f9322bd6c7a449dea33da8aa9dd39ca9d3bc18b147056ec7279c6203fc847fb
Sep 07 20:58:21.018924 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.018887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzg2r" event={"ID":"da7e5605-1bc3-46bd-8151-d5e32f37e05e","Type":"ContainerStarted","Data":"a0810c4f4d0bc0d6db3b30a54c305d446a5f84a46c3cd81218c96d3753102094"}
Sep 07 20:58:21.020251 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.020219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2cg2" event={"ID":"d9fcc1ec-54d7-49d8-962e-35651197929e","Type":"ContainerStarted","Data":"2f9322bd6c7a449dea33da8aa9dd39ca9d3bc18b147056ec7279c6203fc847fb"}
Sep 07 20:58:21.021554 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.021526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh894" event={"ID":"23809825-6a88-483c-8baa-5625142fb636","Type":"ContainerStarted","Data":"ff9d76718d5c2a103c66aa3591b34be23f51ce8dba9790dc60f7c9098760e2aa"}
Sep 07 20:58:21.358752 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.358668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:58:21.358752 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.358735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:58:21.361247 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.361220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"image-registry-7b4fcb5787-7nqbt\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") " pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:58:21.361370 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.361223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/564e38f2-90ac-472d-b9d5-ed594696fbc3-metrics-tls\") pod \"dns-default-cns7p\" (UID: \"564e38f2-90ac-472d-b9d5-ed594696fbc3\") " pod="openshift-dns/dns-default-cns7p"
Sep 07 20:58:21.637422 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.637216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-47zm6\""
Sep 07 20:58:21.645305 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.645253    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:58:21.651706 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.651687    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdcf7\""
Sep 07 20:58:21.659867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.659845    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cns7p"
Sep 07 20:58:21.949097 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.949048    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4fcb5787-7nqbt"]
Sep 07 20:58:21.964838 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:21.964812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cns7p"]
Sep 07 20:58:21.970474 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:21.970225    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564e38f2_90ac_472d_b9d5_ed594696fbc3.slice/crio-0c3dcb49c0919bc9e27ff4c46f23c14da550005419c58a75bf651bd40d8813a7 WatchSource:0}: Error finding container 0c3dcb49c0919bc9e27ff4c46f23c14da550005419c58a75bf651bd40d8813a7: Status 404 returned error can't find the container with id 0c3dcb49c0919bc9e27ff4c46f23c14da550005419c58a75bf651bd40d8813a7
Sep 07 20:58:22.030633 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.030585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt" event={"ID":"f71f4522-bf8d-428a-8898-1308fec33628","Type":"ContainerStarted","Data":"55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa"}
Sep 07 20:58:22.030781 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.030652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt" event={"ID":"f71f4522-bf8d-428a-8898-1308fec33628","Type":"ContainerStarted","Data":"fb0b1c94d2ab02ece81e2a849496bf5bc737d6dc1eb4e78bddc6025b4dc8ae0f"}
Sep 07 20:58:22.031395 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.031366    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:58:22.034250 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.033970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh894" event={"ID":"23809825-6a88-483c-8baa-5625142fb636","Type":"ContainerStarted","Data":"d827a858138132720c64959c99d889bb1a8654bc598068100dcb55feaa83376c"}
Sep 07 20:58:22.034250 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.034036    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh894" event={"ID":"23809825-6a88-483c-8baa-5625142fb636","Type":"ContainerStarted","Data":"3c319f02226c1d4b30e4aef4f14a2bb49c47c1116079a4ef51fcccc707369ce1"}
Sep 07 20:58:22.035455 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.035431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cns7p" event={"ID":"564e38f2-90ac-472d-b9d5-ed594696fbc3","Type":"ContainerStarted","Data":"0c3dcb49c0919bc9e27ff4c46f23c14da550005419c58a75bf651bd40d8813a7"}
Sep 07 20:58:22.053492 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.053419    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt" podStartSLOduration=52.053399824 podStartE2EDuration="52.053399824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:22.051261291 +0000 UTC m=+67.858171840" watchObservedRunningTime="2026-09-07 20:58:22.053399824 +0000 UTC m=+67.860310349"
Sep 07 20:58:22.072582 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:22.072538    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gh894" podStartSLOduration=66.282780195 podStartE2EDuration="1m7.072523286s" totalImagesPullingTime="789.743091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:22.071592815 +0000 UTC m=+67.878503361" watchObservedRunningTime="2026-09-07 20:58:22.072523286 +0000 UTC m=+67.879433809"
Sep 07 20:58:23.763551 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.763513    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"]
Sep 07 20:58:23.766663 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.766636    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.769961 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.769892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 20:58:23.769961 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.769928    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 20:58:23.771166 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.770992    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 20:58:23.771166 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.770993    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 07 20:58:23.781701 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.781681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"]
Sep 07 20:58:23.880310 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.880276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/902b684f-eea4-420e-a001-e513a03e185a-tmp\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.880310 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.880316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/902b684f-eea4-420e-a001-e513a03e185a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.880584 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.880338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvtrg\" (UniqueName: \"kubernetes.io/projected/902b684f-eea4-420e-a001-e513a03e185a-kube-api-access-bvtrg\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.981254 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.981217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/902b684f-eea4-420e-a001-e513a03e185a-tmp\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.981441 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.981274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/902b684f-eea4-420e-a001-e513a03e185a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.981441 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.981321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvtrg\" (UniqueName: \"kubernetes.io/projected/902b684f-eea4-420e-a001-e513a03e185a-kube-api-access-bvtrg\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.981709 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.981677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/902b684f-eea4-420e-a001-e513a03e185a-tmp\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.984415 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.984390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/902b684f-eea4-420e-a001-e513a03e185a-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:23.998794 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:23.998766    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvtrg\" (UniqueName: \"kubernetes.io/projected/902b684f-eea4-420e-a001-e513a03e185a-kube-api-access-bvtrg\") pod \"klusterlet-addon-workmgr-6bdbb6c55c-cm6nt\" (UID: \"902b684f-eea4-420e-a001-e513a03e185a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:24.078387 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:24.078272    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:26.379617 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.379540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"]
Sep 07 20:58:26.382276 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:26.382245    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902b684f_eea4_420e_a001_e513a03e185a.slice/crio-a3a74b16b7f573fe504fa12899b39e6df9a40bbcdbfd72ece853358d113eea2d WatchSource:0}: Error finding container a3a74b16b7f573fe504fa12899b39e6df9a40bbcdbfd72ece853358d113eea2d: Status 404 returned error can't find the container with id a3a74b16b7f573fe504fa12899b39e6df9a40bbcdbfd72ece853358d113eea2d
Sep 07 20:58:26.670538 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.670509    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"]
Sep 07 20:58:26.673628 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.673603    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"
Sep 07 20:58:26.676075 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.676055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 07 20:58:26.676203 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.676079    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-srjdl\""
Sep 07 20:58:26.686091 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.686069    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"]
Sep 07 20:58:26.802635 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.802608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3cee2afe-8697-4e50-89f8-ea57071a8691-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z2l4p\" (UID: \"3cee2afe-8697-4e50-89f8-ea57071a8691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"
Sep 07 20:58:26.903890 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.903853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3cee2afe-8697-4e50-89f8-ea57071a8691-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z2l4p\" (UID: \"3cee2afe-8697-4e50-89f8-ea57071a8691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"
Sep 07 20:58:26.906217 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.906197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3cee2afe-8697-4e50-89f8-ea57071a8691-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z2l4p\" (UID: \"3cee2afe-8697-4e50-89f8-ea57071a8691\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"
Sep 07 20:58:26.982263 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:26.982188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"
Sep 07 20:58:27.057826 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.057797    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n2cg2" event={"ID":"d9fcc1ec-54d7-49d8-962e-35651197929e","Type":"ContainerStarted","Data":"3d506217f32b7e8d3cae6543e3a0b7cf1ab4ac98645603cfce5ada5963bd7915"}
Sep 07 20:58:27.057961 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.057859    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:58:27.059597 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.059575    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cns7p" event={"ID":"564e38f2-90ac-472d-b9d5-ed594696fbc3","Type":"ContainerStarted","Data":"d160d80df12f24c323cdc30f64ff0ece1d8cba469a06fce8acd4879944a92c11"}
Sep 07 20:58:27.059695 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.059627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cns7p" event={"ID":"564e38f2-90ac-472d-b9d5-ed594696fbc3","Type":"ContainerStarted","Data":"2849e2454436d5386ff01ad74d916a94f2aea7fff6555b8550218e36137d397d"}
Sep 07 20:58:27.059695 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.059687    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cns7p"
Sep 07 20:58:27.060959 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.060940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzg2r" event={"ID":"da7e5605-1bc3-46bd-8151-d5e32f37e05e","Type":"ContainerStarted","Data":"836c56f803388c297acc38485f799543ef41ab4d1dc98907b390fba591d892c0"}
Sep 07 20:58:27.062053 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.062034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt" event={"ID":"902b684f-eea4-420e-a001-e513a03e185a","Type":"ContainerStarted","Data":"a3a74b16b7f573fe504fa12899b39e6df9a40bbcdbfd72ece853358d113eea2d"}
Sep 07 20:58:27.073911 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.073481    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n2cg2" podStartSLOduration=66.90868784 podStartE2EDuration="1m12.07344952s" totalImagesPullingTime="5.16476168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:27.073428374 +0000 UTC m=+72.880338904" watchObservedRunningTime="2026-09-07 20:58:27.07344952 +0000 UTC m=+72.880360047"
Sep 07 20:58:27.091293 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.091259    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cns7p" podStartSLOduration=33.958463212 podStartE2EDuration="38.091247953s" totalImagesPullingTime="4.132784741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:27.090591424 +0000 UTC m=+72.897501974" watchObservedRunningTime="2026-09-07 20:58:27.091247953 +0000 UTC m=+72.898158476"
Sep 07 20:58:27.108175 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.108138    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fzg2r" podStartSLOduration=66.934955725 podStartE2EDuration="1m12.108126836s" totalImagesPullingTime="5.173171111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 20:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:27.107678112 +0000 UTC m=+72.914588659" watchObservedRunningTime="2026-09-07 20:58:27.108126836 +0000 UTC m=+72.915037360"
Sep 07 20:58:27.253017 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:27.252934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"]
Sep 07 20:58:27.258178 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:27.258150    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cee2afe_8697_4e50_89f8_ea57071a8691.slice/crio-34c70501eda5679479cf912dd7ef2a1261df653d0a211c1afea48565d0ab1401 WatchSource:0}: Error finding container 34c70501eda5679479cf912dd7ef2a1261df653d0a211c1afea48565d0ab1401: Status 404 returned error can't find the container with id 34c70501eda5679479cf912dd7ef2a1261df653d0a211c1afea48565d0ab1401
Sep 07 20:58:28.068288 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:28.068242    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p" event={"ID":"3cee2afe-8697-4e50-89f8-ea57071a8691","Type":"ContainerStarted","Data":"34c70501eda5679479cf912dd7ef2a1261df653d0a211c1afea48565d0ab1401"}
Sep 07 20:58:31.079637 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.079573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt" event={"ID":"902b684f-eea4-420e-a001-e513a03e185a","Type":"ContainerStarted","Data":"2f370ef701b72624a924064fb56a0e0d5197b0255881f1074270eb9bd990d8ed"}
Sep 07 20:58:31.080056 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.079789    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:31.081361 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.081330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p" event={"ID":"3cee2afe-8697-4e50-89f8-ea57071a8691","Type":"ContainerStarted","Data":"e752c2dbd5a06bf7a959837c11f0113f77647bfb64560e80dac2f17bfd83a1a8"}
Sep 07 20:58:31.081513 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.081390    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"
Sep 07 20:58:31.082113 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.082086    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt"
Sep 07 20:58:31.086308 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.086286    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p"
Sep 07 20:58:31.096183 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.096142    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bdbb6c55c-cm6nt" podStartSLOduration=4.276536707 podStartE2EDuration="8.096129516s" totalImagesPullingTime="3.819592809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:31.095339251 +0000 UTC m=+76.902249775" watchObservedRunningTime="2026-09-07 20:58:31.096129516 +0000 UTC m=+76.903040039"
Sep 07 20:58:31.125769 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.125730    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z2l4p" podStartSLOduration=3.389946727 podStartE2EDuration="5.125718374s" totalImagesPullingTime="1.735771647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:31.124703618 +0000 UTC m=+76.931614155" watchObservedRunningTime="2026-09-07 20:58:31.125718374 +0000 UTC m=+76.932628897"
Sep 07 20:58:31.737987 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.737949    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"]
Sep 07 20:58:31.742864 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.742840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.745185 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.745162    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 07 20:58:31.745331 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.745307    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 20:58:31.746537 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.746517    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 20:58:31.746631 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.746538    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 20:58:31.746631 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.746546    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7d2b5\""
Sep 07 20:58:31.746631 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.746582    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 07 20:58:31.751159 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.751141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"]
Sep 07 20:58:31.843091 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.843050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.843091 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.843090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.843300 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.843116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgng5\" (UniqueName: \"kubernetes.io/projected/a6e2772c-84f2-4342-80d1-10a174849212-kube-api-access-zgng5\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.843300 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.843156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6e2772c-84f2-4342-80d1-10a174849212-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.944502 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.944450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgng5\" (UniqueName: \"kubernetes.io/projected/a6e2772c-84f2-4342-80d1-10a174849212-kube-api-access-zgng5\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.944694 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.944516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6e2772c-84f2-4342-80d1-10a174849212-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.944694 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.944569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.944810 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.944690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.944866 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:31.944812    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 07 20:58:31.944917 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:31.944882    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-tls podName:a6e2772c-84f2-4342-80d1-10a174849212 nodeName:}" failed. No retries permitted until 2026-09-07 20:58:32.444862718 +0000 UTC m=+78.251773228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-c4vmt" (UID: "a6e2772c-84f2-4342-80d1-10a174849212") : secret "prometheus-operator-tls" not found
Sep 07 20:58:31.945258 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.945239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6e2772c-84f2-4342-80d1-10a174849212-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.946851 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.946820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:31.954511 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:31.954489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgng5\" (UniqueName: \"kubernetes.io/projected/a6e2772c-84f2-4342-80d1-10a174849212-kube-api-access-zgng5\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:32.447296 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:32.447253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:32.449681 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:32.449658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6e2772c-84f2-4342-80d1-10a174849212-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-c4vmt\" (UID: \"a6e2772c-84f2-4342-80d1-10a174849212\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:32.651352 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:32.651321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"
Sep 07 20:58:32.918604 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:32.918575    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-c4vmt"]
Sep 07 20:58:32.921453 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:32.921418    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e2772c_84f2_4342_80d1_10a174849212.slice/crio-ab713a590458d9d3a7ac65e2aa03c519a1812652933dcf766a6fa386d35724cc WatchSource:0}: Error finding container ab713a590458d9d3a7ac65e2aa03c519a1812652933dcf766a6fa386d35724cc: Status 404 returned error can't find the container with id ab713a590458d9d3a7ac65e2aa03c519a1812652933dcf766a6fa386d35724cc
Sep 07 20:58:33.088472 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:33.088373    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt" event={"ID":"a6e2772c-84f2-4342-80d1-10a174849212","Type":"ContainerStarted","Data":"ab713a590458d9d3a7ac65e2aa03c519a1812652933dcf766a6fa386d35724cc"}
Sep 07 20:58:34.093148 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:34.093121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt" event={"ID":"a6e2772c-84f2-4342-80d1-10a174849212","Type":"ContainerStarted","Data":"4ee99aef675ababd392e723e46b99de0013ebce91a8f47af33bacf051ae22028"}
Sep 07 20:58:34.998815 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:34.998781    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-cbl9z"]
Sep 07 20:58:35.001904 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.001887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-cbl9z"
Sep 07 20:58:35.004414 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.004390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 20:58:35.004583 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.004444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tk8bc\""
Sep 07 20:58:35.004583 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.004484    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 20:58:35.023171 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.023141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-cbl9z"]
Sep 07 20:58:35.068111 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.068081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpbhg\" (UniqueName: \"kubernetes.io/projected/f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a-kube-api-access-tpbhg\") pod \"downloads-85d98c998f-cbl9z\" (UID: \"f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a\") " pod="openshift-console/downloads-85d98c998f-cbl9z"
Sep 07 20:58:35.098608 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.098580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt" event={"ID":"a6e2772c-84f2-4342-80d1-10a174849212","Type":"ContainerStarted","Data":"73e764ae040c3f1f2d1c224f38759f4da09f0336e798eb066b70623afcb7ff09"}
Sep 07 20:58:35.118455 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.118408    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-c4vmt" podStartSLOduration=3.027372455 podStartE2EDuration="4.118390227s" totalImagesPullingTime="1.091017772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:35.118024426 +0000 UTC m=+80.924934962" watchObservedRunningTime="2026-09-07 20:58:35.118390227 +0000 UTC m=+80.925300752"
Sep 07 20:58:35.169422 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.169392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpbhg\" (UniqueName: \"kubernetes.io/projected/f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a-kube-api-access-tpbhg\") pod \"downloads-85d98c998f-cbl9z\" (UID: \"f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a\") " pod="openshift-console/downloads-85d98c998f-cbl9z"
Sep 07 20:58:35.178048 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.178027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpbhg\" (UniqueName: \"kubernetes.io/projected/f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a-kube-api-access-tpbhg\") pod \"downloads-85d98c998f-cbl9z\" (UID: \"f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a\") " pod="openshift-console/downloads-85d98c998f-cbl9z"
Sep 07 20:58:35.310741 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.310664    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-cbl9z"
Sep 07 20:58:35.580181 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:35.580103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-cbl9z"]
Sep 07 20:58:35.582324 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:35.582293    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46c93ed_ce17_42f5_a4f4_3ce7151c9a0a.slice/crio-13228e30603ef6380eb2df5e5281b9922185e860f656103977bfde90630d1a15 WatchSource:0}: Error finding container 13228e30603ef6380eb2df5e5281b9922185e860f656103977bfde90630d1a15: Status 404 returned error can't find the container with id 13228e30603ef6380eb2df5e5281b9922185e860f656103977bfde90630d1a15
Sep 07 20:58:36.103371 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:36.103333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-cbl9z" event={"ID":"f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a","Type":"ContainerStarted","Data":"13228e30603ef6380eb2df5e5281b9922185e860f656103977bfde90630d1a15"}
Sep 07 20:58:37.071323 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.071194    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cns7p"
Sep 07 20:58:37.264477 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.264441    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"]
Sep 07 20:58:37.267987 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.267964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.270381 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.270356    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 07 20:58:37.270506 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.270385    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jsw6s\""
Sep 07 20:58:37.270670 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.270655    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 07 20:58:37.287226 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.287196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"]
Sep 07 20:58:37.300302 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.300276    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8ml5r"]
Sep 07 20:58:37.304231 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.303988    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.306339 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.306318    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 20:58:37.306448 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.306351    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 20:58:37.307064 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.307011    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f8l9n\""
Sep 07 20:58:37.307064 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.307030    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 20:58:37.386366 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.386366 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.386586 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-sys\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386586 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-wtmp\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386586 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-tls\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386586 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-root\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386586 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49ll2\" (UniqueName: \"kubernetes.io/projected/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-kube-api-access-49ll2\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.386813 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386813 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386813 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9444a8e-37db-431f-a1a8-ff75e9c7753a-metrics-client-ca\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386813 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-textfile\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386813 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf2qb\" (UniqueName: \"kubernetes.io/projected/d9444a8e-37db-431f-a1a8-ff75e9c7753a-kube-api-access-jf2qb\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.386961 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.386817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.487290 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-sys\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-wtmp\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-tls\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487370    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-sys\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487377    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-root\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487424    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-root\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49ll2\" (UniqueName: \"kubernetes.io/projected/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-kube-api-access-49ll2\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487488 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-wtmp\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9444a8e-37db-431f-a1a8-ff75e9c7753a-metrics-client-ca\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-textfile\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2qb\" (UniqueName: \"kubernetes.io/projected/d9444a8e-37db-431f-a1a8-ff75e9c7753a-kube-api-access-jf2qb\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.487867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.487867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.487867 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.488179 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.487955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-textfile\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.488179 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:37.488058    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 07 20:58:37.488179 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:37.488119    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-tls podName:0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b nodeName:}" failed. No retries permitted until 2026-09-07 20:58:37.988097988 +0000 UTC m=+83.795008507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-t8fg6" (UID: "0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b") : secret "openshift-state-metrics-tls" not found
Sep 07 20:58:37.488547 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.488519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.488781 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.488757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.488863 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.488829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9444a8e-37db-431f-a1a8-ff75e9c7753a-metrics-client-ca\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.490139 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.490118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-tls\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.490418 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.490397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.490483 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.490447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9444a8e-37db-431f-a1a8-ff75e9c7753a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.504097 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.504061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49ll2\" (UniqueName: \"kubernetes.io/projected/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-kube-api-access-49ll2\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.504511 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.504489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2qb\" (UniqueName: \"kubernetes.io/projected/d9444a8e-37db-431f-a1a8-ff75e9c7753a-kube-api-access-jf2qb\") pod \"node-exporter-8ml5r\" (UID: \"d9444a8e-37db-431f-a1a8-ff75e9c7753a\") " pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.615625 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.615593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8ml5r"
Sep 07 20:58:37.629074 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:37.629040    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9444a8e_37db_431f_a1a8_ff75e9c7753a.slice/crio-7a2ed0e98965e5f10a0d1670ea7f0e7eee082e8bb26c001183b9754300c16a3a WatchSource:0}: Error finding container 7a2ed0e98965e5f10a0d1670ea7f0e7eee082e8bb26c001183b9754300c16a3a: Status 404 returned error can't find the container with id 7a2ed0e98965e5f10a0d1670ea7f0e7eee082e8bb26c001183b9754300c16a3a
Sep 07 20:58:37.992894 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.992860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:37.995551 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:37.995524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t8fg6\" (UID: \"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:38.113309 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:38.113271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ml5r" event={"ID":"d9444a8e-37db-431f-a1a8-ff75e9c7753a","Type":"ContainerStarted","Data":"7a2ed0e98965e5f10a0d1670ea7f0e7eee082e8bb26c001183b9754300c16a3a"}
Sep 07 20:58:38.178880 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:38.178845    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"
Sep 07 20:58:38.465767 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:38.465732    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6"]
Sep 07 20:58:38.574156 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:38.574117    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be5c693_1f72_4b1f_b3b8_86ed4d3ae03b.slice/crio-70ab5a4ff542c834ea029db61620d4cddc996756b572c284c5e3cc4d44563f47 WatchSource:0}: Error finding container 70ab5a4ff542c834ea029db61620d4cddc996756b572c284c5e3cc4d44563f47: Status 404 returned error can't find the container with id 70ab5a4ff542c834ea029db61620d4cddc996756b572c284c5e3cc4d44563f47
Sep 07 20:58:39.125773 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.125689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6" event={"ID":"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b","Type":"ContainerStarted","Data":"907fedfdff8eef80f6542befa2405cc04780db6636cf3710fab73c33134cfa1c"}
Sep 07 20:58:39.125773 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.125770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6" event={"ID":"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b","Type":"ContainerStarted","Data":"1a63b5c10b84a12538ebb9d011182077bde97af340ef9856e4a915981ddbd3ee"}
Sep 07 20:58:39.125976 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.125800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6" event={"ID":"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b","Type":"ContainerStarted","Data":"70ab5a4ff542c834ea029db61620d4cddc996756b572c284c5e3cc4d44563f47"}
Sep 07 20:58:39.128966 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.128931    2564 generic.go:356] "Generic (PLEG): container finished" podID="d9444a8e-37db-431f-a1a8-ff75e9c7753a" containerID="ead8642010aa8fbe0776f9c32a5e2526c25a13a82b0c5b94f591d365e74085db" exitCode=0
Sep 07 20:58:39.128966 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.128936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ml5r" event={"ID":"d9444a8e-37db-431f-a1a8-ff75e9c7753a","Type":"ContainerDied","Data":"ead8642010aa8fbe0776f9c32a5e2526c25a13a82b0c5b94f591d365e74085db"}
Sep 07 20:58:39.218386 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.218356    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7976df5f66-2tptg"]
Sep 07 20:58:39.222433 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.222410    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.224804 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.224781    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 07 20:58:39.225189 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.225169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 07 20:58:39.225414 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.225390    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 07 20:58:39.226040 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.225603    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-j2bnr\""
Sep 07 20:58:39.226040 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.225771    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 07 20:58:39.226040 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.225935    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-18cain37n4uek\""
Sep 07 20:58:39.226558 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.226383    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 07 20:58:39.237874 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.237854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7976df5f66-2tptg"]
Sep 07 20:58:39.303752 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.303721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.303890 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.303769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-tls\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.303890 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.303862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-metrics-client-ca\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.304007 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.303913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.304007 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.303964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.304007 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.303988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-grpc-tls\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.304144 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.304028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6f6\" (UniqueName: \"kubernetes.io/projected/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-kube-api-access-mt6f6\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.304144 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.304085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404597 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-tls\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404753 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-metrics-client-ca\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404753 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404753 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404753 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-grpc-tls\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404971 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6f6\" (UniqueName: \"kubernetes.io/projected/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-kube-api-access-mt6f6\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404971 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.404971 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.404931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.405439 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.405416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-metrics-client-ca\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.407876 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.407822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.408186 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.408165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-grpc-tls\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.408260 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.408218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.408323 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.408289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.408648 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.408632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.409943 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.409921    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-secret-thanos-querier-tls\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.413022 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.413000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6f6\" (UniqueName: \"kubernetes.io/projected/099e0b45-6d59-4e0e-bd11-968bbdd1c65b-kube-api-access-mt6f6\") pod \"thanos-querier-7976df5f66-2tptg\" (UID: \"099e0b45-6d59-4e0e-bd11-968bbdd1c65b\") " pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.535058 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.535020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:39.891028 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:39.890995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7976df5f66-2tptg"]
Sep 07 20:58:39.893941 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:39.893915    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099e0b45_6d59_4e0e_bd11_968bbdd1c65b.slice/crio-4ba2e7c0df70ee040b197b60a96da556540ab210cc5bc3c1c054512e7ca1e32d WatchSource:0}: Error finding container 4ba2e7c0df70ee040b197b60a96da556540ab210cc5bc3c1c054512e7ca1e32d: Status 404 returned error can't find the container with id 4ba2e7c0df70ee040b197b60a96da556540ab210cc5bc3c1c054512e7ca1e32d
Sep 07 20:58:40.136367 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:40.136282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ml5r" event={"ID":"d9444a8e-37db-431f-a1a8-ff75e9c7753a","Type":"ContainerStarted","Data":"94b0838861b31510f9f90ec1591bc485aa1cb6bae0cb869cb136909f07897524"}
Sep 07 20:58:40.136367 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:40.136338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ml5r" event={"ID":"d9444a8e-37db-431f-a1a8-ff75e9c7753a","Type":"ContainerStarted","Data":"aa1681b370082854a4a02b15f5d0e6ad25620d1808fbf843d1b5619ed5480359"}
Sep 07 20:58:40.139203 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:40.139170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6" event={"ID":"0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b","Type":"ContainerStarted","Data":"3ca88a6a589e315aebc04001051cd6dbd8a25b46f2c5c5990b926821c630fc85"}
Sep 07 20:58:40.140562 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:40.140528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" event={"ID":"099e0b45-6d59-4e0e-bd11-968bbdd1c65b","Type":"ContainerStarted","Data":"4ba2e7c0df70ee040b197b60a96da556540ab210cc5bc3c1c054512e7ca1e32d"}
Sep 07 20:58:40.157901 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:40.157847    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8ml5r" podStartSLOduration=2.090410504 podStartE2EDuration="3.15782813s" totalImagesPullingTime="995.029698ms" totalInitContainerRuntime="72.387928ms" isStatefulPod=true podCreationTimestamp="2026-09-07 20:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:40.156305024 +0000 UTC m=+85.963215575" watchObservedRunningTime="2026-09-07 20:58:40.15782813 +0000 UTC m=+85.964738651"
Sep 07 20:58:40.179083 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:40.178960    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t8fg6" podStartSLOduration=2.239511329 podStartE2EDuration="3.178940184s" totalImagesPullingTime="939.428855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:40.178303788 +0000 UTC m=+85.985214324" watchObservedRunningTime="2026-09-07 20:58:40.178940184 +0000 UTC m=+85.985850709"
Sep 07 20:58:41.941160 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:41.941125    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"]
Sep 07 20:58:41.945083 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:41.945059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:41.947368 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:41.947343    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 07 20:58:41.947521 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:41.947491    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mp5gn\""
Sep 07 20:58:41.958511 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:41.958211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"]
Sep 07 20:58:42.031621 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.031583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7mvq\" (UniqueName: \"kubernetes.io/projected/593fbde5-8a72-4107-8310-6b96f9db08ae-kube-api-access-h7mvq\") pod \"monitoring-plugin-85bbbbbf4-hmhmr\" (UID: \"593fbde5-8a72-4107-8310-6b96f9db08ae\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:42.031770 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.031662    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/593fbde5-8a72-4107-8310-6b96f9db08ae-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hmhmr\" (UID: \"593fbde5-8a72-4107-8310-6b96f9db08ae\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:42.132688 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.132656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/593fbde5-8a72-4107-8310-6b96f9db08ae-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hmhmr\" (UID: \"593fbde5-8a72-4107-8310-6b96f9db08ae\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:42.132881 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.132724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mvq\" (UniqueName: \"kubernetes.io/projected/593fbde5-8a72-4107-8310-6b96f9db08ae-kube-api-access-h7mvq\") pod \"monitoring-plugin-85bbbbbf4-hmhmr\" (UID: \"593fbde5-8a72-4107-8310-6b96f9db08ae\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:42.132881 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:42.132826    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 07 20:58:42.132992 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:58:42.132916    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593fbde5-8a72-4107-8310-6b96f9db08ae-monitoring-plugin-cert podName:593fbde5-8a72-4107-8310-6b96f9db08ae nodeName:}" failed. No retries permitted until 2026-09-07 20:58:42.632898567 +0000 UTC m=+88.439809068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/593fbde5-8a72-4107-8310-6b96f9db08ae-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-hmhmr" (UID: "593fbde5-8a72-4107-8310-6b96f9db08ae") : secret "monitoring-plugin-cert" not found
Sep 07 20:58:42.143888 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.143859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7mvq\" (UniqueName: \"kubernetes.io/projected/593fbde5-8a72-4107-8310-6b96f9db08ae-kube-api-access-h7mvq\") pod \"monitoring-plugin-85bbbbbf4-hmhmr\" (UID: \"593fbde5-8a72-4107-8310-6b96f9db08ae\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:42.155528 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.155496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" event={"ID":"099e0b45-6d59-4e0e-bd11-968bbdd1c65b","Type":"ContainerStarted","Data":"e38bdb08ebcc0a9fb42b9cc544f5ef0e7ffcac53281ba3bbc9ef6ea010f423ab"}
Sep 07 20:58:42.155676 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.155579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" event={"ID":"099e0b45-6d59-4e0e-bd11-968bbdd1c65b","Type":"ContainerStarted","Data":"fddd033727a96a8b5aed64ff6247f1b1b6dbf33f8878bd597d26da5a772bd979"}
Sep 07 20:58:42.155676 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.155609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" event={"ID":"099e0b45-6d59-4e0e-bd11-968bbdd1c65b","Type":"ContainerStarted","Data":"8af564c4166b9fc7f5c361f8efb7aa071a54cac65151df4a3ab6ab237a3f2220"}
Sep 07 20:58:42.638795 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.638759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/593fbde5-8a72-4107-8310-6b96f9db08ae-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hmhmr\" (UID: \"593fbde5-8a72-4107-8310-6b96f9db08ae\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:42.641144 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.641123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/593fbde5-8a72-4107-8310-6b96f9db08ae-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-hmhmr\" (UID: \"593fbde5-8a72-4107-8310-6b96f9db08ae\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:42.856040 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:42.855960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:43.131383 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.131300    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"]
Sep 07 20:58:43.134551 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:43.134518    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593fbde5_8a72_4107_8310_6b96f9db08ae.slice/crio-bf073ecb9bb73da4eef9c0e8af7a3a65fcbc29a288b5e5c53eb494fd1e2b0f1e WatchSource:0}: Error finding container bf073ecb9bb73da4eef9c0e8af7a3a65fcbc29a288b5e5c53eb494fd1e2b0f1e: Status 404 returned error can't find the container with id bf073ecb9bb73da4eef9c0e8af7a3a65fcbc29a288b5e5c53eb494fd1e2b0f1e
Sep 07 20:58:43.163268 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.163222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" event={"ID":"099e0b45-6d59-4e0e-bd11-968bbdd1c65b","Type":"ContainerStarted","Data":"1a6803d5ea2c30b64e8d98231e55fbe08a8a02fa81db91c508ae7d60950c7ba4"}
Sep 07 20:58:43.163387 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.163313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" event={"ID":"099e0b45-6d59-4e0e-bd11-968bbdd1c65b","Type":"ContainerStarted","Data":"7cf63a71d5afc1795a5f01b3335891d917a482064c5568e05b04e24e87174b76"}
Sep 07 20:58:43.163387 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.163360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" event={"ID":"099e0b45-6d59-4e0e-bd11-968bbdd1c65b","Type":"ContainerStarted","Data":"c5e532492223cc50f6ed2b57140f2d3b05c06eda4fe65f44e5326b5e4e62323f"}
Sep 07 20:58:43.163520 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.163406    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:43.164644 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.164610    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr" event={"ID":"593fbde5-8a72-4107-8310-6b96f9db08ae","Type":"ContainerStarted","Data":"bf073ecb9bb73da4eef9c0e8af7a3a65fcbc29a288b5e5c53eb494fd1e2b0f1e"}
Sep 07 20:58:43.197448 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.197399    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg" podStartSLOduration=1.8483829379999999 podStartE2EDuration="4.1973842s" totalImagesPullingTime="2.349001262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:43.196531878 +0000 UTC m=+89.003442421" watchObservedRunningTime="2026-09-07 20:58:43.1973842 +0000 UTC m=+89.004294725"
Sep 07 20:58:43.515951 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.515914    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 20:58:43.520819 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.520793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.524525 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.524495    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 20:58:43.524744 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.524720    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 20:58:43.524923 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.524905    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 20:58:43.525166 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.525147    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-22j27\""
Sep 07 20:58:43.525378 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.525293    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 20:58:43.526083 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.525618    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 20:58:43.526083 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.525668    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 20:58:43.526083 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.525954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 20:58:43.526083 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.526046    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 20:58:43.527558 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.526738    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 20:58:43.527558 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.526980    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 20:58:43.527558 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.527195    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 20:58:43.528164 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.527989    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 20:58:43.528164 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.528045    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 20:58:43.528317 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.528255    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 20:58:43.528435 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.528416    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 20:58:43.528520 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.528494    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dr1llcmj21i9e\""
Sep 07 20:58:43.538065 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.537034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 20:58:43.649014 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.648979    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649200 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649200 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649200 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649361 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649361 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649361 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-config\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649361 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649361 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649619 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649619 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649412    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649619 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649619 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649619 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649619 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649619 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649941 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649941 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649941 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.649941 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.649710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czqnl\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-kube-api-access-czqnl\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751272 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-config\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751498 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czqnl\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-kube-api-access-czqnl\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.751816 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751811    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.752251 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.751834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.752251 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.752219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.753321 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.753291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.753923 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.753888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.755133 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.755102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.755359 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.755329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.755961 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.755930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.757105 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.757077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.757267 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.757239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.757733 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.757705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.757817 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.757781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.758364 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.758337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.761132 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.761105    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.762132 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.762112    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.762658 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.762618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czqnl\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-kube-api-access-czqnl\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.762755 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.762727    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.763176 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.763140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.763752 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.763716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.765787 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.765764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.766392 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.766321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.766990 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.766969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-config\") pod \"prometheus-k8s-0\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:43.838270 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:43.838231    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:58:44.050924 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:44.050831    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:58:44.146019 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:44.145856    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 20:58:44.425982 ip-10-0-138-24 kubenswrapper[2564]: W0907 20:58:44.425950    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8359e84c_be55_4c40_824d_66a25ffd748c.slice/crio-6d660e322a6d9da50f959d42eec8784d433f98cbab855cf485b3c95f0fc3c7c8 WatchSource:0}: Error finding container 6d660e322a6d9da50f959d42eec8784d433f98cbab855cf485b3c95f0fc3c7c8: Status 404 returned error can't find the container with id 6d660e322a6d9da50f959d42eec8784d433f98cbab855cf485b3c95f0fc3c7c8
Sep 07 20:58:45.175800 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:45.175760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr" event={"ID":"593fbde5-8a72-4107-8310-6b96f9db08ae","Type":"ContainerStarted","Data":"d87bb7aa6db60ee34d501889c67e676055627b5d2e403e7e0af6bb87716de24c"}
Sep 07 20:58:45.176281 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:45.176221    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:45.177728 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:45.177695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerStarted","Data":"6d660e322a6d9da50f959d42eec8784d433f98cbab855cf485b3c95f0fc3c7c8"}
Sep 07 20:58:45.182065 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:45.182042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr"
Sep 07 20:58:45.197067 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:45.197019    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-hmhmr" podStartSLOduration=2.860586543 podStartE2EDuration="4.196999735s" totalImagesPullingTime="1.336413192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:45.196070314 +0000 UTC m=+91.002980865" watchObservedRunningTime="2026-09-07 20:58:45.196999735 +0000 UTC m=+91.003910260"
Sep 07 20:58:47.940684 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:47.940648    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4fcb5787-7nqbt"]
Sep 07 20:58:49.177688 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:49.177648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7976df5f66-2tptg"
Sep 07 20:58:53.215642 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:53.215613    2564 generic.go:356] "Generic (PLEG): container finished" podID="8359e84c-be55-4c40-824d-66a25ffd748c" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251" exitCode=0
Sep 07 20:58:53.216051 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:53.215688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"}
Sep 07 20:58:53.217341 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:53.217316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-cbl9z" event={"ID":"f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a","Type":"ContainerStarted","Data":"2d6987d72cf9bbe71795849b6138278ab964179f463af43cb4c44f8df8efe028"}
Sep 07 20:58:53.217518 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:53.217493    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-cbl9z"
Sep 07 20:58:53.218937 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:53.218911    2564 patch_prober.go:28] interesting pod/downloads-85d98c998f-cbl9z container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body=
Sep 07 20:58:53.219031 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:53.218960    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-cbl9z" podUID="f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused"
Sep 07 20:58:53.269448 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:53.269365    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-cbl9z" podStartSLOduration=1.785491769 podStartE2EDuration="19.269349042s" totalImagesPullingTime="17.483857273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:53.268986326 +0000 UTC m=+99.075896850" watchObservedRunningTime="2026-09-07 20:58:53.269349042 +0000 UTC m=+99.076259566"
Sep 07 20:58:54.235033 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:54.234996    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-cbl9z"
Sep 07 20:58:58.071074 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.071031    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n2cg2"
Sep 07 20:58:58.246240 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.246162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerStarted","Data":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"}
Sep 07 20:58:58.246401 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.246243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerStarted","Data":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"}
Sep 07 20:58:58.246401 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.246285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerStarted","Data":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"}
Sep 07 20:58:58.246401 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.246323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerStarted","Data":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"}
Sep 07 20:58:58.246401 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.246355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerStarted","Data":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"}
Sep 07 20:58:58.246401 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.246397    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerStarted","Data":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"}
Sep 07 20:58:58.275123 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.275061    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.768894761 podStartE2EDuration="15.275041907s" totalImagesPullingTime="12.494935516s" totalInitContainerRuntime="11.21163ms" isStatefulPod=false podCreationTimestamp="2026-09-07 20:58:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 20:58:58.272993186 +0000 UTC m=+104.079903765" watchObservedRunningTime="2026-09-07 20:58:58.275041907 +0000 UTC m=+104.081952432"
Sep 07 20:58:58.838711 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:58:58.838654    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:59:12.964538 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:12.964470    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt" podUID="f71f4522-bf8d-428a-8898-1308fec33628" containerName="registry" containerID="cri-o://55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa" gracePeriod=30
Sep 07 20:59:13.232534 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.232478    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:59:13.305309 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305263    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.305565 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305334    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-image-registry-private-configuration\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.305565 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305366    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-bound-sa-token\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.305565 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305390    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f71f4522-bf8d-428a-8898-1308fec33628-ca-trust-extracted\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.305565 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-installation-pull-secrets\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.305565 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-trusted-ca\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.305565 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305536    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svsrw\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-kube-api-access-svsrw\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.305953 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.305573    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-registry-certificates\") pod \"f71f4522-bf8d-428a-8898-1308fec33628\" (UID: \"f71f4522-bf8d-428a-8898-1308fec33628\") "
Sep 07 20:59:13.306134 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.306106    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 20:59:13.307259 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.307207    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 20:59:13.308406 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.308356    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 20:59:13.308554 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.308504    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 20:59:13.308620 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.308564    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-kube-api-access-svsrw" (OuterVolumeSpecName: "kube-api-access-svsrw") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "kube-api-access-svsrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 20:59:13.308676 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.308620    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 20:59:13.308731 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.308707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 20:59:13.311667 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.311644    2564 generic.go:356] "Generic (PLEG): container finished" podID="f71f4522-bf8d-428a-8898-1308fec33628" containerID="55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa" exitCode=0
Sep 07 20:59:13.311769 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.311699    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt"
Sep 07 20:59:13.311769 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.311730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt" event={"ID":"f71f4522-bf8d-428a-8898-1308fec33628","Type":"ContainerDied","Data":"55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa"}
Sep 07 20:59:13.311871 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.311796    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b4fcb5787-7nqbt" event={"ID":"f71f4522-bf8d-428a-8898-1308fec33628","Type":"ContainerDied","Data":"fb0b1c94d2ab02ece81e2a849496bf5bc737d6dc1eb4e78bddc6025b4dc8ae0f"}
Sep 07 20:59:13.311871 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.311826    2564 scope.go:117] "RemoveContainer" containerID="55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa"
Sep 07 20:59:13.315893 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.315864    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f71f4522-bf8d-428a-8898-1308fec33628-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f71f4522-bf8d-428a-8898-1308fec33628" (UID: "f71f4522-bf8d-428a-8898-1308fec33628"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 20:59:13.323823 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.323809    2564 scope.go:117] "RemoveContainer" containerID="55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa"
Sep 07 20:59:13.324112 ip-10-0-138-24 kubenswrapper[2564]: E0907 20:59:13.324092    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa\": container with ID starting with 55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa not found: ID does not exist" containerID="55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa"
Sep 07 20:59:13.324180 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.324119    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa"} err="failed to get container status \"55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa\": rpc error: code = NotFound desc = could not find container \"55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa\": container with ID starting with 55260bb17f77cb8fdf60790d581bbf4b011c86987dad378166bab6e543a797fa not found: ID does not exist"
Sep 07 20:59:13.406269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406245    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svsrw\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-kube-api-access-svsrw\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.406269 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406268    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-registry-certificates\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.406426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406277    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-registry-tls\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.406426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406286    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-image-registry-private-configuration\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.406426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406296    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f71f4522-bf8d-428a-8898-1308fec33628-bound-sa-token\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.406426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406303    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f71f4522-bf8d-428a-8898-1308fec33628-ca-trust-extracted\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.406426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406313    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f71f4522-bf8d-428a-8898-1308fec33628-installation-pull-secrets\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.406426 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.406321    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f71f4522-bf8d-428a-8898-1308fec33628-trusted-ca\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 20:59:13.635881 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.635849    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4fcb5787-7nqbt"]
Sep 07 20:59:13.641693 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:13.641663    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b4fcb5787-7nqbt"]
Sep 07 20:59:14.653549 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:14.653517    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f71f4522-bf8d-428a-8898-1308fec33628" path="/var/lib/kubelet/pods/f71f4522-bf8d-428a-8898-1308fec33628/volumes"
Sep 07 20:59:43.839429 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:43.839394    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:59:43.858979 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:43.858947    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 20:59:44.450037 ip-10-0-138-24 kubenswrapper[2564]: I0907 20:59:44.450012    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:01.944576 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:01.944528    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:00:01.945576 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:01.945394    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy" containerID="cri-o://0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970" gracePeriod=600
Sep 07 21:00:01.945576 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:01.945427    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="config-reloader" containerID="cri-o://215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94" gracePeriod=600
Sep 07 21:00:01.945576 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:01.945434    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="thanos-sidecar" containerID="cri-o://5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef" gracePeriod=600
Sep 07 21:00:01.945576 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:01.945486    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-web" containerID="cri-o://a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91" gracePeriod=600
Sep 07 21:00:01.945576 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:01.945377    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="prometheus" containerID="cri-o://8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382" gracePeriod=600
Sep 07 21:00:01.945900 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:01.945670    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b" gracePeriod=600
Sep 07 21:00:02.203420 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.203348    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.292646 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292613    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-tls-assets\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.292801 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292659    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-trusted-ca-bundle\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.292801 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.292801 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292732    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.292801 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292758    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-thanos-prometheus-http-client-file\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.292972 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-config\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.292972 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-metrics-client-certs\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.292972 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292962    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-2\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.292991    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-tls\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293020    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-serving-certs-ca-bundle\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293051    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-metrics-client-ca\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293080    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-grpc-tls\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293077    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:00:02.293118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293115    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-web-config\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293410 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-db\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293410 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-0\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293410 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293207    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-kube-rbac-proxy\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293410 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-kubelet-serving-ca-bundle\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293410 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293268    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czqnl\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-kube-api-access-czqnl\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293410 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293307    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-config-out\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293410 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293347    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-1\") pod \"8359e84c-be55-4c40-824d-66a25ffd748c\" (UID: \"8359e84c-be55-4c40-824d-66a25ffd748c\") "
Sep 07 21:00:02.293787 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293494    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:00:02.293787 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293599    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-metrics-client-ca\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.293787 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293620    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.293941 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.293807    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:00:02.294416 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.294166    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:00:02.295317 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.294837    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:00:02.296729 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.296444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.296890 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.296828    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:00:02.297347 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.297347 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:00:02.297347 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297293    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-config" (OuterVolumeSpecName: "config") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.297347 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297333    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.297605 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297498    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:00:02.297731 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297692    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.297793 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297726    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:00:02.297986 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.297932    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-kube-api-access-czqnl" (OuterVolumeSpecName: "kube-api-access-czqnl") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "kube-api-access-czqnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:00:02.298092 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.298005    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.298244 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.298220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.298777 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.298752    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.299215 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.299187    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-config-out" (OuterVolumeSpecName: "config-out") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:00:02.307752 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.307729    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-web-config" (OuterVolumeSpecName: "web-config") pod "8359e84c-be55-4c40-824d-66a25ffd748c" (UID: "8359e84c-be55-4c40-824d-66a25ffd748c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:00:02.394344 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394305    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-web-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394344 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394341    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-db\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394344 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394350    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394344 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394359    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-kube-rbac-proxy\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394371    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394380    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czqnl\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-kube-api-access-czqnl\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394388    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8359e84c-be55-4c40-824d-66a25ffd748c-config-out\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394396    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394404    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8359e84c-be55-4c40-824d-66a25ffd748c-tls-assets\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394412    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394420    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394429    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394436    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394445    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-metrics-client-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394453    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394477    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394486    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8359e84c-be55-4c40-824d-66a25ffd748c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.394637 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.394495    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8359e84c-be55-4c40-824d-66a25ffd748c-secret-grpc-tls\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502054    2564 generic.go:356] "Generic (PLEG): container finished" podID="8359e84c-be55-4c40-824d-66a25ffd748c" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b" exitCode=0
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502083    2564 generic.go:356] "Generic (PLEG): container finished" podID="8359e84c-be55-4c40-824d-66a25ffd748c" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970" exitCode=0
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502093    2564 generic.go:356] "Generic (PLEG): container finished" podID="8359e84c-be55-4c40-824d-66a25ffd748c" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91" exitCode=0
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502101    2564 generic.go:356] "Generic (PLEG): container finished" podID="8359e84c-be55-4c40-824d-66a25ffd748c" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef" exitCode=0
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502108    2564 generic.go:356] "Generic (PLEG): container finished" podID="8359e84c-be55-4c40-824d-66a25ffd748c" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94" exitCode=0
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502117    2564 generic.go:356] "Generic (PLEG): container finished" podID="8359e84c-be55-4c40-824d-66a25ffd748c" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382" exitCode=0
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502124    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.502148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"}
Sep 07 21:00:02.502680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"}
Sep 07 21:00:02.502680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502233    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"}
Sep 07 21:00:02.502680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502257    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"}
Sep 07 21:00:02.502680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502278    2564 scope.go:117] "RemoveContainer" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.502680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"}
Sep 07 21:00:02.502680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"}
Sep 07 21:00:02.502680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.502410    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8359e84c-be55-4c40-824d-66a25ffd748c","Type":"ContainerDied","Data":"6d660e322a6d9da50f959d42eec8784d433f98cbab855cf485b3c95f0fc3c7c8"}
Sep 07 21:00:02.511028 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.510946    2564 scope.go:117] "RemoveContainer" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.520771 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.520750    2564 scope.go:117] "RemoveContainer" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.527860 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.527844    2564 scope.go:117] "RemoveContainer" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.534421 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.534407    2564 scope.go:117] "RemoveContainer" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.538894 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.538871    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:00:02.541775 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.541757    2564 scope.go:117] "RemoveContainer" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.548737 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.548720    2564 scope.go:117] "RemoveContainer" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.555401 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.555384    2564 scope.go:117] "RemoveContainer" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.555671 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:00:02.555653    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": container with ID starting with 7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b not found: ID does not exist" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.555729 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.555682    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"} err="failed to get container status \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": rpc error: code = NotFound desc = could not find container \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": container with ID starting with 7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b not found: ID does not exist"
Sep 07 21:00:02.555729 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.555700    2564 scope.go:117] "RemoveContainer" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.555925 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:00:02.555909    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": container with ID starting with 0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970 not found: ID does not exist" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.555968 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.555931    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"} err="failed to get container status \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": rpc error: code = NotFound desc = could not find container \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": container with ID starting with 0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970 not found: ID does not exist"
Sep 07 21:00:02.555968 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.555942    2564 scope.go:117] "RemoveContainer" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.556105 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556087    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:00:02.556163 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:00:02.556149    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": container with ID starting with a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91 not found: ID does not exist" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.556198 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556168    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"} err="failed to get container status \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": rpc error: code = NotFound desc = could not find container \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": container with ID starting with a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91 not found: ID does not exist"
Sep 07 21:00:02.556198 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556180    2564 scope.go:117] "RemoveContainer" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.556386 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:00:02.556369    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": container with ID starting with 5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef not found: ID does not exist" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.556424 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556391    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"} err="failed to get container status \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": rpc error: code = NotFound desc = could not find container \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": container with ID starting with 5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef not found: ID does not exist"
Sep 07 21:00:02.556424 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556406    2564 scope.go:117] "RemoveContainer" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.556681 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:00:02.556665    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": container with ID starting with 215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94 not found: ID does not exist" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.556748 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556682    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"} err="failed to get container status \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": rpc error: code = NotFound desc = could not find container \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": container with ID starting with 215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94 not found: ID does not exist"
Sep 07 21:00:02.556748 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556694    2564 scope.go:117] "RemoveContainer" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.556938 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:00:02.556925    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": container with ID starting with 8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382 not found: ID does not exist" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.556972 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556941    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"} err="failed to get container status \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": rpc error: code = NotFound desc = could not find container \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": container with ID starting with 8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382 not found: ID does not exist"
Sep 07 21:00:02.556972 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.556953    2564 scope.go:117] "RemoveContainer" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.557187 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:00:02.557171    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": container with ID starting with 799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251 not found: ID does not exist" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.557228 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557190    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"} err="failed to get container status \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": rpc error: code = NotFound desc = could not find container \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": container with ID starting with 799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251 not found: ID does not exist"
Sep 07 21:00:02.557228 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557202    2564 scope.go:117] "RemoveContainer" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.557446 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557428    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"} err="failed to get container status \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": rpc error: code = NotFound desc = could not find container \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": container with ID starting with 7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b not found: ID does not exist"
Sep 07 21:00:02.557522 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557446    2564 scope.go:117] "RemoveContainer" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.557708 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557689    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"} err="failed to get container status \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": rpc error: code = NotFound desc = could not find container \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": container with ID starting with 0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970 not found: ID does not exist"
Sep 07 21:00:02.557749 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557709    2564 scope.go:117] "RemoveContainer" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.557935 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557917    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"} err="failed to get container status \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": rpc error: code = NotFound desc = could not find container \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": container with ID starting with a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91 not found: ID does not exist"
Sep 07 21:00:02.557991 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.557936    2564 scope.go:117] "RemoveContainer" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.558158 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558142    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"} err="failed to get container status \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": rpc error: code = NotFound desc = could not find container \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": container with ID starting with 5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef not found: ID does not exist"
Sep 07 21:00:02.558196 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558158    2564 scope.go:117] "RemoveContainer" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.558372 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558355    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"} err="failed to get container status \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": rpc error: code = NotFound desc = could not find container \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": container with ID starting with 215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94 not found: ID does not exist"
Sep 07 21:00:02.558416 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558372    2564 scope.go:117] "RemoveContainer" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.558609 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558592    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"} err="failed to get container status \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": rpc error: code = NotFound desc = could not find container \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": container with ID starting with 8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382 not found: ID does not exist"
Sep 07 21:00:02.558671 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558609    2564 scope.go:117] "RemoveContainer" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.558830 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558814    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"} err="failed to get container status \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": rpc error: code = NotFound desc = could not find container \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": container with ID starting with 799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251 not found: ID does not exist"
Sep 07 21:00:02.558872 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.558832    2564 scope.go:117] "RemoveContainer" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.559054 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559037    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"} err="failed to get container status \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": rpc error: code = NotFound desc = could not find container \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": container with ID starting with 7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b not found: ID does not exist"
Sep 07 21:00:02.559096 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559054    2564 scope.go:117] "RemoveContainer" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.559276 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559260    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"} err="failed to get container status \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": rpc error: code = NotFound desc = could not find container \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": container with ID starting with 0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970 not found: ID does not exist"
Sep 07 21:00:02.559329 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559277    2564 scope.go:117] "RemoveContainer" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.559537 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559513    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"} err="failed to get container status \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": rpc error: code = NotFound desc = could not find container \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": container with ID starting with a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91 not found: ID does not exist"
Sep 07 21:00:02.559537 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559532    2564 scope.go:117] "RemoveContainer" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.559760 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559741    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"} err="failed to get container status \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": rpc error: code = NotFound desc = could not find container \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": container with ID starting with 5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef not found: ID does not exist"
Sep 07 21:00:02.559811 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559760    2564 scope.go:117] "RemoveContainer" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.559986 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559969    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"} err="failed to get container status \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": rpc error: code = NotFound desc = could not find container \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": container with ID starting with 215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94 not found: ID does not exist"
Sep 07 21:00:02.560030 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.559987    2564 scope.go:117] "RemoveContainer" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.560199 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560185    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"} err="failed to get container status \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": rpc error: code = NotFound desc = could not find container \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": container with ID starting with 8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382 not found: ID does not exist"
Sep 07 21:00:02.560199 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560198    2564 scope.go:117] "RemoveContainer" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.560423 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560400    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"} err="failed to get container status \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": rpc error: code = NotFound desc = could not find container \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": container with ID starting with 799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251 not found: ID does not exist"
Sep 07 21:00:02.560499 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560423    2564 scope.go:117] "RemoveContainer" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.560694 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560676    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"} err="failed to get container status \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": rpc error: code = NotFound desc = could not find container \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": container with ID starting with 7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b not found: ID does not exist"
Sep 07 21:00:02.560694 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560694    2564 scope.go:117] "RemoveContainer" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.560949 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560932    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"} err="failed to get container status \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": rpc error: code = NotFound desc = could not find container \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": container with ID starting with 0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970 not found: ID does not exist"
Sep 07 21:00:02.561024 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.560949    2564 scope.go:117] "RemoveContainer" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.561200 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561183    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"} err="failed to get container status \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": rpc error: code = NotFound desc = could not find container \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": container with ID starting with a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91 not found: ID does not exist"
Sep 07 21:00:02.561265 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561201    2564 scope.go:117] "RemoveContainer" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.561428 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561411    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"} err="failed to get container status \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": rpc error: code = NotFound desc = could not find container \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": container with ID starting with 5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef not found: ID does not exist"
Sep 07 21:00:02.561513 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561428    2564 scope.go:117] "RemoveContainer" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.561717 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561694    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"} err="failed to get container status \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": rpc error: code = NotFound desc = could not find container \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": container with ID starting with 215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94 not found: ID does not exist"
Sep 07 21:00:02.561717 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561716    2564 scope.go:117] "RemoveContainer" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.561986 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561957    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"} err="failed to get container status \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": rpc error: code = NotFound desc = could not find container \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": container with ID starting with 8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382 not found: ID does not exist"
Sep 07 21:00:02.562031 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.561987    2564 scope.go:117] "RemoveContainer" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.562237 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562217    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"} err="failed to get container status \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": rpc error: code = NotFound desc = could not find container \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": container with ID starting with 799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251 not found: ID does not exist"
Sep 07 21:00:02.562299 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562237    2564 scope.go:117] "RemoveContainer" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.562486 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562452    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"} err="failed to get container status \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": rpc error: code = NotFound desc = could not find container \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": container with ID starting with 7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b not found: ID does not exist"
Sep 07 21:00:02.562552 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562487    2564 scope.go:117] "RemoveContainer" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.562725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562708    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"} err="failed to get container status \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": rpc error: code = NotFound desc = could not find container \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": container with ID starting with 0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970 not found: ID does not exist"
Sep 07 21:00:02.562780 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562727    2564 scope.go:117] "RemoveContainer" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.562952 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562935    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"} err="failed to get container status \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": rpc error: code = NotFound desc = could not find container \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": container with ID starting with a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91 not found: ID does not exist"
Sep 07 21:00:02.562993 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.562951    2564 scope.go:117] "RemoveContainer" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.563154 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563137    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"} err="failed to get container status \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": rpc error: code = NotFound desc = could not find container \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": container with ID starting with 5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef not found: ID does not exist"
Sep 07 21:00:02.563214 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563154    2564 scope.go:117] "RemoveContainer" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.563392 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563371    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"} err="failed to get container status \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": rpc error: code = NotFound desc = could not find container \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": container with ID starting with 215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94 not found: ID does not exist"
Sep 07 21:00:02.563392 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563391    2564 scope.go:117] "RemoveContainer" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.563630 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563613    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"} err="failed to get container status \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": rpc error: code = NotFound desc = could not find container \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": container with ID starting with 8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382 not found: ID does not exist"
Sep 07 21:00:02.563671 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563632    2564 scope.go:117] "RemoveContainer" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.563860 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563845    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"} err="failed to get container status \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": rpc error: code = NotFound desc = could not find container \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": container with ID starting with 799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251 not found: ID does not exist"
Sep 07 21:00:02.563896 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.563861    2564 scope.go:117] "RemoveContainer" containerID="7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"
Sep 07 21:00:02.564070 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564047    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b"} err="failed to get container status \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": rpc error: code = NotFound desc = could not find container \"7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b\": container with ID starting with 7c2f909af0de32a5292a747cafe57ccdc0ed44cc8ce784a67141b3d22ddf414b not found: ID does not exist"
Sep 07 21:00:02.564106 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564071    2564 scope.go:117] "RemoveContainer" containerID="0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"
Sep 07 21:00:02.564298 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564283    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970"} err="failed to get container status \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": rpc error: code = NotFound desc = could not find container \"0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970\": container with ID starting with 0def266b05774858d2a9ef916549453e5268658238b45d4bb093c8a795d8a970 not found: ID does not exist"
Sep 07 21:00:02.564332 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564298    2564 scope.go:117] "RemoveContainer" containerID="a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"
Sep 07 21:00:02.564510 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564494    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91"} err="failed to get container status \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": rpc error: code = NotFound desc = could not find container \"a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91\": container with ID starting with a59e4bbaccbafddf365869da7e337aca2637065605ff4b1b3e0332aafc3cec91 not found: ID does not exist"
Sep 07 21:00:02.564551 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564510    2564 scope.go:117] "RemoveContainer" containerID="5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"
Sep 07 21:00:02.564739 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564721    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef"} err="failed to get container status \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": rpc error: code = NotFound desc = could not find container \"5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef\": container with ID starting with 5c78e1b360880d6f1dd3ee568b1cde981376b550753ec0b43d26f15ab71d54ef not found: ID does not exist"
Sep 07 21:00:02.564776 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564741    2564 scope.go:117] "RemoveContainer" containerID="215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"
Sep 07 21:00:02.564946 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564930    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94"} err="failed to get container status \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": rpc error: code = NotFound desc = could not find container \"215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94\": container with ID starting with 215e7c2f952d377306fc7d44dd9d014f428cc26c1efabba7df36bf4e6bb2ef94 not found: ID does not exist"
Sep 07 21:00:02.564993 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.564946    2564 scope.go:117] "RemoveContainer" containerID="8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"
Sep 07 21:00:02.565171 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.565145    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382"} err="failed to get container status \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": rpc error: code = NotFound desc = could not find container \"8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382\": container with ID starting with 8eed5119ac2b08760825e4036d65c0462a6c5ee33c640503ac2aef647e266382 not found: ID does not exist"
Sep 07 21:00:02.565171 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.565166    2564 scope.go:117] "RemoveContainer" containerID="799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"
Sep 07 21:00:02.565385 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.565370    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251"} err="failed to get container status \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": rpc error: code = NotFound desc = could not find container \"799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251\": container with ID starting with 799d9405fa24ddcb3b6471407f649d23d6f880390c93d140a47b9113180b5251 not found: ID does not exist"
Sep 07 21:00:02.586247 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586228    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:00:02.586531 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586519    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="init-config-reloader"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586533    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="init-config-reloader"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586542    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586547    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586555    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f71f4522-bf8d-428a-8898-1308fec33628" containerName="registry"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586561    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f71f4522-bf8d-428a-8898-1308fec33628" containerName="registry"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586568    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="config-reloader"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586573    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="config-reloader"
Sep 07 21:00:02.586582 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586583    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-web"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586589    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-web"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586598    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="thanos-sidecar"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586604    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="thanos-sidecar"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586612    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="prometheus"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586619    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="prometheus"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586629    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-thanos"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586637    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-thanos"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586684    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="config-reloader"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586693    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="prometheus"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586698    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-thanos"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586705    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f71f4522-bf8d-428a-8898-1308fec33628" containerName="registry"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586711    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="thanos-sidecar"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586716    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy"
Sep 07 21:00:02.586807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.586721    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" containerName="kube-rbac-proxy-web"
Sep 07 21:00:02.590663 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.590643    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.593399 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593367    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 21:00:02.593487 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593414    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 21:00:02.593487 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593446    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 21:00:02.593607 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593506    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-22j27\""
Sep 07 21:00:02.593807 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593789    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 21:00:02.593884 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593798    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 21:00:02.593884 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593842    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 21:00:02.593884 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593854    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 21:00:02.594030 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 21:00:02.594030 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593844    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 21:00:02.594030 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.593948    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 21:00:02.594176 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.594090    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 21:00:02.594278 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.594254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 21:00:02.594278 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.594266    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 21:00:02.594387 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.594308    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dr1llcmj21i9e\""
Sep 07 21:00:02.597253 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.597192    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 21:00:02.599140 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.599124    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 21:00:02.609677 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.609645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:00:02.653988 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.653960    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8359e84c-be55-4c40-824d-66a25ffd748c" path="/var/lib/kubelet/pods/8359e84c-be55-4c40-824d-66a25ffd748c/volumes"
Sep 07 21:00:02.696276 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696427 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qcjv\" (UniqueName: \"kubernetes.io/projected/a9b8c094-54ce-44c6-888f-2374ba2e9dff-kube-api-access-2qcjv\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696427 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696427 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9b8c094-54ce-44c6-888f-2374ba2e9dff-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696427 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696427 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696427 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-config\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9b8c094-54ce-44c6-888f-2374ba2e9dff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.696678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.697017 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.697017 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.697017 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.697017 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.697017 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.696828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797174 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797174 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qcjv\" (UniqueName: \"kubernetes.io/projected/a9b8c094-54ce-44c6-888f-2374ba2e9dff-kube-api-access-2qcjv\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797174 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797174 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9b8c094-54ce-44c6-888f-2374ba2e9dff-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797295    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-config\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797455 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797893 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9b8c094-54ce-44c6-888f-2374ba2e9dff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797893 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.797893 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.797787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.798252 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.798210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800159 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9b8c094-54ce-44c6-888f-2374ba2e9dff-config-out\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-config\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-web-config\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800965 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800617    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800965 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9b8c094-54ce-44c6-888f-2374ba2e9dff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800965 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.800965 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.801157 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.800972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.801157 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.801083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.801244 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.801187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.801244 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.801229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.801347 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.801240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.802394 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.802371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.803176 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.803154    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.803265 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.803210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a9b8c094-54ce-44c6-888f-2374ba2e9dff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.803770 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.803748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a9b8c094-54ce-44c6-888f-2374ba2e9dff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.806209 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.806192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qcjv\" (UniqueName: \"kubernetes.io/projected/a9b8c094-54ce-44c6-888f-2374ba2e9dff-kube-api-access-2qcjv\") pod \"prometheus-k8s-0\" (UID: \"a9b8c094-54ce-44c6-888f-2374ba2e9dff\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:02.900849 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:02.900812    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:00:03.175709 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:03.175620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 21:00:03.180219 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:00:03.180193    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b8c094_54ce_44c6_888f_2374ba2e9dff.slice/crio-212dd6d2eb5f102bfa9b2a97c4c0b58013c35cd45dd0204f132a53bee0c8008a WatchSource:0}: Error finding container 212dd6d2eb5f102bfa9b2a97c4c0b58013c35cd45dd0204f132a53bee0c8008a: Status 404 returned error can't find the container with id 212dd6d2eb5f102bfa9b2a97c4c0b58013c35cd45dd0204f132a53bee0c8008a
Sep 07 21:00:03.507774 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:03.507682    2564 generic.go:356] "Generic (PLEG): container finished" podID="a9b8c094-54ce-44c6-888f-2374ba2e9dff" containerID="600e806606e50b767ebcf635dfe7c18c1f9bd793ace25c5055e9abaeb9acda56" exitCode=0
Sep 07 21:00:03.507928 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:03.507766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerDied","Data":"600e806606e50b767ebcf635dfe7c18c1f9bd793ace25c5055e9abaeb9acda56"}
Sep 07 21:00:03.507928 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:03.507853    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerStarted","Data":"212dd6d2eb5f102bfa9b2a97c4c0b58013c35cd45dd0204f132a53bee0c8008a"}
Sep 07 21:00:04.516245 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:04.516208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerStarted","Data":"55ee0caf58acd8f18943437039f5cc411f27c8ed7d8d72a5a71091888f541a14"}
Sep 07 21:00:04.516725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:04.516309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerStarted","Data":"8cc165fa8e180c77e7e3863b3a18f9bbbcd92bfc048f1ea0aa7eb0e7ff7bb70c"}
Sep 07 21:00:04.516725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:04.516342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerStarted","Data":"940fe692253e108e51ae7fc3dcc0ae6cab4fbed7046a24ec4e3412fdc64f04ca"}
Sep 07 21:00:04.516725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:04.516373    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerStarted","Data":"5b30986b25fc37bd906da92d9401559bbf55cff60a24c71de143199c25e3069a"}
Sep 07 21:00:04.516725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:04.516397    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerStarted","Data":"57e2c0f3fc03dbe7aecc19138bbf7027bb37b905b24bfbcf608904c51453d315"}
Sep 07 21:00:04.516725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:04.516419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a9b8c094-54ce-44c6-888f-2374ba2e9dff","Type":"ContainerStarted","Data":"52a1c5f2427455c9476ba145274a74873a3d97fdeee0be86fc7c9b8200aafb9c"}
Sep 07 21:00:04.548379 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:04.548326    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.529737873 podStartE2EDuration="2.548296475s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.558602ms" isStatefulPod=false podCreationTimestamp="2026-09-07 21:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:00:04.546732957 +0000 UTC m=+170.353643498" watchObservedRunningTime="2026-09-07 21:00:04.548296475 +0000 UTC m=+170.355207001"
Sep 07 21:00:07.901957 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:00:07.901871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:01:02.901272 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:01:02.901237    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:01:02.916665 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:01:02.916640    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:01:03.739299 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:01:03.739270    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 21:02:14.580296 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:14.580272    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 21:02:22.253480 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.253434    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"]
Sep 07 21:02:22.255923 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.255907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.258502 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.258478    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 21:02:22.259565 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.259542    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bxd4k\""
Sep 07 21:02:22.259717 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.259542    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 21:02:22.269306 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.266841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"]
Sep 07 21:02:22.362156 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.362115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.362345 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.362163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcf95\" (UniqueName: \"kubernetes.io/projected/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-kube-api-access-mcf95\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.362345 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.362184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.463093 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.463054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcf95\" (UniqueName: \"kubernetes.io/projected/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-kube-api-access-mcf95\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.463093 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.463091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.463317 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.463154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.463577 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.463559    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.463625 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.463575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.471887 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.471863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcf95\" (UniqueName: \"kubernetes.io/projected/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-kube-api-access-mcf95\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.565822 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.565737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:22.839974 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.839948    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"]
Sep 07 21:02:22.842352 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:02:22.842325    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c91bcad_18c5_47f3_a8d3_884a790ca9bf.slice/crio-a218bbb615748b626061cbbed420044453359eecf49d5a4fc7f0c965d1848f2b WatchSource:0}: Error finding container a218bbb615748b626061cbbed420044453359eecf49d5a4fc7f0c965d1848f2b: Status 404 returned error can't find the container with id a218bbb615748b626061cbbed420044453359eecf49d5a4fc7f0c965d1848f2b
Sep 07 21:02:22.844155 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:22.844138    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:02:23.007902 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.007866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg" event={"ID":"8c91bcad-18c5-47f3-a8d3-884a790ca9bf","Type":"ContainerStarted","Data":"a218bbb615748b626061cbbed420044453359eecf49d5a4fc7f0c965d1848f2b"}
Sep 07 21:02:23.714088 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.714019    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"]
Sep 07 21:02:23.716910 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.716875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.720025 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.719805    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 21:02:23.720198 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.720072    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-rltt9\""
Sep 07 21:02:23.720551 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.720266    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 21:02:23.720551 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.720348    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 21:02:23.730635 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.730594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"]
Sep 07 21:02:23.774148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd21c77-fedf-4297-8324-2270eae84602-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774327 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774327 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774327 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774327 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd21c77-fedf-4297-8324-2270eae84602-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774545 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774423    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd21c77-fedf-4297-8324-2270eae84602-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774545 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774626 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.774626 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.774573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2592\" (UniqueName: \"kubernetes.io/projected/bcd21c77-fedf-4297-8324-2270eae84602-kube-api-access-m2592\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875312 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875312 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875580 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd21c77-fedf-4297-8324-2270eae84602-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875580 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd21c77-fedf-4297-8324-2270eae84602-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875580 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875580 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875580 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2592\" (UniqueName: \"kubernetes.io/projected/bcd21c77-fedf-4297-8324-2270eae84602-kube-api-access-m2592\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875580 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd21c77-fedf-4297-8324-2270eae84602-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875927 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.875927 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.876033 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.875959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.876133 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.876113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.876199 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.876179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.876408 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.876385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd21c77-fedf-4297-8324-2270eae84602-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.877955 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.877929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd21c77-fedf-4297-8324-2270eae84602-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.878151 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.878135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd21c77-fedf-4297-8324-2270eae84602-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.884257 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.884231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd21c77-fedf-4297-8324-2270eae84602-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:23.884390 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:23.884238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2592\" (UniqueName: \"kubernetes.io/projected/bcd21c77-fedf-4297-8324-2270eae84602-kube-api-access-m2592\") pod \"openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s\" (UID: \"bcd21c77-fedf-4297-8324-2270eae84602\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:24.032417 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:24.032331    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:24.319711 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:24.319623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"]
Sep 07 21:02:24.323108 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:02:24.323068    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd21c77_fedf_4297_8324_2270eae84602.slice/crio-c926ce140383b09376a05f403431964b18a65102a12cda2032768f6581f2750b WatchSource:0}: Error finding container c926ce140383b09376a05f403431964b18a65102a12cda2032768f6581f2750b: Status 404 returned error can't find the container with id c926ce140383b09376a05f403431964b18a65102a12cda2032768f6581f2750b
Sep 07 21:02:25.018152 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:25.018104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s" event={"ID":"bcd21c77-fedf-4297-8324-2270eae84602","Type":"ContainerStarted","Data":"c926ce140383b09376a05f403431964b18a65102a12cda2032768f6581f2750b"}
Sep 07 21:02:29.030555 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:29.030502    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 21:02:29.030824 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:29.030584    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 21:02:29.030824 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:29.030620    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 21:02:30.042239 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:30.042207    2564 generic.go:356] "Generic (PLEG): container finished" podID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerID="b961509081319ea342d870b99c353ab1bd41c05ae3adfafb8241f106fbedbe75" exitCode=0
Sep 07 21:02:30.042722 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:30.042295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg" event={"ID":"8c91bcad-18c5-47f3-a8d3-884a790ca9bf","Type":"ContainerDied","Data":"b961509081319ea342d870b99c353ab1bd41c05ae3adfafb8241f106fbedbe75"}
Sep 07 21:02:30.043955 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:30.043928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s" event={"ID":"bcd21c77-fedf-4297-8324-2270eae84602","Type":"ContainerStarted","Data":"19491bf021ad8a0a6b15e9417cb22f51a0e2d0bdc927e5949aaacdeba42f5505"}
Sep 07 21:02:30.077966 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:30.077923    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s" podStartSLOduration=2.373092305 podStartE2EDuration="7.07790969s" totalImagesPullingTime="4.704817385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:30.076144643 +0000 UTC m=+315.883055185" watchObservedRunningTime="2026-09-07 21:02:30.07790969 +0000 UTC m=+315.884820213"
Sep 07 21:02:31.032990 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:31.032961    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:31.037967 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:31.037946    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:31.049670 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:31.049643    2564 generic.go:356] "Generic (PLEG): container finished" podID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerID="55e2e9fa17c9a8bb8169b29e31cebb5593a8f61a316b424ce8f562dd15caa1ca" exitCode=0
Sep 07 21:02:31.049939 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:31.049723    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg" event={"ID":"8c91bcad-18c5-47f3-a8d3-884a790ca9bf","Type":"ContainerDied","Data":"55e2e9fa17c9a8bb8169b29e31cebb5593a8f61a316b424ce8f562dd15caa1ca"}
Sep 07 21:02:31.049985 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:31.049969    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:31.050731 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:31.050715    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s"
Sep 07 21:02:37.076735 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:37.076631    2564 generic.go:356] "Generic (PLEG): container finished" podID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerID="d48e8622313b37952113f7c02ce65faadea2a861e6a6be690e9e585f8b10df77" exitCode=0
Sep 07 21:02:37.076735 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:37.076718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg" event={"ID":"8c91bcad-18c5-47f3-a8d3-884a790ca9bf","Type":"ContainerDied","Data":"d48e8622313b37952113f7c02ce65faadea2a861e6a6be690e9e585f8b10df77"}
Sep 07 21:02:38.204299 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.204273    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:38.304711 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.304681    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcf95\" (UniqueName: \"kubernetes.io/projected/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-kube-api-access-mcf95\") pod \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") "
Sep 07 21:02:38.304852 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.304737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-bundle\") pod \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") "
Sep 07 21:02:38.304852 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.304828    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-util\") pod \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\" (UID: \"8c91bcad-18c5-47f3-a8d3-884a790ca9bf\") "
Sep 07 21:02:38.305190 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.305168    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-bundle" (OuterVolumeSpecName: "bundle") pod "8c91bcad-18c5-47f3-a8d3-884a790ca9bf" (UID: "8c91bcad-18c5-47f3-a8d3-884a790ca9bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:02:38.306845 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.306816    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-kube-api-access-mcf95" (OuterVolumeSpecName: "kube-api-access-mcf95") pod "8c91bcad-18c5-47f3-a8d3-884a790ca9bf" (UID: "8c91bcad-18c5-47f3-a8d3-884a790ca9bf"). InnerVolumeSpecName "kube-api-access-mcf95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:02:38.308783 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.308763    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-util" (OuterVolumeSpecName: "util") pod "8c91bcad-18c5-47f3-a8d3-884a790ca9bf" (UID: "8c91bcad-18c5-47f3-a8d3-884a790ca9bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 21:02:38.406353 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.406315    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:02:38.406353 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.406353    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcf95\" (UniqueName: \"kubernetes.io/projected/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-kube-api-access-mcf95\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:02:38.406545 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:38.406368    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c91bcad-18c5-47f3-a8d3-884a790ca9bf-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:02:39.086222 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:39.086121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg" event={"ID":"8c91bcad-18c5-47f3-a8d3-884a790ca9bf","Type":"ContainerDied","Data":"a218bbb615748b626061cbbed420044453359eecf49d5a4fc7f0c965d1848f2b"}
Sep 07 21:02:39.086222 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:39.086150    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sv6zg"
Sep 07 21:02:39.086222 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:39.086172    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a218bbb615748b626061cbbed420044453359eecf49d5a4fc7f0c965d1848f2b"
Sep 07 21:02:40.898505 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898474    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"]
Sep 07 21:02:40.898877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898775    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerName="pull"
Sep 07 21:02:40.898877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898786    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerName="pull"
Sep 07 21:02:40.898877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898801    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerName="extract"
Sep 07 21:02:40.898877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898808    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerName="extract"
Sep 07 21:02:40.898877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898819    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerName="util"
Sep 07 21:02:40.898877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898824    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerName="util"
Sep 07 21:02:40.898877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.898875    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c91bcad-18c5-47f3-a8d3-884a790ca9bf" containerName="extract"
Sep 07 21:02:40.902373 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.902357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:40.904946 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.904926    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Sep 07 21:02:40.905849 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.905830    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Sep 07 21:02:40.905902 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.905830    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-ktjz6\""
Sep 07 21:02:40.911598 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:40.911577    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"]
Sep 07 21:02:41.029426 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.029394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a52baa2e-b58f-412a-be7d-7e26235cde4f-tmp\") pod \"jobset-operator-56d489b4b8-jjzzr\" (UID: \"a52baa2e-b58f-412a-be7d-7e26235cde4f\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:41.029612 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.029437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnc9f\" (UniqueName: \"kubernetes.io/projected/a52baa2e-b58f-412a-be7d-7e26235cde4f-kube-api-access-pnc9f\") pod \"jobset-operator-56d489b4b8-jjzzr\" (UID: \"a52baa2e-b58f-412a-be7d-7e26235cde4f\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:41.130404 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.130355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a52baa2e-b58f-412a-be7d-7e26235cde4f-tmp\") pod \"jobset-operator-56d489b4b8-jjzzr\" (UID: \"a52baa2e-b58f-412a-be7d-7e26235cde4f\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:41.130591 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.130417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnc9f\" (UniqueName: \"kubernetes.io/projected/a52baa2e-b58f-412a-be7d-7e26235cde4f-kube-api-access-pnc9f\") pod \"jobset-operator-56d489b4b8-jjzzr\" (UID: \"a52baa2e-b58f-412a-be7d-7e26235cde4f\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:41.130855 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.130834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a52baa2e-b58f-412a-be7d-7e26235cde4f-tmp\") pod \"jobset-operator-56d489b4b8-jjzzr\" (UID: \"a52baa2e-b58f-412a-be7d-7e26235cde4f\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:41.142135 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.142107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnc9f\" (UniqueName: \"kubernetes.io/projected/a52baa2e-b58f-412a-be7d-7e26235cde4f-kube-api-access-pnc9f\") pod \"jobset-operator-56d489b4b8-jjzzr\" (UID: \"a52baa2e-b58f-412a-be7d-7e26235cde4f\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:41.220163 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.220092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"
Sep 07 21:02:41.494148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:41.494126    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr"]
Sep 07 21:02:41.496593 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:02:41.496564    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda52baa2e_b58f_412a_be7d_7e26235cde4f.slice/crio-d50d6060ea73cbf3652a98221d1759504c3d6542975aa60fe42dac1cf3ab11c5 WatchSource:0}: Error finding container d50d6060ea73cbf3652a98221d1759504c3d6542975aa60fe42dac1cf3ab11c5: Status 404 returned error can't find the container with id d50d6060ea73cbf3652a98221d1759504c3d6542975aa60fe42dac1cf3ab11c5
Sep 07 21:02:42.097396 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:42.097364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr" event={"ID":"a52baa2e-b58f-412a-be7d-7e26235cde4f","Type":"ContainerStarted","Data":"d50d6060ea73cbf3652a98221d1759504c3d6542975aa60fe42dac1cf3ab11c5"}
Sep 07 21:02:45.112823 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:45.112787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr" event={"ID":"a52baa2e-b58f-412a-be7d-7e26235cde4f","Type":"ContainerStarted","Data":"c2c5db12516c3d1b46d7f3a5c2f906b74f48bf444a1dabc4bf25405ef47abbeb"}
Sep 07 21:02:45.132775 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:45.132729    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-jjzzr" podStartSLOduration=2.020128856 podStartE2EDuration="5.132715324s" totalImagesPullingTime="3.112586468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:45.13189334 +0000 UTC m=+330.938803865" watchObservedRunningTime="2026-09-07 21:02:45.132715324 +0000 UTC m=+330.939625849"
Sep 07 21:02:51.480124 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.480079    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"]
Sep 07 21:02:51.501918 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.501896    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.506401 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.506376    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 07 21:02:51.506572 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.506397    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"]
Sep 07 21:02:51.506572 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.506426    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 21:02:51.506572 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.506478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 21:02:51.506755 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.506606    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-tglfj\""
Sep 07 21:02:51.507278 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.507258    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 07 21:02:51.507502 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.507487    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 07 21:02:51.623229 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.623187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4a4ed34-61aa-4024-b976-06ed415f13bb-manifests\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.623405 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.623245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46q8v\" (UniqueName: \"kubernetes.io/projected/c4a4ed34-61aa-4024-b976-06ed415f13bb-kube-api-access-46q8v\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.623405 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.623326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.623405 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.623358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.623559 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.623419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4a4ed34-61aa-4024-b976-06ed415f13bb-tmp\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.623559 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.623435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-metrics-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.724036 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.724004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46q8v\" (UniqueName: \"kubernetes.io/projected/c4a4ed34-61aa-4024-b976-06ed415f13bb-kube-api-access-46q8v\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.724221 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.724050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.724221 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.724068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.724221 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.724101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4a4ed34-61aa-4024-b976-06ed415f13bb-tmp\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.724221 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.724120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-metrics-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.724221 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.724145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4a4ed34-61aa-4024-b976-06ed415f13bb-manifests\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.724621 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.724593    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c4a4ed34-61aa-4024-b976-06ed415f13bb-manifests\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.726481 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.726444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4a4ed34-61aa-4024-b976-06ed415f13bb-tmp\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.726678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.726654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-metrics-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.726756 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.726683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.726914 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.726898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4a4ed34-61aa-4024-b976-06ed415f13bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.737086 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.737019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46q8v\" (UniqueName: \"kubernetes.io/projected/c4a4ed34-61aa-4024-b976-06ed415f13bb-kube-api-access-46q8v\") pod \"opendatahub-operator-controller-manager-84dd88468f-6n8zw\" (UID: \"c4a4ed34-61aa-4024-b976-06ed415f13bb\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:51.813718 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:51.813689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:52.129425 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:52.129400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"]
Sep 07 21:02:52.131912 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:02:52.131882    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a4ed34_61aa_4024_b976_06ed415f13bb.slice/crio-99c05dd9bccc45aa02259d380b2d7ceb47d62254b2369c15cf89dc0b18623142 WatchSource:0}: Error finding container 99c05dd9bccc45aa02259d380b2d7ceb47d62254b2369c15cf89dc0b18623142: Status 404 returned error can't find the container with id 99c05dd9bccc45aa02259d380b2d7ceb47d62254b2369c15cf89dc0b18623142
Sep 07 21:02:52.141967 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:52.141942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw" event={"ID":"c4a4ed34-61aa-4024-b976-06ed415f13bb","Type":"ContainerStarted","Data":"99c05dd9bccc45aa02259d380b2d7ceb47d62254b2369c15cf89dc0b18623142"}
Sep 07 21:02:55.158945 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:55.158903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw" event={"ID":"c4a4ed34-61aa-4024-b976-06ed415f13bb","Type":"ContainerStarted","Data":"13411d8a43d98f2e9d9f93482bac0da95e77a35c31224d49003650203caf8d24"}
Sep 07 21:02:56.165193 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:56.165158    2564 generic.go:356] "Generic (PLEG): container finished" podID="c4a4ed34-61aa-4024-b976-06ed415f13bb" containerID="13411d8a43d98f2e9d9f93482bac0da95e77a35c31224d49003650203caf8d24" exitCode=0
Sep 07 21:02:56.165586 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:56.165217    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw" event={"ID":"c4a4ed34-61aa-4024-b976-06ed415f13bb","Type":"ContainerDied","Data":"13411d8a43d98f2e9d9f93482bac0da95e77a35c31224d49003650203caf8d24"}
Sep 07 21:02:57.171837 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:57.171801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw" event={"ID":"c4a4ed34-61aa-4024-b976-06ed415f13bb","Type":"ContainerStarted","Data":"a3153bd63bb4075801b4e3b20695af1f4041c388fa1ec07c59f26e73d5c02672"}
Sep 07 21:02:57.172250 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:57.171912    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:02:57.204786 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:02:57.204735    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw" podStartSLOduration=2.639577363 podStartE2EDuration="6.204717366s" totalImagesPullingTime="3.119728718s" totalInitContainerRuntime="445.411285ms" isStatefulPod=false podCreationTimestamp="2026-09-07 21:02:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:02:57.203641335 +0000 UTC m=+343.010551883" watchObservedRunningTime="2026-09-07 21:02:57.204717366 +0000 UTC m=+343.011627890"
Sep 07 21:03:08.178827 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.178720    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84dd88468f-6n8zw"
Sep 07 21:03:08.363880 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.363849    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-fbxg5"]
Sep 07 21:03:08.366079 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.366063    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5"
Sep 07 21:03:08.369236 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.369212    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 21:03:08.369827 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.369804    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tr9ft\""
Sep 07 21:03:08.369946 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.369927    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 21:03:08.383687 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.383666    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-fbxg5"]
Sep 07 21:03:08.458539 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.458444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wxsn\" (UniqueName: \"kubernetes.io/projected/b7dad903-8be7-48c7-a36b-f3074f4f8326-kube-api-access-7wxsn\") pod \"authorino-operator-84d9bfc694-fbxg5\" (UID: \"b7dad903-8be7-48c7-a36b-f3074f4f8326\") " pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5"
Sep 07 21:03:08.559413 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.559385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wxsn\" (UniqueName: \"kubernetes.io/projected/b7dad903-8be7-48c7-a36b-f3074f4f8326-kube-api-access-7wxsn\") pod \"authorino-operator-84d9bfc694-fbxg5\" (UID: \"b7dad903-8be7-48c7-a36b-f3074f4f8326\") " pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5"
Sep 07 21:03:08.568604 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.568577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wxsn\" (UniqueName: \"kubernetes.io/projected/b7dad903-8be7-48c7-a36b-f3074f4f8326-kube-api-access-7wxsn\") pod \"authorino-operator-84d9bfc694-fbxg5\" (UID: \"b7dad903-8be7-48c7-a36b-f3074f4f8326\") " pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5"
Sep 07 21:03:08.675797 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.675763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5"
Sep 07 21:03:08.781331 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.781299    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"]
Sep 07 21:03:08.783725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.783706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.786065 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.786041    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 07 21:03:08.786205 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.786165    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 07 21:03:08.786270 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.786228    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7h4m2\""
Sep 07 21:03:08.793917 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.793894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"]
Sep 07 21:03:08.861626 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.861588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkg55\" (UniqueName: \"kubernetes.io/projected/583dbabb-c609-449d-8a17-1982516e4fc4-kube-api-access-xkg55\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.861782 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.861711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/583dbabb-c609-449d-8a17-1982516e4fc4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.861782 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.861765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583dbabb-c609-449d-8a17-1982516e4fc4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.947502 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.947479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-fbxg5"]
Sep 07 21:03:08.949193 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:08.949164    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7dad903_8be7_48c7_a36b_f3074f4f8326.slice/crio-7cd25fa315eda394c59559a92b8ecfedc6ca11b928a49f2c34c6bc810809241e WatchSource:0}: Error finding container 7cd25fa315eda394c59559a92b8ecfedc6ca11b928a49f2c34c6bc810809241e: Status 404 returned error can't find the container with id 7cd25fa315eda394c59559a92b8ecfedc6ca11b928a49f2c34c6bc810809241e
Sep 07 21:03:08.962630 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.962610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583dbabb-c609-449d-8a17-1982516e4fc4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.962712 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.962659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkg55\" (UniqueName: \"kubernetes.io/projected/583dbabb-c609-449d-8a17-1982516e4fc4-kube-api-access-xkg55\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.962764 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.962701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/583dbabb-c609-449d-8a17-1982516e4fc4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.962764 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:08.962747    2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 07 21:03:08.962838 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:08.962802    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/583dbabb-c609-449d-8a17-1982516e4fc4-plugin-serving-cert podName:583dbabb-c609-449d-8a17-1982516e4fc4 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:09.46278505 +0000 UTC m=+355.269695551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/583dbabb-c609-449d-8a17-1982516e4fc4-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-jlnl8" (UID: "583dbabb-c609-449d-8a17-1982516e4fc4") : secret "plugin-serving-cert" not found
Sep 07 21:03:08.963340 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.963322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/583dbabb-c609-449d-8a17-1982516e4fc4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:08.971269 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:08.971221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkg55\" (UniqueName: \"kubernetes.io/projected/583dbabb-c609-449d-8a17-1982516e4fc4-kube-api-access-xkg55\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:09.225041 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:09.224965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5" event={"ID":"b7dad903-8be7-48c7-a36b-f3074f4f8326","Type":"ContainerStarted","Data":"7cd25fa315eda394c59559a92b8ecfedc6ca11b928a49f2c34c6bc810809241e"}
Sep 07 21:03:09.467223 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:09.467189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583dbabb-c609-449d-8a17-1982516e4fc4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:09.469549 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:09.469529    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/583dbabb-c609-449d-8a17-1982516e4fc4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jlnl8\" (UID: \"583dbabb-c609-449d-8a17-1982516e4fc4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:09.693140 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:09.693097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"
Sep 07 21:03:09.988319 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:09.988194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8"]
Sep 07 21:03:09.991804 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:09.991770    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod583dbabb_c609_449d_8a17_1982516e4fc4.slice/crio-3c2747fff5270b70cb1e0c856c869a6757ed2e06dbd12de74fded17d765560c0 WatchSource:0}: Error finding container 3c2747fff5270b70cb1e0c856c869a6757ed2e06dbd12de74fded17d765560c0: Status 404 returned error can't find the container with id 3c2747fff5270b70cb1e0c856c869a6757ed2e06dbd12de74fded17d765560c0
Sep 07 21:03:10.234880 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:10.234849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8" event={"ID":"583dbabb-c609-449d-8a17-1982516e4fc4","Type":"ContainerStarted","Data":"3c2747fff5270b70cb1e0c856c869a6757ed2e06dbd12de74fded17d765560c0"}
Sep 07 21:03:12.246682 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:12.246640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5" event={"ID":"b7dad903-8be7-48c7-a36b-f3074f4f8326","Type":"ContainerStarted","Data":"8d2e8f3f8d822ccedd1728494ba1dadba757476aa2d41e7d2b9874611fe54fbe"}
Sep 07 21:03:12.247113 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:12.246771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5"
Sep 07 21:03:12.286579 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:12.286322    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5" podStartSLOduration=1.882946999 podStartE2EDuration="4.286302347s" totalImagesPullingTime="2.403355348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:12.28420906 +0000 UTC m=+358.091119616" watchObservedRunningTime="2026-09-07 21:03:12.286302347 +0000 UTC m=+358.093212873"
Sep 07 21:03:15.262032 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:15.261998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8" event={"ID":"583dbabb-c609-449d-8a17-1982516e4fc4","Type":"ContainerStarted","Data":"70b55725c9c3656698df08ffdd2332f60ec249961980a46998f9b6da861f345c"}
Sep 07 21:03:15.280229 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:15.280182    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jlnl8" podStartSLOduration=2.175036924 podStartE2EDuration="7.28016702s" totalImagesPullingTime="5.105130096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:15.27844112 +0000 UTC m=+361.085351641" watchObservedRunningTime="2026-09-07 21:03:15.28016702 +0000 UTC m=+361.087077583"
Sep 07 21:03:23.253769 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.253735    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-84d9bfc694-fbxg5"
Sep 07 21:03:23.726037 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.726001    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"]
Sep 07 21:03:23.730872 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.730850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.733419 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.733376    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 07 21:03:23.733419 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.733376    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 07 21:03:23.733619 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.733444    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rtg5d\""
Sep 07 21:03:23.738842 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.738360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"]
Sep 07 21:03:23.780282 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.780246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tmp\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.780432 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.780290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59p82\" (UniqueName: \"kubernetes.io/projected/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-kube-api-access-59p82\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.780432 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.780340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tls-certs\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.881539 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.881500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tmp\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.881723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.881569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59p82\" (UniqueName: \"kubernetes.io/projected/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-kube-api-access-59p82\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.881723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.881614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tls-certs\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.881838 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:23.881790    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 07 21:03:23.881887 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:23.881850    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tls-certs podName:0cb8e5b6-59c1-4f41-b281-bcc0965dba7e nodeName:}" failed. No retries permitted until 2026-09-07 21:03:24.381831317 +0000 UTC m=+370.188741838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tls-certs") pod "kube-auth-proxy-7dd8c6c7d4-zqdqg" (UID: "0cb8e5b6-59c1-4f41-b281-bcc0965dba7e") : secret "kube-auth-proxy-tls" not found
Sep 07 21:03:23.884877 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.884847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tmp\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.901615 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.901584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59p82\" (UniqueName: \"kubernetes.io/projected/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-kube-api-access-59p82\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:23.903191 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.903169    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"]
Sep 07 21:03:23.905589 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.905575    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.908536 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.908511    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rnnbh\""
Sep 07 21:03:23.930705 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.930672    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"]
Sep 07 21:03:23.982680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.982680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.982902 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.982902 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.982902 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.982902 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.982902 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.983145 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.982947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8xk\" (UniqueName: \"kubernetes.io/projected/6bce06c8-1a78-4b42-8707-ddda56d52d9e-kube-api-access-bc8xk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:23.983145 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:23.983031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084482 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8xk\" (UniqueName: \"kubernetes.io/projected/6bce06c8-1a78-4b42-8707-ddda56d52d9e-kube-api-access-bc8xk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084958 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084958 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.084958 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.084839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.085374 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.085259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.085374 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.085278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.085685 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.085661    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.085794 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.085711    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.085996 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.085972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.087713 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.087685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.087991 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.087967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.105558 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.105527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bce06c8-1a78-4b42-8707-ddda56d52d9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.105747 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.105725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8xk\" (UniqueName: \"kubernetes.io/projected/6bce06c8-1a78-4b42-8707-ddda56d52d9e-kube-api-access-bc8xk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb\" (UID: \"6bce06c8-1a78-4b42-8707-ddda56d52d9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.105903 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.105881    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"]
Sep 07 21:03:24.113474 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.113439    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.116737 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.116720    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 21:03:24.121370 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.121348    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"]
Sep 07 21:03:24.186094 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.186057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vflnn\" (UniqueName: \"kubernetes.io/projected/505eb4ad-5688-4ce1-a924-7d5e29150839-kube-api-access-vflnn\") pod \"limitador-limitador-859c4d96d6-rlrd4\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.186282 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.186155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/505eb4ad-5688-4ce1-a924-7d5e29150839-config-file\") pod \"limitador-limitador-859c4d96d6-rlrd4\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.186625 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.186601    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"]
Sep 07 21:03:24.217022 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.216992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:24.287148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.287111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vflnn\" (UniqueName: \"kubernetes.io/projected/505eb4ad-5688-4ce1-a924-7d5e29150839-kube-api-access-vflnn\") pod \"limitador-limitador-859c4d96d6-rlrd4\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.287557 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.287296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/505eb4ad-5688-4ce1-a924-7d5e29150839-config-file\") pod \"limitador-limitador-859c4d96d6-rlrd4\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.288158 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.288134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/505eb4ad-5688-4ce1-a924-7d5e29150839-config-file\") pod \"limitador-limitador-859c4d96d6-rlrd4\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.306612 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.306584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vflnn\" (UniqueName: \"kubernetes.io/projected/505eb4ad-5688-4ce1-a924-7d5e29150839-kube-api-access-vflnn\") pod \"limitador-limitador-859c4d96d6-rlrd4\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.388395 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.388359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tls-certs\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:24.390759 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.390729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb8e5b6-59c1-4f41-b281-bcc0965dba7e-tls-certs\") pod \"kube-auth-proxy-7dd8c6c7d4-zqdqg\" (UID: \"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e\") " pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:24.425657 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.425623    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:24.507533 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.507438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"]
Sep 07 21:03:24.510920 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:24.510881    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bce06c8_1a78_4b42_8707_ddda56d52d9e.slice/crio-66a033097de9a4e6817ea7f0a49cef159825aaa2abadadf2bab806d61635b07d WatchSource:0}: Error finding container 66a033097de9a4e6817ea7f0a49cef159825aaa2abadadf2bab806d61635b07d: Status 404 returned error can't find the container with id 66a033097de9a4e6817ea7f0a49cef159825aaa2abadadf2bab806d61635b07d
Sep 07 21:03:24.513750 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.513711    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 21:03:24.513842 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.513791    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 21:03:24.513842 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.513829    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 07 21:03:24.642091 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.642053    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"
Sep 07 21:03:24.716472 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.716432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"]
Sep 07 21:03:24.723176 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:24.723151    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505eb4ad_5688_4ce1_a924_7d5e29150839.slice/crio-98a6b45d0e17dff86166f884e1ff85e9c636c98d2b184ad3fb809153d7946299 WatchSource:0}: Error finding container 98a6b45d0e17dff86166f884e1ff85e9c636c98d2b184ad3fb809153d7946299: Status 404 returned error can't find the container with id 98a6b45d0e17dff86166f884e1ff85e9c636c98d2b184ad3fb809153d7946299
Sep 07 21:03:24.940432 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:24.940399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg"]
Sep 07 21:03:24.945916 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:24.945880    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb8e5b6_59c1_4f41_b281_bcc0965dba7e.slice/crio-9ea6d0d7c0cb226009fe3e390036d2068c4a05edfb4645a25f39e6920afade5f WatchSource:0}: Error finding container 9ea6d0d7c0cb226009fe3e390036d2068c4a05edfb4645a25f39e6920afade5f: Status 404 returned error can't find the container with id 9ea6d0d7c0cb226009fe3e390036d2068c4a05edfb4645a25f39e6920afade5f
Sep 07 21:03:25.309241 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:25.309153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg" event={"ID":"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e","Type":"ContainerStarted","Data":"9ea6d0d7c0cb226009fe3e390036d2068c4a05edfb4645a25f39e6920afade5f"}
Sep 07 21:03:25.310373 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:25.310344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4" event={"ID":"505eb4ad-5688-4ce1-a924-7d5e29150839","Type":"ContainerStarted","Data":"98a6b45d0e17dff86166f884e1ff85e9c636c98d2b184ad3fb809153d7946299"}
Sep 07 21:03:25.311907 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:25.311882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb" event={"ID":"6bce06c8-1a78-4b42-8707-ddda56d52d9e","Type":"ContainerStarted","Data":"80a0c673898eca4a591e83f777247664ea129b434eff966866b4cec036f143ca"}
Sep 07 21:03:25.312017 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:25.311924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb" event={"ID":"6bce06c8-1a78-4b42-8707-ddda56d52d9e","Type":"ContainerStarted","Data":"66a033097de9a4e6817ea7f0a49cef159825aaa2abadadf2bab806d61635b07d"}
Sep 07 21:03:25.330801 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:25.330758    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb" podStartSLOduration=2.330745628 podStartE2EDuration="2.330745628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:25.329186716 +0000 UTC m=+371.136097257" watchObservedRunningTime="2026-09-07 21:03:25.330745628 +0000 UTC m=+371.137656151"
Sep 07 21:03:26.217872 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:26.217820    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:26.223091 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:26.223065    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:26.321472 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:26.321411    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:26.322612 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:26.322586    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb"
Sep 07 21:03:28.332486 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:28.332440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg" event={"ID":"0cb8e5b6-59c1-4f41-b281-bcc0965dba7e","Type":"ContainerStarted","Data":"5f19f92d3cef74e762acf7a51f300b21b43672f1f62029f7e1c62f30282f4061"}
Sep 07 21:03:28.333932 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:28.333901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4" event={"ID":"505eb4ad-5688-4ce1-a924-7d5e29150839","Type":"ContainerStarted","Data":"3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f"}
Sep 07 21:03:28.334092 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:28.334072    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:28.349816 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:28.349776    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7dd8c6c7d4-zqdqg" podStartSLOduration=2.839136372 podStartE2EDuration="5.349762952s" totalImagesPullingTime="2.51062658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:28.348288377 +0000 UTC m=+374.155198926" watchObservedRunningTime="2026-09-07 21:03:28.349762952 +0000 UTC m=+374.156673475"
Sep 07 21:03:28.364346 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:28.364295    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4" podStartSLOduration=1.682464839 podStartE2EDuration="4.364283262s" totalImagesPullingTime="2.681818423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:28.362502543 +0000 UTC m=+374.169413086" watchObservedRunningTime="2026-09-07 21:03:28.364283262 +0000 UTC m=+374.171193788"
Sep 07 21:03:39.074539 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.074501    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"]
Sep 07 21:03:39.074946 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.074672    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4" podUID="505eb4ad-5688-4ce1-a924-7d5e29150839" containerName="limitador" containerID="cri-o://3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f" gracePeriod=30
Sep 07 21:03:39.075420 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.075397    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:39.615883 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.615859    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:39.725703 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.725670    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vflnn\" (UniqueName: \"kubernetes.io/projected/505eb4ad-5688-4ce1-a924-7d5e29150839-kube-api-access-vflnn\") pod \"505eb4ad-5688-4ce1-a924-7d5e29150839\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") "
Sep 07 21:03:39.725853 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.725756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/505eb4ad-5688-4ce1-a924-7d5e29150839-config-file\") pod \"505eb4ad-5688-4ce1-a924-7d5e29150839\" (UID: \"505eb4ad-5688-4ce1-a924-7d5e29150839\") "
Sep 07 21:03:39.726110 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.726079    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/505eb4ad-5688-4ce1-a924-7d5e29150839-config-file" (OuterVolumeSpecName: "config-file") pod "505eb4ad-5688-4ce1-a924-7d5e29150839" (UID: "505eb4ad-5688-4ce1-a924-7d5e29150839"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 21:03:39.727936 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.727914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/505eb4ad-5688-4ce1-a924-7d5e29150839-kube-api-access-vflnn" (OuterVolumeSpecName: "kube-api-access-vflnn") pod "505eb4ad-5688-4ce1-a924-7d5e29150839" (UID: "505eb4ad-5688-4ce1-a924-7d5e29150839"). InnerVolumeSpecName "kube-api-access-vflnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:39.827235 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.827206    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/505eb4ad-5688-4ce1-a924-7d5e29150839-config-file\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:03:39.827235 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:39.827229    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vflnn\" (UniqueName: \"kubernetes.io/projected/505eb4ad-5688-4ce1-a924-7d5e29150839-kube-api-access-vflnn\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:03:40.388937 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.388902    2564 generic.go:356] "Generic (PLEG): container finished" podID="505eb4ad-5688-4ce1-a924-7d5e29150839" containerID="3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f" exitCode=0
Sep 07 21:03:40.389359 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.388947    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"
Sep 07 21:03:40.389359 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.388987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4" event={"ID":"505eb4ad-5688-4ce1-a924-7d5e29150839","Type":"ContainerDied","Data":"3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f"}
Sep 07 21:03:40.389359 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.389036    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rlrd4" event={"ID":"505eb4ad-5688-4ce1-a924-7d5e29150839","Type":"ContainerDied","Data":"98a6b45d0e17dff86166f884e1ff85e9c636c98d2b184ad3fb809153d7946299"}
Sep 07 21:03:40.389359 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.389058    2564 scope.go:117] "RemoveContainer" containerID="3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f"
Sep 07 21:03:40.397868 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.397851    2564 scope.go:117] "RemoveContainer" containerID="3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f"
Sep 07 21:03:40.398127 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:40.398109    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f\": container with ID starting with 3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f not found: ID does not exist" containerID="3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f"
Sep 07 21:03:40.398174 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.398134    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f"} err="failed to get container status \"3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f\": rpc error: code = NotFound desc = could not find container \"3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f\": container with ID starting with 3cf0fe7250a593145670bcd9bc95e8cc8b1eadd05defe290e21a36ec7017d77f not found: ID does not exist"
Sep 07 21:03:40.409972 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.409947    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"]
Sep 07 21:03:40.413427 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.413404    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rlrd4"]
Sep 07 21:03:40.654007 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:40.653976    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="505eb4ad-5688-4ce1-a924-7d5e29150839" path="/var/lib/kubelet/pods/505eb4ad-5688-4ce1-a924-7d5e29150839/volumes"
Sep 07 21:03:43.093312 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.093277    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55b46ff6f8-z57xb"]
Sep 07 21:03:43.093678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.093654    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="505eb4ad-5688-4ce1-a924-7d5e29150839" containerName="limitador"
Sep 07 21:03:43.093678 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.093665    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="505eb4ad-5688-4ce1-a924-7d5e29150839" containerName="limitador"
Sep 07 21:03:43.093747 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.093727    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="505eb4ad-5688-4ce1-a924-7d5e29150839" containerName="limitador"
Sep 07 21:03:43.097956 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.097935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.100727 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.100706    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 07 21:03:43.100852 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.100733    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 21:03:43.100852 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.100733    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 21:03:43.101668 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.101652    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 07 21:03:43.101778 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.101668    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 07 21:03:43.101778 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.101674    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xmgk6\""
Sep 07 21:03:43.107813 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.107785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b46ff6f8-z57xb"]
Sep 07 21:03:43.257498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.257441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.257498 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.257501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-metrics-certs\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.257689 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.257606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdcvr\" (UniqueName: \"kubernetes.io/projected/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-kube-api-access-zdcvr\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.274337 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.274301    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-796c6d8b86-5p99q"]
Sep 07 21:03:43.277675 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.277654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.288352 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.288326    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-796c6d8b86-5p99q"]
Sep 07 21:03:43.358820 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.358724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-metrics-certs\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.358820 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.358767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5tr\" (UniqueName: \"kubernetes.io/projected/14d9a786-bfcd-4577-bdc2-aece739c93c7-kube-api-access-mw5tr\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.359050 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.358883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdcvr\" (UniqueName: \"kubernetes.io/projected/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-kube-api-access-zdcvr\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.359050 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.358907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14d9a786-bfcd-4577-bdc2-aece739c93c7-webhook-cert\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.359050 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.358943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d9a786-bfcd-4577-bdc2-aece739c93c7-metrics-certs\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.359050 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.359001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.359233 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:43.359094    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 07 21:03:43.359233 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:43.359152    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert podName:b49c7ba5-2b9b-4bd3-9ca3-88169f430531 nodeName:}" failed. No retries permitted until 2026-09-07 21:03:43.8591372 +0000 UTC m=+389.666047725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert") pod "maas-controller-55b46ff6f8-z57xb" (UID: "b49c7ba5-2b9b-4bd3-9ca3-88169f430531") : secret "maas-controller-webhook-cert" not found
Sep 07 21:03:43.361169 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.361151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-metrics-certs\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.367696 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.367673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdcvr\" (UniqueName: \"kubernetes.io/projected/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-kube-api-access-zdcvr\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.459769 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.459732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14d9a786-bfcd-4577-bdc2-aece739c93c7-webhook-cert\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.459955 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.459778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d9a786-bfcd-4577-bdc2-aece739c93c7-metrics-certs\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.459955 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.459829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5tr\" (UniqueName: \"kubernetes.io/projected/14d9a786-bfcd-4577-bdc2-aece739c93c7-kube-api-access-mw5tr\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.462137 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.462113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14d9a786-bfcd-4577-bdc2-aece739c93c7-webhook-cert\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.462264 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.462242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14d9a786-bfcd-4577-bdc2-aece739c93c7-metrics-certs\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.468684 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.468663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5tr\" (UniqueName: \"kubernetes.io/projected/14d9a786-bfcd-4577-bdc2-aece739c93c7-kube-api-access-mw5tr\") pod \"maas-controller-796c6d8b86-5p99q\" (UID: \"14d9a786-bfcd-4577-bdc2-aece739c93c7\") " pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.588437 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.588403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:43.856491 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.856448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-796c6d8b86-5p99q"]
Sep 07 21:03:43.858289 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:43.858264    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d9a786_bfcd_4577_bdc2_aece739c93c7.slice/crio-d526a16f776266fe59fa8e84eac86719982d7111e6feb251558ad6e99bafebfa WatchSource:0}: Error finding container d526a16f776266fe59fa8e84eac86719982d7111e6feb251558ad6e99bafebfa: Status 404 returned error can't find the container with id d526a16f776266fe59fa8e84eac86719982d7111e6feb251558ad6e99bafebfa
Sep 07 21:03:43.863257 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.863239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:43.865758 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:43.865736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert\") pod \"maas-controller-55b46ff6f8-z57xb\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") " pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:44.009598 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.009564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:44.279680 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.279650    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b46ff6f8-z57xb"]
Sep 07 21:03:44.281383 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:44.281359    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49c7ba5_2b9b_4bd3_9ca3_88169f430531.slice/crio-5cadb5949ee7e81e924377f761d94ed5daab9462f1df95bcbc6ac2d377c0f9d4 WatchSource:0}: Error finding container 5cadb5949ee7e81e924377f761d94ed5daab9462f1df95bcbc6ac2d377c0f9d4: Status 404 returned error can't find the container with id 5cadb5949ee7e81e924377f761d94ed5daab9462f1df95bcbc6ac2d377c0f9d4
Sep 07 21:03:44.413243 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.413207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b46ff6f8-z57xb" event={"ID":"b49c7ba5-2b9b-4bd3-9ca3-88169f430531","Type":"ContainerStarted","Data":"5cadb5949ee7e81e924377f761d94ed5daab9462f1df95bcbc6ac2d377c0f9d4"}
Sep 07 21:03:44.414299 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.414276    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-796c6d8b86-5p99q" event={"ID":"14d9a786-bfcd-4577-bdc2-aece739c93c7","Type":"ContainerStarted","Data":"d526a16f776266fe59fa8e84eac86719982d7111e6feb251558ad6e99bafebfa"}
Sep 07 21:03:44.709775 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.708095    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"]
Sep 07 21:03:44.712252 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.712136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.716188 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.715933    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Sep 07 21:03:44.716188 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.715943    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Sep 07 21:03:44.716188 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.715966    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Sep 07 21:03:44.716188 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.716087    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-tf28d\""
Sep 07 21:03:44.721356 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.721316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"]
Sep 07 21:03:44.871876 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.871841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd85eb9e-ff77-48af-b079-868065e46676-metrics-certs\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.871876 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.871879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd85eb9e-ff77-48af-b079-868065e46676-cert\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.872121 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.871940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccv4j\" (UniqueName: \"kubernetes.io/projected/cd85eb9e-ff77-48af-b079-868065e46676-kube-api-access-ccv4j\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.872121 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.871988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd85eb9e-ff77-48af-b079-868065e46676-manager-config\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.972946 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.972870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd85eb9e-ff77-48af-b079-868065e46676-manager-config\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.972946 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.972933    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd85eb9e-ff77-48af-b079-868065e46676-metrics-certs\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.973118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.972951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd85eb9e-ff77-48af-b079-868065e46676-cert\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.973118 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.972986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccv4j\" (UniqueName: \"kubernetes.io/projected/cd85eb9e-ff77-48af-b079-868065e46676-kube-api-access-ccv4j\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.973530 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.973512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd85eb9e-ff77-48af-b079-868065e46676-manager-config\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.975506 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.975485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd85eb9e-ff77-48af-b079-868065e46676-metrics-certs\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.975662 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.975640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd85eb9e-ff77-48af-b079-868065e46676-cert\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:44.981398 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:44.981375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccv4j\" (UniqueName: \"kubernetes.io/projected/cd85eb9e-ff77-48af-b079-868065e46676-kube-api-access-ccv4j\") pod \"jobset-controller-manager-7dfc566c4c-hpbwt\" (UID: \"cd85eb9e-ff77-48af-b079-868065e46676\") " pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:45.027426 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:45.027390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:45.316437 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:45.316412    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"]
Sep 07 21:03:45.749516 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:03:45.749479    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd85eb9e_ff77_48af_b079_868065e46676.slice/crio-b68d6c505f30312cdff82e5c8126260b6729081b82620332e420ff825765722a WatchSource:0}: Error finding container b68d6c505f30312cdff82e5c8126260b6729081b82620332e420ff825765722a: Status 404 returned error can't find the container with id b68d6c505f30312cdff82e5c8126260b6729081b82620332e420ff825765722a
Sep 07 21:03:46.426350 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:46.426313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b46ff6f8-z57xb" event={"ID":"b49c7ba5-2b9b-4bd3-9ca3-88169f430531","Type":"ContainerStarted","Data":"e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25"}
Sep 07 21:03:46.426803 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:46.426423    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:46.427975 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:46.427943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-796c6d8b86-5p99q" event={"ID":"14d9a786-bfcd-4577-bdc2-aece739c93c7","Type":"ContainerStarted","Data":"b1bdaad06aa21b9b48eb3d8f78fe7f4c808a9b65cc4f3ec70ebaf631766dcf59"}
Sep 07 21:03:46.428115 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:46.428015    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:46.429270 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:46.429249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt" event={"ID":"cd85eb9e-ff77-48af-b079-868065e46676","Type":"ContainerStarted","Data":"b68d6c505f30312cdff82e5c8126260b6729081b82620332e420ff825765722a"}
Sep 07 21:03:46.445261 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:46.445213    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55b46ff6f8-z57xb" podStartSLOduration=1.8999877189999999 podStartE2EDuration="3.445198617s" totalImagesPullingTime="1.545210898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:46.443646491 +0000 UTC m=+392.250557040" watchObservedRunningTime="2026-09-07 21:03:46.445198617 +0000 UTC m=+392.252109142"
Sep 07 21:03:46.465440 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:46.465394    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-796c6d8b86-5p99q" podStartSLOduration=1.500003992 podStartE2EDuration="3.465376939s" totalImagesPullingTime="1.965372947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:46.464545497 +0000 UTC m=+392.271456054" watchObservedRunningTime="2026-09-07 21:03:46.465376939 +0000 UTC m=+392.272287462"
Sep 07 21:03:49.447143 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:49.447109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt" event={"ID":"cd85eb9e-ff77-48af-b079-868065e46676","Type":"ContainerStarted","Data":"b6165d19c3a7bede45977c99965f5337b32a31e1310bacb29a058bbcf634886f"}
Sep 07 21:03:49.447530 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:49.447246    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:03:49.462454 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:49.462405    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt" podStartSLOduration=2.659059865 podStartE2EDuration="5.462390252s" totalImagesPullingTime="2.803330387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:03:49.462090203 +0000 UTC m=+395.269000738" watchObservedRunningTime="2026-09-07 21:03:49.462390252 +0000 UTC m=+395.269300777"
Sep 07 21:03:57.438551 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.438521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-796c6d8b86-5p99q"
Sep 07 21:03:57.439069 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.438590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:57.499052 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.499016    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b46ff6f8-z57xb"]
Sep 07 21:03:57.499298 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.499248    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55b46ff6f8-z57xb" podUID="b49c7ba5-2b9b-4bd3-9ca3-88169f430531" containerName="manager" containerID="cri-o://e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25" gracePeriod=30
Sep 07 21:03:57.736148 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.736123    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:57.889515 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.889482    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-metrics-certs\") pod \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") "
Sep 07 21:03:57.889662 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.889535    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert\") pod \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") "
Sep 07 21:03:57.889662 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.889570    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdcvr\" (UniqueName: \"kubernetes.io/projected/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-kube-api-access-zdcvr\") pod \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\" (UID: \"b49c7ba5-2b9b-4bd3-9ca3-88169f430531\") "
Sep 07 21:03:57.891800 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.891767    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b49c7ba5-2b9b-4bd3-9ca3-88169f430531" (UID: "b49c7ba5-2b9b-4bd3-9ca3-88169f430531"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:57.891800 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.891765    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-kube-api-access-zdcvr" (OuterVolumeSpecName: "kube-api-access-zdcvr") pod "b49c7ba5-2b9b-4bd3-9ca3-88169f430531" (UID: "b49c7ba5-2b9b-4bd3-9ca3-88169f430531"). InnerVolumeSpecName "kube-api-access-zdcvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 21:03:57.891951 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.891797    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b49c7ba5-2b9b-4bd3-9ca3-88169f430531" (UID: "b49c7ba5-2b9b-4bd3-9ca3-88169f430531"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 21:03:57.990818 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.990740    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-webhook-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:03:57.990818 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.990770    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdcvr\" (UniqueName: \"kubernetes.io/projected/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-kube-api-access-zdcvr\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:03:57.990818 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:57.990780    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b49c7ba5-2b9b-4bd3-9ca3-88169f430531-metrics-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Sep 07 21:03:58.494870 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.494837    2564 generic.go:356] "Generic (PLEG): container finished" podID="b49c7ba5-2b9b-4bd3-9ca3-88169f430531" containerID="e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25" exitCode=0
Sep 07 21:03:58.495259 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.494888    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b46ff6f8-z57xb"
Sep 07 21:03:58.495259 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.494919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b46ff6f8-z57xb" event={"ID":"b49c7ba5-2b9b-4bd3-9ca3-88169f430531","Type":"ContainerDied","Data":"e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25"}
Sep 07 21:03:58.495259 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.495002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b46ff6f8-z57xb" event={"ID":"b49c7ba5-2b9b-4bd3-9ca3-88169f430531","Type":"ContainerDied","Data":"5cadb5949ee7e81e924377f761d94ed5daab9462f1df95bcbc6ac2d377c0f9d4"}
Sep 07 21:03:58.495259 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.495031    2564 scope.go:117] "RemoveContainer" containerID="e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25"
Sep 07 21:03:58.503844 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.503645    2564 scope.go:117] "RemoveContainer" containerID="e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25"
Sep 07 21:03:58.503932 ip-10-0-138-24 kubenswrapper[2564]: E0907 21:03:58.503913    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25\": container with ID starting with e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25 not found: ID does not exist" containerID="e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25"
Sep 07 21:03:58.503972 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.503940    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25"} err="failed to get container status \"e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25\": rpc error: code = NotFound desc = could not find container \"e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25\": container with ID starting with e09ff0fd19cbc36f706b68456dc7bd91fdf9e950366e85fc6309af66b2de6d25 not found: ID does not exist"
Sep 07 21:03:58.515505 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.515477    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b46ff6f8-z57xb"]
Sep 07 21:03:58.518821 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.518801    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55b46ff6f8-z57xb"]
Sep 07 21:03:58.654290 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:03:58.654252    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b49c7ba5-2b9b-4bd3-9ca3-88169f430531" path="/var/lib/kubelet/pods/b49c7ba5-2b9b-4bd3-9ca3-88169f430531/volumes"
Sep 07 21:04:00.457581 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:04:00.457548    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7dfc566c4c-hpbwt"
Sep 07 21:06:06.464358 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.464314    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"]
Sep 07 21:06:06.464804 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.464782    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49c7ba5-2b9b-4bd3-9ca3-88169f430531" containerName="manager"
Sep 07 21:06:06.464804 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.464802    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49c7ba5-2b9b-4bd3-9ca3-88169f430531" containerName="manager"
Sep 07 21:06:06.464914 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.464901    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49c7ba5-2b9b-4bd3-9ca3-88169f430531" containerName="manager"
Sep 07 21:06:06.468133 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.468113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.470519 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.470491    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 21:06:06.470650 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.470615    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qsw72\""
Sep 07 21:06:06.471621 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.471604    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 21:06:06.471725 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.471645    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 07 21:06:06.475683 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.475428    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"]
Sep 07 21:06:06.573764 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.573729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.573764 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.573768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.574001 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.573809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.574001 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.573913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.574001 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.573951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.574001 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.573985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvvh2\" (UniqueName: \"kubernetes.io/projected/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-kube-api-access-kvvh2\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.674816 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.674788    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.674816 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.674819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.675022 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.674883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.675022 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.674946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.675022 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.674966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.675022 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.674986    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvh2\" (UniqueName: \"kubernetes.io/projected/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-kube-api-access-kvvh2\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.675243 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.675214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.675317 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.675236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.675379 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.675330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.677309 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.677289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.677600 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.677580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.682518 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.682496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvvh2\" (UniqueName: \"kubernetes.io/projected/a944fd13-2d74-4ca3-b0a9-31bb0ca93cef-kube-api-access-kvvh2\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z\" (UID: \"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:06.779296 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:06.779215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:07.048668 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:07.048645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"]
Sep 07 21:06:07.050426 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:06:07.050403    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda944fd13_2d74_4ca3_b0a9_31bb0ca93cef.slice/crio-174f3ff5ff1dc0f8175c0abefef697177118a02759aac34b301cb4d52217aaf8 WatchSource:0}: Error finding container 174f3ff5ff1dc0f8175c0abefef697177118a02759aac34b301cb4d52217aaf8: Status 404 returned error can't find the container with id 174f3ff5ff1dc0f8175c0abefef697177118a02759aac34b301cb4d52217aaf8
Sep 07 21:06:07.108197 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:07.108165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z" event={"ID":"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef","Type":"ContainerStarted","Data":"174f3ff5ff1dc0f8175c0abefef697177118a02759aac34b301cb4d52217aaf8"}
Sep 07 21:06:08.115256 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:08.115219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z" event={"ID":"a944fd13-2d74-4ca3-b0a9-31bb0ca93cef","Type":"ContainerStarted","Data":"41790c7dd96d554d5b0120252a06524a10b52b2199dbdc99beb853943e79a24a"}
Sep 07 21:06:08.779635 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:08.779600    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:16.780117 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:16.780077    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:16.792521 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:16.792497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:16.811102 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:16.811056    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z" podStartSLOduration=9.86449734 podStartE2EDuration="10.811039522s" totalImagesPullingTime="946.542182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:06:08.130296412 +0000 UTC m=+533.937206961" watchObservedRunningTime="2026-09-07 21:06:16.811039522 +0000 UTC m=+542.617950051"
Sep 07 21:06:17.173922 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:17.173890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z"
Sep 07 21:06:31.266654 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.266618    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"]
Sep 07 21:06:31.270238 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.270214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.272571 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.272546    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 07 21:06:31.279869 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.279848    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"]
Sep 07 21:06:31.387123 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.387089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn2r8\" (UniqueName: \"kubernetes.io/projected/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-kube-api-access-qn2r8\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.387300 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.387136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.387300 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.387222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.387300 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.387265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.387300 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.387286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.387454 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.387383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488013 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.487969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488193 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488193 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488193 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488360 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn2r8\" (UniqueName: \"kubernetes.io/projected/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-kube-api-access-qn2r8\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488486 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488559 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488559 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-home\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.488747 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.488726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.490356 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.490331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-dshm\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.490666 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.490648    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.496386 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.496365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn2r8\" (UniqueName: \"kubernetes.io/projected/230950c7-9b26-4fe2-a88f-cfb3c7b185ae-kube-api-access-qn2r8\") pod \"facebook-opt-125m-simulated-kserve-89945f574-ckkkt\" (UID: \"230950c7-9b26-4fe2-a88f-cfb3c7b185ae\") " pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.582755 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.582674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:31.855021 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:31.854992    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"]
Sep 07 21:06:31.856358 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:06:31.856327    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230950c7_9b26_4fe2_a88f_cfb3c7b185ae.slice/crio-ce074b15d90397d6f4731d14846b2c9d4767e12daa09fb62a86f32969cc19e94 WatchSource:0}: Error finding container ce074b15d90397d6f4731d14846b2c9d4767e12daa09fb62a86f32969cc19e94: Status 404 returned error can't find the container with id ce074b15d90397d6f4731d14846b2c9d4767e12daa09fb62a86f32969cc19e94
Sep 07 21:06:32.233100 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:32.233065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt" event={"ID":"230950c7-9b26-4fe2-a88f-cfb3c7b185ae","Type":"ContainerStarted","Data":"6a8c87c6080c286a3a45d6a7e6e29901dfa5cd1ce262c660d4a9b9c141b6cad9"}
Sep 07 21:06:32.233266 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:32.233119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt" event={"ID":"230950c7-9b26-4fe2-a88f-cfb3c7b185ae","Type":"ContainerStarted","Data":"ce074b15d90397d6f4731d14846b2c9d4767e12daa09fb62a86f32969cc19e94"}
Sep 07 21:06:32.250235 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:32.250187    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt" podStartSLOduration=1.066290565 podStartE2EDuration="1.250172954s" totalImagesPullingTime="183.882389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:06:32.249173481 +0000 UTC m=+558.056084030" watchObservedRunningTime="2026-09-07 21:06:32.250172954 +0000 UTC m=+558.057083477"
Sep 07 21:06:32.582834 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:32.582757    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:38.964690 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:38.964656    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"]
Sep 07 21:06:38.968159 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:38.968132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:38.970472 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:38.970437    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 07 21:06:38.977617 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:38.977593    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"]
Sep 07 21:06:39.054545 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.054512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvhhs\" (UniqueName: \"kubernetes.io/projected/c57d285f-1840-4909-b2c3-e85465a39ad9-kube-api-access-gvhhs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.054729 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.054560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.054729 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.054585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57d285f-1840-4909-b2c3-e85465a39ad9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.054729 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.054676    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.054892 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.054785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.054892 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.054811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.155610 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.155570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.155788 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.155659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.155788 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.155698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.155788 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.155759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvhhs\" (UniqueName: \"kubernetes.io/projected/c57d285f-1840-4909-b2c3-e85465a39ad9-kube-api-access-gvhhs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.155943 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.155802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.155943 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.155826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57d285f-1840-4909-b2c3-e85465a39ad9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.156120 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.156098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.156183 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.156109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.156270 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.156197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.157927 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.157902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c57d285f-1840-4909-b2c3-e85465a39ad9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.158237 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.158221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c57d285f-1840-4909-b2c3-e85465a39ad9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.165169 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.165147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvhhs\" (UniqueName: \"kubernetes.io/projected/c57d285f-1840-4909-b2c3-e85465a39ad9-kube-api-access-gvhhs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4\" (UID: \"c57d285f-1840-4909-b2c3-e85465a39ad9\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.278088 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.278012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:39.547243 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:39.547216    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"]
Sep 07 21:06:39.548936 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:06:39.548903    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc57d285f_1840_4909_b2c3_e85465a39ad9.slice/crio-f403026f829955d4ed66727740b3e5b56fd52a4fdd46118dfa02abe4c0209fa7 WatchSource:0}: Error finding container f403026f829955d4ed66727740b3e5b56fd52a4fdd46118dfa02abe4c0209fa7: Status 404 returned error can't find the container with id f403026f829955d4ed66727740b3e5b56fd52a4fdd46118dfa02abe4c0209fa7
Sep 07 21:06:40.278292 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:40.278252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4" event={"ID":"c57d285f-1840-4909-b2c3-e85465a39ad9","Type":"ContainerStarted","Data":"77d2219cd9960fcbde7649c382144d320cef325cb7247bcb960537100a8d013d"}
Sep 07 21:06:40.278821 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:40.278307    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4" event={"ID":"c57d285f-1840-4909-b2c3-e85465a39ad9","Type":"ContainerStarted","Data":"f403026f829955d4ed66727740b3e5b56fd52a4fdd46118dfa02abe4c0209fa7"}
Sep 07 21:06:40.297577 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:40.297525    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4" podStartSLOduration=2.096091419 podStartE2EDuration="2.297507303s" totalImagesPullingTime="201.415884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:06:40.295383642 +0000 UTC m=+566.102294205" watchObservedRunningTime="2026-09-07 21:06:40.297507303 +0000 UTC m=+566.104417827"
Sep 07 21:06:41.278267 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:41.278230    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:41.582850 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:41.582756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:41.595673 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:41.595626    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:42.298437 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:42.298409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-89945f574-ckkkt"
Sep 07 21:06:49.278515 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:49.278484    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:49.292324 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:49.292290    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:06:49.330143 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:06:49.330114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4"
Sep 07 21:08:04.134207 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:04.134172    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-796c6d8b86-5p99q_14d9a786-bfcd-4577-bdc2-aece739c93c7/manager/0.log"
Sep 07 21:08:05.681848 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:05.681804    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-fbxg5_b7dad903-8be7-48c7-a36b-f3074f4f8326/manager/0.log"
Sep 07 21:08:05.902356 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:05.902328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-jlnl8_583dbabb-c609-449d-8a17-1982516e4fc4/kuadrant-console-plugin/0.log"
Sep 07 21:08:06.586940 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:06.586914    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb_6bce06c8-1a78-4b42-8707-ddda56d52d9e/istio-proxy/0.log"
Sep 07 21:08:06.913485 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:06.913443    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-zqdqg_0cb8e5b6-59c1-4f41-b281-bcc0965dba7e/kube-auth-proxy/0.log"
Sep 07 21:08:07.132009 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:07.131978    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s_bcd21c77-fedf-4297-8324-2270eae84602/istio-proxy/0.log"
Sep 07 21:08:08.118872 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:08.118846    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-5bccb7bbf7-4jk9z_a944fd13-2d74-4ca3-b0a9-31bb0ca93cef/main/0.log"
Sep 07 21:08:08.338062 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:08.338031    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-89945f574-ckkkt_230950c7-9b26-4fe2-a88f-cfb3c7b185ae/main/0.log"
Sep 07 21:08:08.451033 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:08.451007    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-7pwj4_c57d285f-1840-4909-b2c3-e85465a39ad9/main/0.log"
Sep 07 21:08:13.400266 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.400233    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l2452/must-gather-xfd5c"]
Sep 07 21:08:13.403899 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.403872    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.406501 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.406478    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l2452\"/\"kube-root-ca.crt\""
Sep 07 21:08:13.407560 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.407543    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l2452\"/\"openshift-service-ca.crt\""
Sep 07 21:08:13.407560 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.407555    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l2452\"/\"default-dockercfg-j5ftn\""
Sep 07 21:08:13.411114 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.411080    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l2452/must-gather-xfd5c"]
Sep 07 21:08:13.499233 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.499199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbrq4\" (UniqueName: \"kubernetes.io/projected/628d571e-2a89-4f11-b25a-a113a6b0336e-kube-api-access-bbrq4\") pod \"must-gather-xfd5c\" (UID: \"628d571e-2a89-4f11-b25a-a113a6b0336e\") " pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.499404 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.499292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/628d571e-2a89-4f11-b25a-a113a6b0336e-must-gather-output\") pod \"must-gather-xfd5c\" (UID: \"628d571e-2a89-4f11-b25a-a113a6b0336e\") " pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.599851 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.599815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/628d571e-2a89-4f11-b25a-a113a6b0336e-must-gather-output\") pod \"must-gather-xfd5c\" (UID: \"628d571e-2a89-4f11-b25a-a113a6b0336e\") " pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.600013 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.599880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbrq4\" (UniqueName: \"kubernetes.io/projected/628d571e-2a89-4f11-b25a-a113a6b0336e-kube-api-access-bbrq4\") pod \"must-gather-xfd5c\" (UID: \"628d571e-2a89-4f11-b25a-a113a6b0336e\") " pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.600179 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.600160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/628d571e-2a89-4f11-b25a-a113a6b0336e-must-gather-output\") pod \"must-gather-xfd5c\" (UID: \"628d571e-2a89-4f11-b25a-a113a6b0336e\") " pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.610216 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.610192    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbrq4\" (UniqueName: \"kubernetes.io/projected/628d571e-2a89-4f11-b25a-a113a6b0336e-kube-api-access-bbrq4\") pod \"must-gather-xfd5c\" (UID: \"628d571e-2a89-4f11-b25a-a113a6b0336e\") " pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.714095 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.714025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l2452/must-gather-xfd5c"
Sep 07 21:08:13.985728 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.985701    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l2452/must-gather-xfd5c"]
Sep 07 21:08:13.987358 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:08:13.987324    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod628d571e_2a89_4f11_b25a_a113a6b0336e.slice/crio-0c249807ddae1eb9a1d68d9f564c18b544f7ffa6b007dbbb2a4a499f748d33f4 WatchSource:0}: Error finding container 0c249807ddae1eb9a1d68d9f564c18b544f7ffa6b007dbbb2a4a499f748d33f4: Status 404 returned error can't find the container with id 0c249807ddae1eb9a1d68d9f564c18b544f7ffa6b007dbbb2a4a499f748d33f4
Sep 07 21:08:13.989332 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:13.989316    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 21:08:14.728959 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:14.728924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l2452/must-gather-xfd5c" event={"ID":"628d571e-2a89-4f11-b25a-a113a6b0336e","Type":"ContainerStarted","Data":"0c249807ddae1eb9a1d68d9f564c18b544f7ffa6b007dbbb2a4a499f748d33f4"}
Sep 07 21:08:15.746521 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:15.746481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l2452/must-gather-xfd5c" event={"ID":"628d571e-2a89-4f11-b25a-a113a6b0336e","Type":"ContainerStarted","Data":"c01de388694ce8775f7d1ca635cd73940f66230d600def29ba1618a320a6bf6d"}
Sep 07 21:08:15.746978 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:15.746532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l2452/must-gather-xfd5c" event={"ID":"628d571e-2a89-4f11-b25a-a113a6b0336e","Type":"ContainerStarted","Data":"8381e79f5159f47db8ee6f8df72676198de7f9a44fb62713c07068065ad88dcb"}
Sep 07 21:08:15.762954 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:15.762894    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l2452/must-gather-xfd5c" podStartSLOduration=1.900488199 podStartE2EDuration="2.762875275s" totalImagesPullingTime="862.387076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 21:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:15.760843883 +0000 UTC m=+661.567754410" watchObservedRunningTime="2026-09-07 21:08:15.762875275 +0000 UTC m=+661.569785800"
Sep 07 21:08:16.378554 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:16.378524    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fzg2r_da7e5605-1bc3-46bd-8151-d5e32f37e05e/global-pull-secret-syncer/0.log"
Sep 07 21:08:16.550025 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:16.549993    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mjw6l_e345f2dc-607f-4cb2-b6a6-1d748e1d486e/konnectivity-agent/0.log"
Sep 07 21:08:16.595119 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:16.595088    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-24.ec2.internal_cd25d00ecfdc6dacba0fd37c82f3213c/haproxy/0.log"
Sep 07 21:08:20.601316 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:20.601224    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-fbxg5_b7dad903-8be7-48c7-a36b-f3074f4f8326/manager/0.log"
Sep 07 21:08:20.735282 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:20.735244    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-jlnl8_583dbabb-c609-449d-8a17-1982516e4fc4/kuadrant-console-plugin/0.log"
Sep 07 21:08:23.009850 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.009781    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-hmhmr_593fbde5-8a72-4107-8310-6b96f9db08ae/monitoring-plugin/0.log"
Sep 07 21:08:23.114217 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.114189    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ml5r_d9444a8e-37db-431f-a1a8-ff75e9c7753a/node-exporter/0.log"
Sep 07 21:08:23.135741 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.135709    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ml5r_d9444a8e-37db-431f-a1a8-ff75e9c7753a/kube-rbac-proxy/0.log"
Sep 07 21:08:23.160647 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.160622    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ml5r_d9444a8e-37db-431f-a1a8-ff75e9c7753a/init-textfile/0.log"
Sep 07 21:08:23.273951 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.273875    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t8fg6_0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b/kube-rbac-proxy-main/0.log"
Sep 07 21:08:23.300035 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.299991    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t8fg6_0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b/kube-rbac-proxy-self/0.log"
Sep 07 21:08:23.325668 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.325615    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t8fg6_0be5c693-1f72-4b1f-b3b8-86ed4d3ae03b/openshift-state-metrics/0.log"
Sep 07 21:08:23.362248 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.362217    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9b8c094-54ce-44c6-888f-2374ba2e9dff/prometheus/0.log"
Sep 07 21:08:23.390497 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.390412    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9b8c094-54ce-44c6-888f-2374ba2e9dff/config-reloader/0.log"
Sep 07 21:08:23.413810 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.413785    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9b8c094-54ce-44c6-888f-2374ba2e9dff/thanos-sidecar/0.log"
Sep 07 21:08:23.439511 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.439487    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9b8c094-54ce-44c6-888f-2374ba2e9dff/kube-rbac-proxy-web/0.log"
Sep 07 21:08:23.462912 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.462880    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9b8c094-54ce-44c6-888f-2374ba2e9dff/kube-rbac-proxy/0.log"
Sep 07 21:08:23.486837 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.486784    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9b8c094-54ce-44c6-888f-2374ba2e9dff/kube-rbac-proxy-thanos/0.log"
Sep 07 21:08:23.513852 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.513822    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a9b8c094-54ce-44c6-888f-2374ba2e9dff/init-config-reloader/0.log"
Sep 07 21:08:23.545156 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.545082    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-c4vmt_a6e2772c-84f2-4342-80d1-10a174849212/prometheus-operator/0.log"
Sep 07 21:08:23.565339 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.565309    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-c4vmt_a6e2772c-84f2-4342-80d1-10a174849212/kube-rbac-proxy/0.log"
Sep 07 21:08:23.602490 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.602421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-z2l4p_3cee2afe-8697-4e50-89f8-ea57071a8691/prometheus-operator-admission-webhook/0.log"
Sep 07 21:08:23.755823 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.755786    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7976df5f66-2tptg_099e0b45-6d59-4e0e-bd11-968bbdd1c65b/thanos-query/0.log"
Sep 07 21:08:23.779163 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.779135    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7976df5f66-2tptg_099e0b45-6d59-4e0e-bd11-968bbdd1c65b/kube-rbac-proxy-web/0.log"
Sep 07 21:08:23.804282 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.804141    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7976df5f66-2tptg_099e0b45-6d59-4e0e-bd11-968bbdd1c65b/kube-rbac-proxy/0.log"
Sep 07 21:08:23.841401 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.841369    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7976df5f66-2tptg_099e0b45-6d59-4e0e-bd11-968bbdd1c65b/prom-label-proxy/0.log"
Sep 07 21:08:23.864759 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.864729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7976df5f66-2tptg_099e0b45-6d59-4e0e-bd11-968bbdd1c65b/kube-rbac-proxy-rules/0.log"
Sep 07 21:08:23.885816 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:23.885786    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7976df5f66-2tptg_099e0b45-6d59-4e0e-bd11-968bbdd1c65b/kube-rbac-proxy-metrics/0.log"
Sep 07 21:08:26.531060 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.531022    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"]
Sep 07 21:08:26.533400 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.533342    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-cbl9z_f46c93ed-ce17-42f5-a4f4-3ce7151c9a0a/download-server/0.log"
Sep 07 21:08:26.538100 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.538071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.542812 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.542777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"]
Sep 07 21:08:26.650038 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.649994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-sys\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.650217 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.650094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmjq\" (UniqueName: \"kubernetes.io/projected/70bfac30-b6d8-47b9-9f69-95be515f783d-kube-api-access-4kmjq\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.650217 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.650164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-proc\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.650217 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.650204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-podres\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.650394 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.650232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-lib-modules\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.750874 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.750829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-sys\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751051 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.750892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmjq\" (UniqueName: \"kubernetes.io/projected/70bfac30-b6d8-47b9-9f69-95be515f783d-kube-api-access-4kmjq\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751051 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.750942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-sys\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751051 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.750954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-proc\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751051 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.751013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-proc\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751051 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.751013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-podres\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751397 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.751058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-lib-modules\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751397 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.751118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-podres\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.751397 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.751204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70bfac30-b6d8-47b9-9f69-95be515f783d-lib-modules\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.759213 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.759185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmjq\" (UniqueName: \"kubernetes.io/projected/70bfac30-b6d8-47b9-9f69-95be515f783d-kube-api-access-4kmjq\") pod \"perf-node-gather-daemonset-98kw2\" (UID: \"70bfac30-b6d8-47b9-9f69-95be515f783d\") " pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:26.852606 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:26.852520    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:27.156571 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:27.156526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"]
Sep 07 21:08:27.157869 ip-10-0-138-24 kubenswrapper[2564]: W0907 21:08:27.157825    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod70bfac30_b6d8_47b9_9f69_95be515f783d.slice/crio-ac920754ffefb0c6e1139333f8b3cb4262dacddaef2bc488b2d35e63cf8eda2a WatchSource:0}: Error finding container ac920754ffefb0c6e1139333f8b3cb4262dacddaef2bc488b2d35e63cf8eda2a: Status 404 returned error can't find the container with id ac920754ffefb0c6e1139333f8b3cb4262dacddaef2bc488b2d35e63cf8eda2a
Sep 07 21:08:27.835658 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:27.835621    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2" event={"ID":"70bfac30-b6d8-47b9-9f69-95be515f783d","Type":"ContainerStarted","Data":"65e205af559846c346c19d402a17751010d73bcc632b36d026f95df98982e1f2"}
Sep 07 21:08:27.836139 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:27.835731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2" event={"ID":"70bfac30-b6d8-47b9-9f69-95be515f783d","Type":"ContainerStarted","Data":"ac920754ffefb0c6e1139333f8b3cb4262dacddaef2bc488b2d35e63cf8eda2a"}
Sep 07 21:08:27.836139 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:27.835851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:27.851723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:27.851676    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2" podStartSLOduration=1.851659936 podStartE2EDuration="1.851659936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 21:08:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 21:08:27.850579307 +0000 UTC m=+673.657489852" watchObservedRunningTime="2026-09-07 21:08:27.851659936 +0000 UTC m=+673.658570461"
Sep 07 21:08:28.347679 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:28.347649    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cns7p_564e38f2-90ac-472d-b9d5-ed594696fbc3/dns/0.log"
Sep 07 21:08:28.370301 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:28.370277    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cns7p_564e38f2-90ac-472d-b9d5-ed594696fbc3/kube-rbac-proxy/0.log"
Sep 07 21:08:28.495214 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:28.495186    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l6n5g_c5259364-ddc0-4760-a336-7c8975913c1f/dns-node-resolver/0.log"
Sep 07 21:08:29.035270 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:29.035243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pbj6b_43bba16a-d690-4864-9e1e-428bd4eb88b8/node-ca/0.log"
Sep 07 21:08:29.996602 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:29.996571    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb_6bce06c8-1a78-4b42-8707-ddda56d52d9e/istio-proxy/0.log"
Sep 07 21:08:30.100872 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:30.100834    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-zqdqg_0cb8e5b6-59c1-4f41-b281-bcc0965dba7e/kube-auth-proxy/0.log"
Sep 07 21:08:30.157256 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:30.157222    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s_bcd21c77-fedf-4297-8324-2270eae84602/istio-proxy/0.log"
Sep 07 21:08:30.909073 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:30.909042    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2v5r_5c830036-e3ca-4886-b4c6-384893d64ca9/serve-healthcheck-canary/0.log"
Sep 07 21:08:31.561607 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:31.561582    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9bj9_b900ab94-d771-4414-bb1b-1b5af9aea8f2/kube-rbac-proxy/0.log"
Sep 07 21:08:31.583276 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:31.583251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9bj9_b900ab94-d771-4414-bb1b-1b5af9aea8f2/exporter/0.log"
Sep 07 21:08:31.605597 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:31.605570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x9bj9_b900ab94-d771-4414-bb1b-1b5af9aea8f2/extractor/0.log"
Sep 07 21:08:33.763543 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:33.763513    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-84dd88468f-6n8zw_c4a4ed34-61aa-4024-b976-06ed415f13bb/manager/0.log"
Sep 07 21:08:33.780906 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:33.780877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-84dd88468f-6n8zw_c4a4ed34-61aa-4024-b976-06ed415f13bb/copy-manifests/0.log"
Sep 07 21:08:33.852193 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:33.852159    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l2452/perf-node-gather-daemonset-98kw2"
Sep 07 21:08:35.024509 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:35.024455    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7dfc566c4c-hpbwt_cd85eb9e-ff77-48af-b079-868065e46676/manager/0.log"
Sep 07 21:08:35.054353 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:35.054320    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-jjzzr_a52baa2e-b58f-412a-be7d-7e26235cde4f/jobset-operator/0.log"
Sep 07 21:08:35.504772 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:35.504742    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb_6bce06c8-1a78-4b42-8707-ddda56d52d9e/istio-proxy/0.log"
Sep 07 21:08:35.575388 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:35.575341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-zqdqg_0cb8e5b6-59c1-4f41-b281-bcc0965dba7e/kube-auth-proxy/0.log"
Sep 07 21:08:35.619027 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:35.618994    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s_bcd21c77-fedf-4297-8324-2270eae84602/istio-proxy/0.log"
Sep 07 21:08:35.879161 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:35.879115    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-796c6d8b86-5p99q_14d9a786-bfcd-4577-bdc2-aece739c93c7/manager/0.log"
Sep 07 21:08:36.954772 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:36.954745    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpvqxb_6bce06c8-1a78-4b42-8707-ddda56d52d9e/istio-proxy/0.log"
Sep 07 21:08:37.027706 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:37.027676    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7dd8c6c7d4-zqdqg_0cb8e5b6-59c1-4f41-b281-bcc0965dba7e/kube-auth-proxy/0.log"
Sep 07 21:08:37.061209 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:37.061178    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6987f5b5b9-d699s_bcd21c77-fedf-4297-8324-2270eae84602/istio-proxy/0.log"
Sep 07 21:08:40.886762 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:40.886728    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-72nt2_8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba/migrator/0.log"
Sep 07 21:08:40.907757 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:40.907732    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-72nt2_8ecd5e56-d9a9-49bd-84fe-4f0f08a1f8ba/graceful-termination/0.log"
Sep 07 21:08:42.443526 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.443500    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxwjt_f3c058ba-708e-4132-9368-4023998fe884/kube-multus-additional-cni-plugins/0.log"
Sep 07 21:08:42.464723 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.464700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxwjt_f3c058ba-708e-4132-9368-4023998fe884/egress-router-binary-copy/0.log"
Sep 07 21:08:42.484930 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.484896    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxwjt_f3c058ba-708e-4132-9368-4023998fe884/cni-plugins/0.log"
Sep 07 21:08:42.505606 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.505581    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxwjt_f3c058ba-708e-4132-9368-4023998fe884/bond-cni-plugin/0.log"
Sep 07 21:08:42.529485 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.529437    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxwjt_f3c058ba-708e-4132-9368-4023998fe884/routeoverride-cni/0.log"
Sep 07 21:08:42.551337 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.551315    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxwjt_f3c058ba-708e-4132-9368-4023998fe884/whereabouts-cni-bincopy/0.log"
Sep 07 21:08:42.571566 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.571544    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxwjt_f3c058ba-708e-4132-9368-4023998fe884/whereabouts-cni/0.log"
Sep 07 21:08:42.792086 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.792012    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-msnms_e68a83b8-94a6-4e4d-a339-50244b63ea5e/kube-multus/0.log"
Sep 07 21:08:42.864240 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.864207    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh894_23809825-6a88-483c-8baa-5625142fb636/network-metrics-daemon/0.log"
Sep 07 21:08:42.885085 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:42.885061    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh894_23809825-6a88-483c-8baa-5625142fb636/kube-rbac-proxy/0.log"
Sep 07 21:08:43.957953 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:43.957926    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhlpq_366e76df-a042-4064-8eb8-a5dd7d5c888a/ovn-controller/0.log"
Sep 07 21:08:43.977605 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:43.977554    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhlpq_366e76df-a042-4064-8eb8-a5dd7d5c888a/ovn-acl-logging/0.log"
Sep 07 21:08:44.000025 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:44.000000    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhlpq_366e76df-a042-4064-8eb8-a5dd7d5c888a/kube-rbac-proxy-node/0.log"
Sep 07 21:08:44.021912 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:44.021887    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhlpq_366e76df-a042-4064-8eb8-a5dd7d5c888a/kube-rbac-proxy-ovn-metrics/0.log"
Sep 07 21:08:44.043000 ip-10-0-138-24 kubenswrapper[2564]: I0907 21:08:44.042975    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhlpq_366e76df-a042-4064-8eb8-a5dd7d5c888a/northd/0.log"