Jul 05 19:32:30.482513 ip-10-0-138-140 systemd[1]: Starting Kubernetes Kubelet...
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.880990    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885839    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885850    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885853    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885857    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885860    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885863    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885866    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:30.887639 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885868    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885871    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885873    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885876    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885878    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885881    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885883    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885886    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885888    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885891    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885894    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885897    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885899    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885901    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885910    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885913    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885915    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885917    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885920    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885922    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:30.897262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885925    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885928    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885931    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885934    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885936    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885939    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885942    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885944    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885947    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885949    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885951    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885954    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885956    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885959    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885962    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885964    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885966    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885969    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885971    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885976    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:30.898651 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885980    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885983    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885986    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885988    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885991    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885994    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885996    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.885999    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886001    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886004    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886006    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886009    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886011    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886014    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886018    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886022    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886025    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886027    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886031    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:30.899622 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886034    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886038    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886041    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886043    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886046    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886049    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886052    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886055    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886057    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886060    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886062    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886065    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886068    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886070    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886073    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886076    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886078    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886081    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886083    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886086    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:30.903485 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886088    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886091    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886093    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886096    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886099    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886101    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886104    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886107    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886110    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886112    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886114    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886117    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886119    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886792    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886798    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886803    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886807    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886811    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886814    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:30.905695 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886818    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886820    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886823    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886825    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886828    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886831    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886833    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886836    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886839    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886841    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886843    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886846    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886849    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886851    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886853    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886857    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886859    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886862    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886865    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:30.907909 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886869    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886872    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886875    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886877    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886880    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886883    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886885    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886888    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886890    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886893    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886895    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886898    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886900    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886903    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886905    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886908    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886910    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886912    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886915    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886917    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:30.909705 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886921    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886925    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886927    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886930    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886932    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886935    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886937    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886939    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886942    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886945    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886947    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886950    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886953    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886955    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886958    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886961    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886963    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886966    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886968    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886971    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:30.913661 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886974    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886976    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886979    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886981    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886983    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886985    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886989    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886991    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886994    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886996    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.886998    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887001    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887003    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887006    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887008    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887010    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887013    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887016    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887018    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:30.916388 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887021    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887023    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887025    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887028    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887031    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887033    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887036    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887039    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887041    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887044    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887046    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887049    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887051    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887053    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887056    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887403    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887408    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887410    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887413    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887416    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:30.917156 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887418    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887421    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887423    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887426    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887428    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887431    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887433    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887435    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887438    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887440    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887444    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887447    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887450    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887452    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887455    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887458    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887460    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887463    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887466    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:30.917898 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887468    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887471    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887473    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887476    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887478    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887481    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887483    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887486    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887488    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887490    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887493    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887495    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887498    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887500    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887502    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887505    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887507    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887509    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887512    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887514    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:30.918638 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887516    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887519    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887523    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887526    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887528    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887531    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887533    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887535    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887538    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887541    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887544    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887546    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887551    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887555    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887559    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887562    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887565    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887567    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887570    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:30.919360 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887573    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887575    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887577    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887580    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887582    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887585    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887587    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887589    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887592    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887594    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887598    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887601    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887603    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887606    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887608    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887612    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887614    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887617    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887620    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887622    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:30.920040 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887625    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887627    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887630    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887636    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887640    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887643    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887645    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887648    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887650    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887653    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887655    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887658    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887660    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887663    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887665    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.887668    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887733    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887739    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887745    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887749    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887753    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 05 19:32:30.920824 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887756    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887761    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887765    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887768    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887771    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887774    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887779    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887782    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887785    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887788    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887791    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887794    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887797    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887801    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887803    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887807    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887810    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887813    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887817    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887819    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887822    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887825    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887828    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887831    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 05 19:32:30.921579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887834    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887837    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887839    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887843    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887846    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887849    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887851    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887854    2583 flags.go:64] FLAG: --enable-server="true"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887857    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887861    2583 flags.go:64] FLAG: --event-burst="100"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887865    2583 flags.go:64] FLAG: --event-qps="50"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887868    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887871    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887873    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887878    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887881    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887884    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887886    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887889    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887892    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887895    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887897    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887900    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887903    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887906    2583 flags.go:64] FLAG: --feature-gates=""
Jul 05 19:32:30.922424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887910    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887912    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887915    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887918    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887921    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887924    2583 flags.go:64] FLAG: --help="false"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887927    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-138-140.ec2.internal"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887929    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887933    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887935    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887938    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887941    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887944    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887947    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887949    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887952    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887955    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887958    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887961    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887963    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887966    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887970    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887973    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887975    2583 flags.go:64] FLAG: --lock-file=""
Jul 05 19:32:30.923363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887978    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887981    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887984    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887989    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887991    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887995    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.887997    2583 flags.go:64] FLAG: --logging-format="text"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888000    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888004    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888007    2583 flags.go:64] FLAG: --manifest-url=""
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888010    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888014    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888016    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888020    2583 flags.go:64] FLAG: --max-pods="110"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888023    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888026    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888029    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888032    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888034    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888037    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888040    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888046    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888049    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888052    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 05 19:32:30.924213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888055    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888058    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888063    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888066    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888069    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888073    2583 flags.go:64] FLAG: --port="10250"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888076    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888079    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0640f8fbde5309e79"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888082    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888085    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888087    2583 flags.go:64] FLAG: --register-node="true"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888090    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888093    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888096    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888099    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888102    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888105    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888108    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888112    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888114    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888117    2583 flags.go:64] FLAG: --runonce="false"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888120    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888123    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888126    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888128    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 05 19:32:30.925106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888131    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888134    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888137    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888140    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888142    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888145    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888148    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888151    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888155    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888158    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888160    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888165    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888169    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888172    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888176    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888179    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888181    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888184    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888187    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888189    2583 flags.go:64] FLAG: --v="2"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888193    2583 flags.go:64] FLAG: --version="false"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888197    2583 flags.go:64] FLAG: --vmodule=""
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888200    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.888204    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 05 19:32:30.925848 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888319    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888323    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888325    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888328    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888331    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888333    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888335    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888338    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888342    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888346    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888348    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888351    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888354    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888357    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888359    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888362    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888366    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888368    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888371    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:30.926434 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888373    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888377    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888380    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888382    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888385    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888387    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888390    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888392    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888394    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888397    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888400    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888402    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888405    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888408    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888410    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888413    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888415    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888418    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888421    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:30.926868 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888425    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888428    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888430    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888433    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888435    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888438    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888440    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888442    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888445    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888447    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888451    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888453    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888456    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888458    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888462    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888465    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888467    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888469    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888472    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888474    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:30.927310 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888477    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888479    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888482    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888484    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888486    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888489    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888491    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888494    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888496    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888499    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888501    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888504    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888506    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888508    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888511    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888513    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888516    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888518    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888521    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888523    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:30.927773 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888526    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888528    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888533    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888536    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888539    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888542    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888546    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888549    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888552    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888555    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888558    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888560    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888563    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888565    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888568    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888570    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888573    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888575    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888578    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888580    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:30.928227 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.888583    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.889507    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.898292    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.898310    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.899193    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.899205    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899337    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899343    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899347    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899351    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899354    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899357    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899360    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899363    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899371    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:30.928690 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899377    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899381    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899384    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899387    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899390    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899392    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899395    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899398    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899400    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899403    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899406    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899409    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899412    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899417    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899420    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899422    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899425    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899428    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899432    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899436    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:30.929063 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899443    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899447    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899450    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899453    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899455    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899459    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899466    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899468    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899471    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899474    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899477    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899480    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899490    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899493    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899496    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899498    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899501    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899504    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899509    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:30.929532 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899511    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899514    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899517    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899519    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899522    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899527    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899529    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899532    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899534    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899537    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899540    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899545    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899548    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899552    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899554    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899557    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899559    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899563    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899567    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:30.929971 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899569    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899572    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899576    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899580    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899585    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899588    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899592    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899611    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899616    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899619    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899622    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899625    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899628    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899630    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899633    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899636    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899639    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899644    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899649    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:30.930423 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899652    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899654    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899657    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899660    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899662    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899665    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899667    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899671    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899674    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899676    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899682    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899684    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.899687    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.899692    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900012    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 19:32:30.930896 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900021    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900024    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900027    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900030    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900039    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900042    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900050    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900056    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900058    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900062    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900064    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900067    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900070    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900073    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900075    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900078    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900082    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900085    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900089    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900093    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 19:32:30.931261 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900102    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900108    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900112    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900116    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900118    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900123    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900125    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900128    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900131    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900133    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900136    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900139    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900146    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900149    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900151    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900154    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900157    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900159    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 19:32:30.931891 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900162    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900171    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900174    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900176    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900179    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900182    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900187    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900189    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900192    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900194    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900198    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900200    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900203    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900206    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900208    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900211    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900214    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900216    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900219    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900225    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 19:32:30.932328 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900227    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900230    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900232    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900235    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900238    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900240    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900243    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900245    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900249    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900253    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900257    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900277    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900280    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900283    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900292    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900295    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900298    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900300    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900303    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900305    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 19:32:30.933074 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900308    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900311    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900316    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900318    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900323    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900326    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900329    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900331    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900334    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900337    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900339    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900345    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900348    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900351    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900354    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900357    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900362    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900364    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900367    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 19:32:30.933764 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:30.900370    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.900376    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.900558    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.903531    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.905193    2583 server.go:1019] "Starting client certificate rotation"
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.905284    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.905327    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.913884    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 19:32:30.934221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.933466    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 19:32:30.944614 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.944599    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 05 19:32:30.946860 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.946833    2583 log.go:25] "Validated CRI v1 image API"
Jul 05 19:32:30.947637 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.947621    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 05 19:32:30.949989 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.949971    2583 fs.go:135] Filesystem UUIDs: map[46c07cdb-3726-463c-95c3-020fd2925705:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c340e0c6-66c0-4b96-898d-e546989bfc15:/dev/nvme0n1p3]
Jul 05 19:32:30.950045 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.949988    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 05 19:32:30.954943 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.954927    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 19:32:30.955929 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.955832    2583 manager.go:216] Machine: {Timestamp:2026-07-05 19:32:30.954518081 +0000 UTC m=+0.348840751 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199059 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aae12d89311937fecea985099168e SystemUUID:ec2aae12-d893-1193-7fec-ea985099168e BootID:06ed3d81-c76d-4d7c-b09b-0eb04ef7c6c4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:10:4f:f5:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:10:4f:f5:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:d2:ef:19:30:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 05 19:32:30.955929 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.955926    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 05 19:32:30.956022 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.956016    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 05 19:32:30.959626 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.959590    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 05 19:32:30.959765 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.959629    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-140.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 05 19:32:30.960861 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.960851    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 05 19:32:30.960901 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.960863    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 05 19:32:30.960901 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.960870    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 19:32:30.962533 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.962523    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 19:32:30.963839 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.963829    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 05 19:32:30.967257 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967246    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 19:32:30.967408 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967399    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 05 19:32:30.967452 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967444    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 05 19:32:30.967483 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967472    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 05 19:32:30.967483 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967482    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 05 19:32:30.967536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967494    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 05 19:32:30.967536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967501    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 05 19:32:30.967846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967825    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 19:32:30.967846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.967849    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 19:32:30.970334 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.970318    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 05 19:32:30.972443 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.972426    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97vw8"
Jul 05 19:32:30.972518 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.972454    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 05 19:32:30.972518 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.972492    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 05 19:32:30.973967 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.973941    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 05 19:32:30.974047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.973971    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 05 19:32:30.974047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.973982    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 05 19:32:30.974047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.973992    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 05 19:32:30.974047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974008    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 05 19:32:30.974047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974018    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 05 19:32:30.974047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974034    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 05 19:32:30.974047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974044    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 05 19:32:30.974366 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974057    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 05 19:32:30.974366 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974068    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 05 19:32:30.974366 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974085    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 05 19:32:30.974366 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.974096    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 05 19:32:30.975674 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.975663    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 05 19:32:30.975674 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.975675    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 05 19:32:30.979148 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.979119    2583 server.go:1268] "Started kubelet"
Jul 05 19:32:30.979912 ip-10-0-138-140 systemd[1]: Started Kubernetes Kubelet.
Jul 05 19:32:30.980641 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.980197    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-140.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 05 19:32:30.980641 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.980391    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 05 19:32:30.980641 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.980633    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97vw8"
Jul 05 19:32:30.981075 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:30.981027    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-140.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 05 19:32:30.981075 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:30.981057    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 05 19:32:30.981457 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.981170    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 05 19:32:30.981457 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.981235    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 05 19:32:30.982881 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.982867    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 05 19:32:30.984041 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.984024    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 05 19:32:30.987257 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:30.987238    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 05 19:32:30.988164 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:30.987353    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-140.ec2.internal.18bf7baacd2dacc9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-140.ec2.internal,UID:ip-10-0-138-140.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-140.ec2.internal,},FirstTimestamp:2026-07-05 19:32:30.978985161 +0000 UTC m=+0.373307849,LastTimestamp:2026-07-05 19:32:30.978985161 +0000 UTC m=+0.373307849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-140.ec2.internal,}"
Jul 05 19:32:30.989161 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.989145    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 05 19:32:30.989223 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.989149    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 05 19:32:30.989376 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:30.989359    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:30.989805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.989788    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 05 19:32:30.989805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.989788    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 05 19:32:30.989922 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.989818    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 05 19:32:30.989922 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.989878    2583 factory.go:55] Registering systemd factory
Jul 05 19:32:30.989922 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.989891    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 05 19:32:30.990054 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990030    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 05 19:32:30.990054 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990038    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 05 19:32:30.990119 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990094    2583 factory.go:153] Registering CRI-O factory
Jul 05 19:32:30.990119 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990107    2583 factory.go:223] Registration of the crio container factory successfully
Jul 05 19:32:30.990181 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990157    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 05 19:32:30.990181 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990178    2583 factory.go:103] Registering Raw factory
Jul 05 19:32:30.990296 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990192    2583 manager.go:1196] Started watching for new ooms in manager
Jul 05 19:32:30.990581 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:30.990570    2583 manager.go:349] Starting recovery of all containers
Jul 05 19:32:31.000058 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.000040    2583 manager.go:354] Recovery completed
Jul 05 19:32:31.000166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.000147    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:31.001624 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.001607    2583 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 05 19:32:31.002930 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.002912    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-140.ec2.internal\" not found" node="ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.005045 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.005031    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:31.006764 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.006751    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:31.006846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.006779    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:31.006846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.006793    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:31.007243 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.007229    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 05 19:32:31.007243 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.007241    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 05 19:32:31.007369 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.007247    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:31.007369 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.007258    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 19:32:31.008003 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.007990    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:31.008045 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.008015    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:31.008045 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.008028    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:31.008544 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.008533    2583 policy_none.go:49] "None policy: Start"
Jul 05 19:32:31.008575 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.008548    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 05 19:32:31.008575 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.008558    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 05 19:32:31.009618 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.009609    2583 policy_none.go:47] "Start"
Jul 05 19:32:31.048916 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.048815    2583 manager.go:337] "Starting Device Plugin manager"
Jul 05 19:32:31.049008 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.048943    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 05 19:32:31.049008 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.048952    2583 server.go:87] "Starting device plugin registration server"
Jul 05 19:32:31.049197 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.049185    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 05 19:32:31.049228 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.049201    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 05 19:32:31.049298 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.049284    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 05 19:32:31.049381 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.049363    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 05 19:32:31.049381 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.049377    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 05 19:32:31.050368 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.050352    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 05 19:32:31.050428 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.050387    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.115206 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.115185    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 05 19:32:31.116218 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.116202    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 05 19:32:31.116302 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.116240    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 05 19:32:31.116302 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.116262    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 05 19:32:31.116404 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.116312    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 05 19:32:31.118536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.118520    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:31.149318 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.149301    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:31.150966 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.150952    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:31.151034 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.150978    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:31.151034 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.150992    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:31.151034 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.151017    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.157055 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.157040    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.157151 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.157063    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-140.ec2.internal\": node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.172213 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.172173    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.217044 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.217028    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"]
Jul 05 19:32:31.217091 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.217074    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:31.217754 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.217742    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:31.217809 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.217772    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:31.217809 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.217787    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:31.219007 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.218995    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:31.219114 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219103    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.219146 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219128    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:31.219638 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219624    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:31.219708 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219641    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:31.219708 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219663    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:31.219708 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219673    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:31.219708 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219646    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:31.219839 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.219723    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:31.220788 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.220774    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.220857 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.220798    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 19:32:31.221381 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.221366    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 19:32:31.221452 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.221395    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 19:32:31.221452 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.221409    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeHasSufficientPID"
Jul 05 19:32:31.244730 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.244712    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-140.ec2.internal\" not found" node="ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.248756 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.248741    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-140.ec2.internal\" not found" node="ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.273048 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.273024    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.291664 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.291645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2701aaf6f08c9babce33f409be88b73-config\") pod \"kube-apiserver-proxy-ip-10-0-138-140.ec2.internal\" (UID: \"d2701aaf6f08c9babce33f409be88b73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.291716 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.291671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa14198e01b5cf5a0ff843688947f4c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal\" (UID: \"aa14198e01b5cf5a0ff843688947f4c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.291716 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.291694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa14198e01b5cf5a0ff843688947f4c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal\" (UID: \"aa14198e01b5cf5a0ff843688947f4c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.374024 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.374003    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.392062 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.392038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2701aaf6f08c9babce33f409be88b73-config\") pod \"kube-apiserver-proxy-ip-10-0-138-140.ec2.internal\" (UID: \"d2701aaf6f08c9babce33f409be88b73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.392125 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.392069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa14198e01b5cf5a0ff843688947f4c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal\" (UID: \"aa14198e01b5cf5a0ff843688947f4c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.392160 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.392122    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa14198e01b5cf5a0ff843688947f4c7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal\" (UID: \"aa14198e01b5cf5a0ff843688947f4c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.392160 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.392145    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2701aaf6f08c9babce33f409be88b73-config\") pod \"kube-apiserver-proxy-ip-10-0-138-140.ec2.internal\" (UID: \"d2701aaf6f08c9babce33f409be88b73\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.392225 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.392152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa14198e01b5cf5a0ff843688947f4c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal\" (UID: \"aa14198e01b5cf5a0ff843688947f4c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.392225 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.392197    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa14198e01b5cf5a0ff843688947f4c7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal\" (UID: \"aa14198e01b5cf5a0ff843688947f4c7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.474797 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.474755    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.551975 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.551943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.551975 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.551977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:31.575353 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.575324    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.681143 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.681117    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.782010 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.781950    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.882236 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.882207    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.905265 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.905243    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 05 19:32:31.905690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.905396    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 19:32:31.905690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.905417    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 19:32:31.983392 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:31.983364    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:31.986700 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.986666    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 19:27:31 +0000 UTC" deadline="2028-01-05 20:32:01.693598918 +0000 UTC"
Jul 05 19:32:31.986700 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:31.986698    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13176h59m29.706904644s"
Jul 05 19:32:32.054962 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.054939    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:32.056369 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:32.056337    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa14198e01b5cf5a0ff843688947f4c7.slice/crio-5efca3e1ec527d39b0be7663401d58bd7bb9a0a201299df4f433ca6abceeffc7 WatchSource:0}: Error finding container 5efca3e1ec527d39b0be7663401d58bd7bb9a0a201299df4f433ca6abceeffc7: Status 404 returned error can't find the container with id 5efca3e1ec527d39b0be7663401d58bd7bb9a0a201299df4f433ca6abceeffc7
Jul 05 19:32:32.056755 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:32.056739    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2701aaf6f08c9babce33f409be88b73.slice/crio-76807007e51126b93059c7004b5552fd0e350e9b725fb52366402bb9c52e50bf WatchSource:0}: Error finding container 76807007e51126b93059c7004b5552fd0e350e9b725fb52366402bb9c52e50bf: Status 404 returned error can't find the container with id 76807007e51126b93059c7004b5552fd0e350e9b725fb52366402bb9c52e50bf
Jul 05 19:32:32.062019 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.062002    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 19:32:32.083769 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:32.083746    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:32.119534 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.119494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal" event={"ID":"d2701aaf6f08c9babce33f409be88b73","Type":"ContainerStarted","Data":"76807007e51126b93059c7004b5552fd0e350e9b725fb52366402bb9c52e50bf"}
Jul 05 19:32:32.120551 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.120526    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal" event={"ID":"aa14198e01b5cf5a0ff843688947f4c7","Type":"ContainerStarted","Data":"5efca3e1ec527d39b0be7663401d58bd7bb9a0a201299df4f433ca6abceeffc7"}
Jul 05 19:32:32.188582 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:32.188557    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-140.ec2.internal\" not found"
Jul 05 19:32:32.254623 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.254604    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:32.289449 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.289427    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:32.300826 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.300762    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 19:32:32.303440 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.301971    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal"
Jul 05 19:32:32.311350 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.311333    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 19:32:32.789345 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.789262    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:32.969144 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.969118    2583 apiserver.go:52] "Watching apiserver"
Jul 05 19:32:32.978684 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.978660    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 05 19:32:32.981083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.981052    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-6pbfm","openshift-image-registry/node-ca-jc8f9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal","openshift-multus/network-metrics-daemon-2jb8c","openshift-network-diagnostics/network-check-target-z8s9h","kube-system/konnectivity-agent-8nwbv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj","openshift-multus/multus-additional-cni-plugins-xk59r","openshift-multus/multus-ts9q8","openshift-network-operator/iptables-alerter-lvw59","openshift-ovn-kubernetes/ovnkube-node-whl76","kube-system/global-pull-secret-syncer-8grkm","kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nzc5m"]
Jul 05 19:32:32.982934 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.982913    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:32.984826 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.984371    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:32.986275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.985511    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 05 19:32:32.986275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.985933    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 05 19:32:32.986275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.986221    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vlrs5\""
Jul 05 19:32:32.986522 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.986480    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 05 19:32:32.986627 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.986599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:32.987950 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.987724    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 05 19:32:32.987950 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.987932    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:32.988123 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:32.988019    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:32.988123 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.988062    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 05 19:32:32.989040 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989004    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 05 19:32:32.989142 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989074    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 05 19:32:32.989241 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989220    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wd4gh\""
Jul 05 19:32:32.989352 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989278    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 05 19:32:32.989352 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989319    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:32.989497 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:32.989398    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:32.989497 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989462    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 05 19:32:32.989611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989598    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 05 19:32:32.989697 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989675    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 05 19:32:32.989748 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.989692    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-22ppp\""
Jul 05 19:32:32.990744 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.990080    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 05 19:32:32.990744 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.990711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:32.992785 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.992400    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:32.993922 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.993904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 05 19:32:32.995243 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.994061    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7wqq9\""
Jul 05 19:32:32.995243 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.995094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:32.996235 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.996214    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.998785    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-cni-netd\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.998837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-modprobe-d\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.998873    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysconfig\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.998907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-systemd\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.998931    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.998966    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.998973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgrb\" (UniqueName: \"kubernetes.io/projected/db9e3862-895f-47d9-812c-ddec648fc1b2-kube-api-access-4wgrb\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-run\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-host\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-tuned\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6q6p\" (UniqueName: \"kubernetes.io/projected/d6b0a84d-d3e5-4362-827b-8f15f3e69016-kube-api-access-h6q6p\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999127    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999198    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-run-netns\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999279    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-systemd\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999114    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 05 19:32:32.999622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-run-ovn-kubernetes\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2zpk\" (UniqueName: \"kubernetes.io/projected/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-kube-api-access-r2zpk\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999671    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tww8g\""
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999607    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9twd2\""
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-socket-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovnkube-config\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovnkube-script-lib\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999899    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysctl-d\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999933    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-sys\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:32.999965    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-slash\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-log-socket\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-lib-modules\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-tmp\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ksq6\" (UniqueName: \"kubernetes.io/projected/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-kube-api-access-4ksq6\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.000747 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87abb88d-ad37-4c45-9e0a-ad9c6d9d040e-konnectivity-ca\") pod \"konnectivity-agent-8nwbv\" (UID: \"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e\") " pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000319    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-ovn\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-node-log\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-kubernetes\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysctl-conf\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.000549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-var-lib-kubelet\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87abb88d-ad37-4c45-9e0a-ad9c6d9d040e-agent-certs\") pod \"konnectivity-agent-8nwbv\" (UID: \"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e\") " pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-sys-fs\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-systemd-units\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-etc-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001748 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-cni-bin\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001748 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-env-overrides\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001748 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovn-node-metrics-cert\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001748 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-kubelet\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.001748 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-registration-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.001748 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001713    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-device-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.002120 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.001762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-var-lib-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.002902 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.002867    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.003653 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.003635    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mxdf7\""
Jul 05 19:32:33.004038 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.003889    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 05 19:32:33.004038 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.003924    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 05 19:32:33.004038 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.003986    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 05 19:32:33.004262 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.004160    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.006758 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.006713    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lsn9x\""
Jul 05 19:32:33.006879 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.006837    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 05 19:32:33.006879 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.006872    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 05 19:32:33.007194 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.007141    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 05 19:32:33.007340 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.007321    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.007409 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.007392    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:33.008531 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.008513    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 05 19:32:33.008638 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.008612    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 05 19:32:33.008824 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.008802    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bkj5s\""
Jul 05 19:32:33.009267 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.009249    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 19:32:33.028526 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.028507    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c72nw"
Jul 05 19:32:33.036726 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.036629    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c72nw"
Jul 05 19:32:33.053623 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.053494    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 19:32:33.091106 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.091087    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 05 19:32:33.102583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-serviceca\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.102679 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102584    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a3b5eb-2b30-460a-807a-9b22b68845f6-tmp-dir\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.102679 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-run-netns\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.102679 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-systemd\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.102846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-run-ovn-kubernetes\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.102846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-systemd\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.102846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102766    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-run-netns\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.102846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2zpk\" (UniqueName: \"kubernetes.io/projected/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-kube-api-access-r2zpk\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.102846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102805    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-run-ovn-kubernetes\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.102846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102812    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-netns\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-conf-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-cnibin\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102937    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-host\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102964    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovnkube-config\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.102996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-tmp\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-kubelet\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-slash\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103087    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-log-socket\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103133    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-log-socket\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksq6\" (UniqueName: \"kubernetes.io/projected/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-kube-api-access-4ksq6\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103190    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-slash\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-ovn\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103319    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f11b3971-c796-40a6-9551-d1dc85239212-dbus\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-system-cni-dir\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103372    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103444    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103491    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-run-ovn\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87abb88d-ad37-4c45-9e0a-ad9c6d9d040e-agent-certs\") pod \"konnectivity-agent-8nwbv\" (UID: \"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e\") " pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-systemd-units\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103613    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-systemd-units\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-etc-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103653    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovnkube-config\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103722    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f11b3971-c796-40a6-9551-d1dc85239212-kubelet-config\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103754    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-etc-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.103805 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-registration-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-device-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103872    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-var-lib-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysconfig\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103917    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-device-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-systemd\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-host\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.103972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-tuned\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104001    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-cnibin\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-run\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-hostroot\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-cni-binary-copy\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91a3b5eb-2b30-460a-807a-9b22b68845f6-hosts-file\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be27ad17-aded-4c10-bf36-ce4deae2c195-cni-binary-copy\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104229    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysconfig\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104272    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.104625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104278    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-var-lib-openvswitch\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104326    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-systemd\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104350    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-run\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104412    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-registration-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104410    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-host\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104449    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-system-cni-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfc71438-68fe-48fd-9d6a-1ff92329cda2-iptables-alerter-script\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4fv\" (UniqueName: \"kubernetes.io/projected/dfc71438-68fe-48fd-9d6a-1ff92329cda2-kube-api-access-9w4fv\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-socket-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovnkube-script-lib\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysctl-d\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104711    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-socket-dir\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104739    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysctl-d\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-sys\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-cni-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.105377 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-daemon-config\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104832    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-sys\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104843    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-lib-modules\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104906    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-cni-multus\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104944    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-lib-modules\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c84w2\" (UniqueName: \"kubernetes.io/projected/91a3b5eb-2b30-460a-807a-9b22b68845f6-kube-api-access-c84w2\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.104981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87abb88d-ad37-4c45-9e0a-ad9c6d9d040e-konnectivity-ca\") pod \"konnectivity-agent-8nwbv\" (UID: \"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e\") " pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-node-log\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-kubernetes\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105095    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysctl-conf\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-var-lib-kubelet\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105172    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-cni-bin\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105172    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovnkube-script-lib\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.106145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105204    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-sysctl-conf\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-sys-fs\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-cni-bin\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105272    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-kubernetes\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-env-overrides\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105332    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-node-log\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovn-node-metrics-cert\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-os-release\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.106921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.105943    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87abb88d-ad37-4c45-9e0a-ad9c6d9d040e-konnectivity-ca\") pod \"konnectivity-agent-8nwbv\" (UID: \"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e\") " pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:33.107336 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107086    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-cni-bin\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.107456 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107436    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-env-overrides\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.107561 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.107532    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:33.107700 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107679    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-tuned\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.107766 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107723    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-tmp\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.107827 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107774    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db9e3862-895f-47d9-812c-ddec648fc1b2-sys-fs\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.107889 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqsxv\" (UniqueName: \"kubernetes.io/projected/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-kube-api-access-bqsxv\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.107944 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.107887    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs podName:d6b0a84d-d3e5-4362-827b-8f15f3e69016 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:33.607837152 +0000 UTC m=+3.002159838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs") pod "network-metrics-daemon-2jb8c" (UID: "d6b0a84d-d3e5-4362-827b-8f15f3e69016") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:33.107944 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107918    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-var-lib-kubelet\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.108063 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.107974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-kubelet\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.108063 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-cni-netd\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.108063 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108026    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87abb88d-ad37-4c45-9e0a-ad9c6d9d040e-agent-certs\") pod \"konnectivity-agent-8nwbv\" (UID: \"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e\") " pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:33.108063 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-modprobe-d\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.108293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6q6p\" (UniqueName: \"kubernetes.io/projected/d6b0a84d-d3e5-4362-827b-8f15f3e69016-kube-api-access-h6q6p\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:33.108293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-k8s-cni-cncf-io\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.108293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108161    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-kubelet\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.108293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-os-release\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.108293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.108293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108220    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-host-cni-netd\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.108293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgrb\" (UniqueName: \"kubernetes.io/projected/db9e3862-895f-47d9-812c-ddec648fc1b2-kube-api-access-4wgrb\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.108706 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-socket-dir-parent\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.108706 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108309    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-etc-modprobe-d\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.108706 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l8dc\" (UniqueName: \"kubernetes.io/projected/844bf420-3791-474e-9869-dd1d52bbafac-kube-api-access-8l8dc\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.108706 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfc71438-68fe-48fd-9d6a-1ff92329cda2-host-slash\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.108706 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-multus-certs\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.108706 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-etc-kubernetes\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.108706 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.108584    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7fkz\" (UniqueName: \"kubernetes.io/projected/be27ad17-aded-4c10-bf36-ce4deae2c195-kube-api-access-c7fkz\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.110296 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.109752    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:33.110296 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.109778    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:33.110296 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.109792    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2qx76 for pod openshift-network-diagnostics/network-check-target-z8s9h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:33.110296 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.109860    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76 podName:dae6d384-942c-4b69-9b6d-94474ea24af1 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:33.609836718 +0000 UTC m=+3.004159378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2qx76" (UniqueName: "kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76") pod "network-check-target-z8s9h" (UID: "dae6d384-942c-4b69-9b6d-94474ea24af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:33.112311 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.112151    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-ovn-node-metrics-cert\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.112611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.112586    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2zpk\" (UniqueName: \"kubernetes.io/projected/97a58ddc-91b4-4815-bac5-4a1ddaa6cec0-kube-api-access-r2zpk\") pod \"ovnkube-node-whl76\" (UID: \"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0\") " pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.113021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.113002    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ksq6\" (UniqueName: \"kubernetes.io/projected/1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72-kube-api-access-4ksq6\") pod \"tuned-nzc5m\" (UID: \"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72\") " pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.119399 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.119375    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgrb\" (UniqueName: \"kubernetes.io/projected/db9e3862-895f-47d9-812c-ddec648fc1b2-kube-api-access-4wgrb\") pod \"aws-ebs-csi-driver-node-lh7jj\" (UID: \"db9e3862-895f-47d9-812c-ddec648fc1b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.119766 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.119743    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6q6p\" (UniqueName: \"kubernetes.io/projected/d6b0a84d-d3e5-4362-827b-8f15f3e69016-kube-api-access-h6q6p\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:33.209076 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-serviceca\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.209076 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a3b5eb-2b30-460a-807a-9b22b68845f6-tmp-dir\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.209275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-netns\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-conf-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-cnibin\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.209275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-netns\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209207    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-cnibin\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.209275 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209247    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-conf-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209309    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-host\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-kubelet\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f11b3971-c796-40a6-9551-d1dc85239212-dbus\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209420    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-host\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-system-cni-dir\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209459    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91a3b5eb-2b30-460a-807a-9b22b68845f6-tmp-dir\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f11b3971-c796-40a6-9551-d1dc85239212-kubelet-config\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209478    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-kubelet\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-cnibin\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209538    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-system-cni-dir\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209584    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-hostroot\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209589    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-cnibin\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-hostroot\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.209611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209601    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-serviceca\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209624    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f11b3971-c796-40a6-9551-d1dc85239212-dbus\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209595    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f11b3971-c796-40a6-9551-d1dc85239212-kubelet-config\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-cni-binary-copy\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91a3b5eb-2b30-460a-807a-9b22b68845f6-hosts-file\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be27ad17-aded-4c10-bf36-ce4deae2c195-cni-binary-copy\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-system-cni-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfc71438-68fe-48fd-9d6a-1ff92329cda2-iptables-alerter-script\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4fv\" (UniqueName: \"kubernetes.io/projected/dfc71438-68fe-48fd-9d6a-1ff92329cda2-kube-api-access-9w4fv\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-cni-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209820    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91a3b5eb-2b30-460a-807a-9b22b68845f6-hosts-file\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209827    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-system-cni-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-daemon-config\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-cni-multus\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209885    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-cni-dir\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.210293 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c84w2\" (UniqueName: \"kubernetes.io/projected/91a3b5eb-2b30-460a-807a-9b22b68845f6-kube-api-access-c84w2\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209962    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-cni-bin\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.209987    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-cni-multus\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-os-release\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqsxv\" (UniqueName: \"kubernetes.io/projected/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-kube-api-access-bqsxv\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.210075    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-k8s-cni-cncf-io\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-os-release\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.210138    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret podName:f11b3971-c796-40a6-9551-d1dc85239212 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:33.710120992 +0000 UTC m=+3.104443674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret") pod "global-pull-secret-syncer-8grkm" (UID: "f11b3971-c796-40a6-9551-d1dc85239212") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210187    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-os-release\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-socket-dir-parent\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210215    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-cni-binary-copy\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210227    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be27ad17-aded-4c10-bf36-ce4deae2c195-cni-binary-copy\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210249    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-socket-dir-parent\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l8dc\" (UniqueName: \"kubernetes.io/projected/844bf420-3791-474e-9869-dd1d52bbafac-kube-api-access-8l8dc\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfc71438-68fe-48fd-9d6a-1ff92329cda2-host-slash\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210306    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-os-release\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210321    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-multus-certs\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-etc-kubernetes\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210374    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-var-lib-cni-bin\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210372    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-multus-certs\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210408    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-host-run-k8s-cni-cncf-io\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210417    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/844bf420-3791-474e-9869-dd1d52bbafac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7fkz\" (UniqueName: \"kubernetes.io/projected/be27ad17-aded-4c10-bf36-ce4deae2c195-kube-api-access-c7fkz\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210418    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfc71438-68fe-48fd-9d6a-1ff92329cda2-iptables-alerter-script\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210422    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be27ad17-aded-4c10-bf36-ce4deae2c195-etc-kubernetes\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210460    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfc71438-68fe-48fd-9d6a-1ff92329cda2-host-slash\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210488    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/844bf420-3791-474e-9869-dd1d52bbafac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.211786 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.210804    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be27ad17-aded-4c10-bf36-ce4deae2c195-multus-daemon-config\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.222892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.222870    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqsxv\" (UniqueName: \"kubernetes.io/projected/918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac-kube-api-access-bqsxv\") pod \"node-ca-jc8f9\" (UID: \"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac\") " pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.223001 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.222921    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l8dc\" (UniqueName: \"kubernetes.io/projected/844bf420-3791-474e-9869-dd1d52bbafac-kube-api-access-8l8dc\") pod \"multus-additional-cni-plugins-xk59r\" (UID: \"844bf420-3791-474e-9869-dd1d52bbafac\") " pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.223148 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.223128    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c84w2\" (UniqueName: \"kubernetes.io/projected/91a3b5eb-2b30-460a-807a-9b22b68845f6-kube-api-access-c84w2\") pod \"node-resolver-6pbfm\" (UID: \"91a3b5eb-2b30-460a-807a-9b22b68845f6\") " pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.223257 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.222813    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7fkz\" (UniqueName: \"kubernetes.io/projected/be27ad17-aded-4c10-bf36-ce4deae2c195-kube-api-access-c7fkz\") pod \"multus-ts9q8\" (UID: \"be27ad17-aded-4c10-bf36-ce4deae2c195\") " pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.223475 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.223459    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4fv\" (UniqueName: \"kubernetes.io/projected/dfc71438-68fe-48fd-9d6a-1ff92329cda2-kube-api-access-9w4fv\") pod \"iptables-alerter-lvw59\" (UID: \"dfc71438-68fe-48fd-9d6a-1ff92329cda2\") " pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.299969 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.299906    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj"
Jul 05 19:32:33.310162 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.310142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:33.319199 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.319182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nzc5m"
Jul 05 19:32:33.324127 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.324102    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:33.331651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.331632    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ts9q8"
Jul 05 19:32:33.340195 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.340177    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xk59r"
Jul 05 19:32:33.346913 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.346896    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jc8f9"
Jul 05 19:32:33.356471 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.356454    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvw59"
Jul 05 19:32:33.362195 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.362178    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6pbfm"
Jul 05 19:32:33.613316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.613232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:33.613316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.613272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:33.613514 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.613397    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:33.613514 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.613411    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:33.613514 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.613421    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2qx76 for pod openshift-network-diagnostics/network-check-target-z8s9h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:33.613514 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.613456    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:33.613514 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.613477    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76 podName:dae6d384-942c-4b69-9b6d-94474ea24af1 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:34.613456656 +0000 UTC m=+4.007779319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qx76" (UniqueName: "kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76") pod "network-check-target-z8s9h" (UID: "dae6d384-942c-4b69-9b6d-94474ea24af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:33.613514 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.613509    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs podName:d6b0a84d-d3e5-4362-827b-8f15f3e69016 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:34.613495758 +0000 UTC m=+4.007818425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs") pod "network-metrics-daemon-2jb8c" (UID: "d6b0a84d-d3e5-4362-827b-8f15f3e69016") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:33.715916 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:33.713952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:33.715916 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.714192    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:33.715916 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:33.714275    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret podName:f11b3971-c796-40a6-9551-d1dc85239212 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:34.714257446 +0000 UTC m=+4.108580110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret") pod "global-pull-secret-syncer-8grkm" (UID: "f11b3971-c796-40a6-9551-d1dc85239212") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:34.039537 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.039492    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 19:27:33 +0000 UTC" deadline="2028-02-28 10:39:06.92972026 +0000 UTC"
Jul 05 19:32:34.039537 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.039537    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14463h6m32.890186495s"
Jul 05 19:32:34.044361 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.044335    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a58ddc_91b4_4815_bac5_4a1ddaa6cec0.slice/crio-4a8e9ddc279e874bc815c3f22279cd3e74f9f409221127fb4178e14064da565c WatchSource:0}: Error finding container 4a8e9ddc279e874bc815c3f22279cd3e74f9f409221127fb4178e14064da565c: Status 404 returned error can't find the container with id 4a8e9ddc279e874bc815c3f22279cd3e74f9f409221127fb4178e14064da565c
Jul 05 19:32:34.045782 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.045752    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87abb88d_ad37_4c45_9e0a_ad9c6d9d040e.slice/crio-fcffc58f7be49b5d986696919aa49730062376bd89b28c6200d9dbaa6373c05a WatchSource:0}: Error finding container fcffc58f7be49b5d986696919aa49730062376bd89b28c6200d9dbaa6373c05a: Status 404 returned error can't find the container with id fcffc58f7be49b5d986696919aa49730062376bd89b28c6200d9dbaa6373c05a
Jul 05 19:32:34.050301 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.050275    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9e3862_895f_47d9_812c_ddec648fc1b2.slice/crio-35fff0af30bda0f0845a6b1c93fb87ac8efb6fab496bc94f58e17e401628250c WatchSource:0}: Error finding container 35fff0af30bda0f0845a6b1c93fb87ac8efb6fab496bc94f58e17e401628250c: Status 404 returned error can't find the container with id 35fff0af30bda0f0845a6b1c93fb87ac8efb6fab496bc94f58e17e401628250c
Jul 05 19:32:34.050813 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.050786    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844bf420_3791_474e_9869_dd1d52bbafac.slice/crio-49265f5ca2e657a2793457a5234b32c337810bd685e178fc96464eb116837fa0 WatchSource:0}: Error finding container 49265f5ca2e657a2793457a5234b32c337810bd685e178fc96464eb116837fa0: Status 404 returned error can't find the container with id 49265f5ca2e657a2793457a5234b32c337810bd685e178fc96464eb116837fa0
Jul 05 19:32:34.052191 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.052167    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc71438_68fe_48fd_9d6a_1ff92329cda2.slice/crio-e0a8d3823892c8f0cc0a4f47af449c5bf69ab416c93f42a3e342b8c97ce7cc81 WatchSource:0}: Error finding container e0a8d3823892c8f0cc0a4f47af449c5bf69ab416c93f42a3e342b8c97ce7cc81: Status 404 returned error can't find the container with id e0a8d3823892c8f0cc0a4f47af449c5bf69ab416c93f42a3e342b8c97ce7cc81
Jul 05 19:32:34.053022 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.052957    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe27ad17_aded_4c10_bf36_ce4deae2c195.slice/crio-897df1fcc5d25b4296af851fd5c53ae606114117f6308a2130941c11d22f02fe WatchSource:0}: Error finding container 897df1fcc5d25b4296af851fd5c53ae606114117f6308a2130941c11d22f02fe: Status 404 returned error can't find the container with id 897df1fcc5d25b4296af851fd5c53ae606114117f6308a2130941c11d22f02fe
Jul 05 19:32:34.054840 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.054689    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a3b5eb_2b30_460a_807a_9b22b68845f6.slice/crio-5d9ce0d94f3711bf5f62859da34a3de66ce8732916f5a95f314419124111a797 WatchSource:0}: Error finding container 5d9ce0d94f3711bf5f62859da34a3de66ce8732916f5a95f314419124111a797: Status 404 returned error can't find the container with id 5d9ce0d94f3711bf5f62859da34a3de66ce8732916f5a95f314419124111a797
Jul 05 19:32:34.055352 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.055320    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c98ae8d_81e0_4c7f_8f71_c5b204c2ee72.slice/crio-164681fb8d334b9418d083b5ef203dc6665e5c4b9e62c1bee5b13b0966319e6d WatchSource:0}: Error finding container 164681fb8d334b9418d083b5ef203dc6665e5c4b9e62c1bee5b13b0966319e6d: Status 404 returned error can't find the container with id 164681fb8d334b9418d083b5ef203dc6665e5c4b9e62c1bee5b13b0966319e6d
Jul 05 19:32:34.057262 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:32:34.057225    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918e0ee9_d8ef_4a2a_8d1b_8486d1d308ac.slice/crio-f987b115ce26b19d6400af9a33bc50e7c5e5df255067fb3ebd76e6c31fd83917 WatchSource:0}: Error finding container f987b115ce26b19d6400af9a33bc50e7c5e5df255067fb3ebd76e6c31fd83917: Status 404 returned error can't find the container with id f987b115ce26b19d6400af9a33bc50e7c5e5df255067fb3ebd76e6c31fd83917
Jul 05 19:32:34.116651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.116551    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:34.116727 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.116648    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:34.123784 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.123758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj" event={"ID":"db9e3862-895f-47d9-812c-ddec648fc1b2","Type":"ContainerStarted","Data":"35fff0af30bda0f0845a6b1c93fb87ac8efb6fab496bc94f58e17e401628250c"}
Jul 05 19:32:34.124901 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.124874    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8nwbv" event={"ID":"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e","Type":"ContainerStarted","Data":"fcffc58f7be49b5d986696919aa49730062376bd89b28c6200d9dbaa6373c05a"}
Jul 05 19:32:34.126172 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.126148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvw59" event={"ID":"dfc71438-68fe-48fd-9d6a-1ff92329cda2","Type":"ContainerStarted","Data":"e0a8d3823892c8f0cc0a4f47af449c5bf69ab416c93f42a3e342b8c97ce7cc81"}
Jul 05 19:32:34.127248 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.127226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerStarted","Data":"49265f5ca2e657a2793457a5234b32c337810bd685e178fc96464eb116837fa0"}
Jul 05 19:32:34.128641 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.128506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"4a8e9ddc279e874bc815c3f22279cd3e74f9f409221127fb4178e14064da565c"}
Jul 05 19:32:34.129760 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.129733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jc8f9" event={"ID":"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac","Type":"ContainerStarted","Data":"f987b115ce26b19d6400af9a33bc50e7c5e5df255067fb3ebd76e6c31fd83917"}
Jul 05 19:32:34.130982 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.130962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzc5m" event={"ID":"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72","Type":"ContainerStarted","Data":"164681fb8d334b9418d083b5ef203dc6665e5c4b9e62c1bee5b13b0966319e6d"}
Jul 05 19:32:34.132040 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.132014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6pbfm" event={"ID":"91a3b5eb-2b30-460a-807a-9b22b68845f6","Type":"ContainerStarted","Data":"5d9ce0d94f3711bf5f62859da34a3de66ce8732916f5a95f314419124111a797"}
Jul 05 19:32:34.133134 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.133115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ts9q8" event={"ID":"be27ad17-aded-4c10-bf36-ce4deae2c195","Type":"ContainerStarted","Data":"897df1fcc5d25b4296af851fd5c53ae606114117f6308a2130941c11d22f02fe"}
Jul 05 19:32:34.621026 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.620912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:34.621026 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.620979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:34.621239 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.621136    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:34.621239 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.621157    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:34.621239 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.621169    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2qx76 for pod openshift-network-diagnostics/network-check-target-z8s9h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:34.621239 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.621229    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76 podName:dae6d384-942c-4b69-9b6d-94474ea24af1 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:36.621210732 +0000 UTC m=+6.015533395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qx76" (UniqueName: "kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76") pod "network-check-target-z8s9h" (UID: "dae6d384-942c-4b69-9b6d-94474ea24af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:34.621552 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.621296    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:34.621552 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.621346    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs podName:d6b0a84d-d3e5-4362-827b-8f15f3e69016 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:36.621334638 +0000 UTC m=+6.015657301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs") pod "network-metrics-daemon-2jb8c" (UID: "d6b0a84d-d3e5-4362-827b-8f15f3e69016") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:34.721878 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:34.721841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:34.722057 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.721985    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:34.722057 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:34.722054    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret podName:f11b3971-c796-40a6-9551-d1dc85239212 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:36.722032821 +0000 UTC m=+6.116355486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret") pod "global-pull-secret-syncer-8grkm" (UID: "f11b3971-c796-40a6-9551-d1dc85239212") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:35.040330 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.040290    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 19:27:33 +0000 UTC" deadline="2028-04-04 09:51:36.895196026 +0000 UTC"
Jul 05 19:32:35.040330 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.040329    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15326h19m1.854871786s"
Jul 05 19:32:35.119311 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.119281    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:35.119490 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:35.119446    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:35.120169 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.120005    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:35.120169 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:35.120131    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:35.147416 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.147012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal" event={"ID":"d2701aaf6f08c9babce33f409be88b73","Type":"ContainerStarted","Data":"6141b71e8ad09088212b71352e2b9f12fde427dd1a7fe13ad919e947fa7281c2"}
Jul 05 19:32:35.169543 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.169379    2583 generic.go:356] "Generic (PLEG): container finished" podID="aa14198e01b5cf5a0ff843688947f4c7" containerID="6888cd141664709209b11397c0e6c9a26491764602f19ffc0501c9a94d6f2c4d" exitCode=0
Jul 05 19:32:35.169543 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.169448    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal" event={"ID":"aa14198e01b5cf5a0ff843688947f4c7","Type":"ContainerDied","Data":"6888cd141664709209b11397c0e6c9a26491764602f19ffc0501c9a94d6f2c4d"}
Jul 05 19:32:35.188742 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:35.188685    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-140.ec2.internal" podStartSLOduration=3.188667582 podStartE2EDuration="3.188667582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:35.163291915 +0000 UTC m=+4.557614599" watchObservedRunningTime="2026-07-05 19:32:35.188667582 +0000 UTC m=+4.582990267"
Jul 05 19:32:36.117171 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:36.117138    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:36.117659 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.117265    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:36.200205 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:36.200138    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal" event={"ID":"aa14198e01b5cf5a0ff843688947f4c7","Type":"ContainerStarted","Data":"b84a9441c074a78895408b2de990d414c966d378d022af6c23016fa46b92457f"}
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:36.660020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:36.660122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.660258    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.660340    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs podName:d6b0a84d-d3e5-4362-827b-8f15f3e69016 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:40.660303147 +0000 UTC m=+10.054625820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs") pod "network-metrics-daemon-2jb8c" (UID: "d6b0a84d-d3e5-4362-827b-8f15f3e69016") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.660766    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.660784    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.660798    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2qx76 for pod openshift-network-diagnostics/network-check-target-z8s9h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:36.660881 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.660845    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76 podName:dae6d384-942c-4b69-9b6d-94474ea24af1 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:40.660828042 +0000 UTC m=+10.055150704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qx76" (UniqueName: "kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76") pod "network-check-target-z8s9h" (UID: "dae6d384-942c-4b69-9b6d-94474ea24af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:36.761531 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:36.760941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:36.761531 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.761105    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:36.761531 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:36.761168    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret podName:f11b3971-c796-40a6-9551-d1dc85239212 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:40.761150883 +0000 UTC m=+10.155473549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret") pod "global-pull-secret-syncer-8grkm" (UID: "f11b3971-c796-40a6-9551-d1dc85239212") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:37.116556 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:37.116466    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:37.116861 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:37.116601    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:37.117615 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:37.117373    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:37.117615 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:37.117504    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:38.117724 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:38.117161    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:38.117724 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:38.117320    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:39.118376 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:39.117452    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:39.118376 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:39.117592    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:39.118376 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:39.118058    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:39.118376 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:39.118166    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:40.117021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:40.116984    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:40.117203 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.117120    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:40.695549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:40.695615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.695672    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.695721    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.695730    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs podName:d6b0a84d-d3e5-4362-827b-8f15f3e69016 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:48.695711256 +0000 UTC m=+18.090033933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs") pod "network-metrics-daemon-2jb8c" (UID: "d6b0a84d-d3e5-4362-827b-8f15f3e69016") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.695772    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.695785    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2qx76 for pod openshift-network-diagnostics/network-check-target-z8s9h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:40.695887 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.695855    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76 podName:dae6d384-942c-4b69-9b6d-94474ea24af1 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:48.695842293 +0000 UTC m=+18.090164954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qx76" (UniqueName: "kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76") pod "network-check-target-z8s9h" (UID: "dae6d384-942c-4b69-9b6d-94474ea24af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:40.797493 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:40.796957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:40.797493 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.797123    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:40.797493 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:40.797176    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret podName:f11b3971-c796-40a6-9551-d1dc85239212 nodeName:}" failed. No retries permitted until 2026-07-05 19:32:48.797158399 +0000 UTC m=+18.191481059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret") pod "global-pull-secret-syncer-8grkm" (UID: "f11b3971-c796-40a6-9551-d1dc85239212") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:41.118087 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:41.117869    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:41.118087 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:41.118000    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:41.118334 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:41.118123    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:41.118334 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:41.118246    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:42.117113 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:42.117084    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:42.117608 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:42.117204    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:43.117815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:43.117729    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:43.118307 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:43.117863    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:43.118307 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:43.117947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:43.118307 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:43.118067    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:44.117251 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:44.117212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:44.117466 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:44.117350    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:45.117259 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:45.117227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:45.117661 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:45.117285    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:45.117661 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:45.117378    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:45.117661 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:45.117509    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:46.117145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:46.117114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:46.117349 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:46.117219    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:47.117341 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:47.117308    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:47.117813 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:47.117351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:47.117813 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:47.117456    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:47.117813 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:47.117587    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:48.116632 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:48.116601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:48.116840 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.116722    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:48.756262 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:48.756223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:48.756712 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.756425    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:32:48.756712 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.756450    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:32:48.756712 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.756463    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2qx76 for pod openshift-network-diagnostics/network-check-target-z8s9h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:48.756712 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.756530    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76 podName:dae6d384-942c-4b69-9b6d-94474ea24af1 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:04.756511248 +0000 UTC m=+34.150833920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qx76" (UniqueName: "kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76") pod "network-check-target-z8s9h" (UID: "dae6d384-942c-4b69-9b6d-94474ea24af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:32:48.756712 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:48.756425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:48.756712 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.756551    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:48.756712 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.756612    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs podName:d6b0a84d-d3e5-4362-827b-8f15f3e69016 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:04.756588649 +0000 UTC m=+34.150911308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs") pod "network-metrics-daemon-2jb8c" (UID: "d6b0a84d-d3e5-4362-827b-8f15f3e69016") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:32:48.857818 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:48.857782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:48.858018 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.857987    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:48.858153 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:48.858069    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret podName:f11b3971-c796-40a6-9551-d1dc85239212 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:04.858048112 +0000 UTC m=+34.252370780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret") pod "global-pull-secret-syncer-8grkm" (UID: "f11b3971-c796-40a6-9551-d1dc85239212") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:32:49.117525 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:49.117435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:49.117694 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:49.117435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:49.117694 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:49.117570    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:49.117694 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:49.117638    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:50.117333 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:50.117296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:50.117778 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:50.117428    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:51.118215 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:51.118170    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:51.118704 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:51.118308    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:51.118704 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:51.118367    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:51.118704 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:51.118480    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:52.117072 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:52.117031    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:52.117244 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:52.117147    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:53.116921 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.116724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:53.117420 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.116798    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:53.117420 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:53.117007    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:53.117420 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:53.117113    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:53.237846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.237795    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nzc5m" event={"ID":"1c98ae8d-81e0-4c7f-8f71-c5b204c2ee72","Type":"ContainerStarted","Data":"7cbde868b384656680ceeb10ea164e1251bfe7bdfaca7d286c539733564e68fe"}
Jul 05 19:32:53.239172 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.239149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6pbfm" event={"ID":"91a3b5eb-2b30-460a-807a-9b22b68845f6","Type":"ContainerStarted","Data":"e7ff28dbf523851505210cebfe20547050fed5839f29c6f93bb4f1dbdf7ad059"}
Jul 05 19:32:53.240828 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.240803    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ts9q8" event={"ID":"be27ad17-aded-4c10-bf36-ce4deae2c195","Type":"ContainerStarted","Data":"f6e72b51892d07ae06ca79f4998c9c299bdacfe99d952d61fa0a02d229a05e08"}
Jul 05 19:32:53.242317 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.242293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj" event={"ID":"db9e3862-895f-47d9-812c-ddec648fc1b2","Type":"ContainerStarted","Data":"1f415098c40c6e47cd4210ccc4a647503e51d47c02461ed490bd2013630caf34"}
Jul 05 19:32:53.243767 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.243731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8nwbv" event={"ID":"87abb88d-ad37-4c45-9e0a-ad9c6d9d040e","Type":"ContainerStarted","Data":"055b3aed2334eb82293f569c0a686aa35874616f813b641d95f1ea74cf9e83ad"}
Jul 05 19:32:53.245465 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.245441    2583 generic.go:356] "Generic (PLEG): container finished" podID="844bf420-3791-474e-9869-dd1d52bbafac" containerID="c246d27aad6378e7054345f681f3c4f4a2bf097ea1f500aab4b0ce724d221242" exitCode=0
Jul 05 19:32:53.245554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.245520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerDied","Data":"c246d27aad6378e7054345f681f3c4f4a2bf097ea1f500aab4b0ce724d221242"}
Jul 05 19:32:53.247788 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.247763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"51a26c46604a3b9d09cb9c73f501847b583da05712c646a097dd2236364166f7"}
Jul 05 19:32:53.247876 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.247828    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"61af5cefa88276a09a534d7728916fc06d031ba8a8d88b9fe98d4d41fd9ab23f"}
Jul 05 19:32:53.247938 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.247874    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"b17e9c68ec3e32c0e079ced7ec188912f12d7022b9e1ad9e191e0641c259aebe"}
Jul 05 19:32:53.249132 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.249112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jc8f9" event={"ID":"918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac","Type":"ContainerStarted","Data":"e0ee6a06b089ffef36d48b6f9a59c87d6c23b312870e5c3fb7a56c5bad79d48d"}
Jul 05 19:32:53.258010 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.257977    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-140.ec2.internal" podStartSLOduration=21.257967016 podStartE2EDuration="21.257967016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:36.221885168 +0000 UTC m=+5.616207877" watchObservedRunningTime="2026-07-05 19:32:53.257967016 +0000 UTC m=+22.652289697"
Jul 05 19:32:53.258536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.258510    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nzc5m" podStartSLOduration=3.463502306 podStartE2EDuration="22.258504192s" totalImagesPullingTime="18.795001886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:53.257872429 +0000 UTC m=+22.652195110" watchObservedRunningTime="2026-07-05 19:32:53.258504192 +0000 UTC m=+22.652826872"
Jul 05 19:32:53.274167 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.274134    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jc8f9" podStartSLOduration=3.486583267 podStartE2EDuration="22.274124232s" totalImagesPullingTime="18.787540965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:53.274056776 +0000 UTC m=+22.668379455" watchObservedRunningTime="2026-07-05 19:32:53.274124232 +0000 UTC m=+22.668446927"
Jul 05 19:32:53.307840 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.307795    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8nwbv" podStartSLOduration=11.665952632 podStartE2EDuration="22.307783577s" totalImagesPullingTime="10.641830945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:53.307593762 +0000 UTC m=+22.701916442" watchObservedRunningTime="2026-07-05 19:32:53.307783577 +0000 UTC m=+22.702106258"
Jul 05 19:32:53.308317 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.308293    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6pbfm" podStartSLOduration=3.51709029 podStartE2EDuration="22.308264785s" totalImagesPullingTime="18.791174495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:53.291660376 +0000 UTC m=+22.685983056" watchObservedRunningTime="2026-07-05 19:32:53.308264785 +0000 UTC m=+22.702587494"
Jul 05 19:32:53.327192 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:53.327151    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ts9q8" podStartSLOduration=3.489773432 podStartE2EDuration="22.327139203s" totalImagesPullingTime="18.837365771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:53.326577009 +0000 UTC m=+22.720899690" watchObservedRunningTime="2026-07-05 19:32:53.327139203 +0000 UTC m=+22.721461883"
Jul 05 19:32:54.117130 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.117098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:54.117668 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:54.117228    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:54.253248 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.253208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvw59" event={"ID":"dfc71438-68fe-48fd-9d6a-1ff92329cda2","Type":"ContainerStarted","Data":"f74f0a3fcb377ff05af905f1c7cc0c8a6648140cc027450602bf7afafb0963d1"}
Jul 05 19:32:54.256563 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.256523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"5e70674e3b0401abcb69d5b7f11d143719c9752884b42fb905630b395025e970"}
Jul 05 19:32:54.256704 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.256611    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"66b53c019c4f2b803faae15e272310f5181b94477cce12011a2708b9a45b5c21"}
Jul 05 19:32:54.256704 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.256663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"8477a47471e21d168896e619356e9d7a0effdb3f2a8bcb8bae9f0daa4511a533"}
Jul 05 19:32:54.269485 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.269445    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lvw59" podStartSLOduration=4.476465655 podStartE2EDuration="23.269430607s" totalImagesPullingTime="18.792964952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:54.269158908 +0000 UTC m=+23.663481593" watchObservedRunningTime="2026-07-05 19:32:54.269430607 +0000 UTC m=+23.663753321"
Jul 05 19:32:54.422561 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.422534    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 05 19:32:54.766097 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.766015    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:54.766604 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:54.766581    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:55.061966 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.061818    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T19:32:54.422555033Z","UUID":"026bbb10-80ef-4453-b308-c33629d44b72","Handler":null,"Name":"","Endpoint":""}
Jul 05 19:32:55.063668 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.063646    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 05 19:32:55.063792 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.063683    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 05 19:32:55.117228 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.117164    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:55.117228 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.117194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:55.117765 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:55.117289    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:55.117765 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:55.117373    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:55.265865 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.265824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj" event={"ID":"db9e3862-895f-47d9-812c-ddec648fc1b2","Type":"ContainerStarted","Data":"9a856aad86c91d2610cad15a04416bfe67e85b059d004a44734ec855916d45d6"}
Jul 05 19:32:55.266048 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.266029    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:55.266584 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:55.266563    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8nwbv"
Jul 05 19:32:56.116495 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:56.116462    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:56.116668 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:56.116640    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:56.270518 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:56.270475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj" event={"ID":"db9e3862-895f-47d9-812c-ddec648fc1b2","Type":"ContainerStarted","Data":"84625da20e0cddbe4eb2c358e997acff6ffbe2289a41de070f94a50c1a48314b"}
Jul 05 19:32:56.274651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:56.274629    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"5d6d210d0342f61ef6a71fc8dcc2ec0b7b9e3762562c4b94c1dc7eabc65086b1"}
Jul 05 19:32:56.288862 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:56.288823    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lh7jj" podStartSLOduration=4.311384716 podStartE2EDuration="25.288809125s" totalImagesPullingTime="20.977424409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:56.288192613 +0000 UTC m=+25.682515296" watchObservedRunningTime="2026-07-05 19:32:56.288809125 +0000 UTC m=+25.683131810"
Jul 05 19:32:57.116954 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:57.116745    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:57.117124 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:57.116797    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:57.117124 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:57.117064    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:57.117235 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:57.117139    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:58.117460 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.117381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:58.118249 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:58.117507    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:58.282261 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.282214    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" event={"ID":"97a58ddc-91b4-4815-bac5-4a1ddaa6cec0","Type":"ContainerStarted","Data":"999e4373fafe84d5f7d90a3e4f7224e11641affd8999c1baa4e2d19bd1f553ec"}
Jul 05 19:32:58.282874 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.282853    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:58.283014 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.282922    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:58.283904 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.283881    2583 generic.go:356] "Generic (PLEG): container finished" podID="844bf420-3791-474e-9869-dd1d52bbafac" containerID="7788ab14196c21491db52ac96b2250e2aaca1b1721a60976df38e068d984cdae" exitCode=0
Jul 05 19:32:58.284011 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.283909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerDied","Data":"7788ab14196c21491db52ac96b2250e2aaca1b1721a60976df38e068d984cdae"}
Jul 05 19:32:58.299139 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.299120    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:58.311620 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:58.311579    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-whl76" podStartSLOduration=8.43798945 podStartE2EDuration="27.311565757s" totalImagesPullingTime="18.873576307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:32:58.311147339 +0000 UTC m=+27.705470020" watchObservedRunningTime="2026-07-05 19:32:58.311565757 +0000 UTC m=+27.705888437"
Jul 05 19:32:59.117003 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.116754    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:59.117199 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.116815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:59.117199 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:59.117109    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:59.117306 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:59.117190    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:32:59.286215 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.286109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:59.300576 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.300551    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:32:59.945955 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.945856    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8s9h"]
Jul 05 19:32:59.946148 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.946016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:32:59.946148 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:59.946127    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:32:59.946561 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.946537    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8grkm"]
Jul 05 19:32:59.946692 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.946634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:32:59.946752 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:59.946724    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:32:59.947226 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.947203    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jb8c"]
Jul 05 19:32:59.947355 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:32:59.947318    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:32:59.947434 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:32:59.947413    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:33:00.290153 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:00.290067    2583 generic.go:356] "Generic (PLEG): container finished" podID="844bf420-3791-474e-9869-dd1d52bbafac" containerID="ea5290bb12fcac58326052802c22ec0a7a7c27c78102ef0711554937ea2a68e3" exitCode=0
Jul 05 19:33:00.290645 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:00.290157    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerDied","Data":"ea5290bb12fcac58326052802c22ec0a7a7c27c78102ef0711554937ea2a68e3"}
Jul 05 19:33:01.118115 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:01.118087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:01.118319 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:01.118187    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:33:01.118319 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:01.118255    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:01.118451 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:01.118372    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:33:02.117116 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:02.116840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:02.117558 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:02.117166    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:33:02.297299 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:02.297248    2583 generic.go:356] "Generic (PLEG): container finished" podID="844bf420-3791-474e-9869-dd1d52bbafac" containerID="b07c37325349b70718d95f812caaff8c2e82dc982a85bc91953950174eeca56f" exitCode=0
Jul 05 19:33:02.297478 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:02.297317    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerDied","Data":"b07c37325349b70718d95f812caaff8c2e82dc982a85bc91953950174eeca56f"}
Jul 05 19:33:03.120444 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:03.120418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:03.120961 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:03.120418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:03.120961 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:03.120522    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:33:03.120961 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:03.120845    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:33:04.116686 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:04.116650    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:04.116852 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.116784    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8s9h" podUID="dae6d384-942c-4b69-9b6d-94474ea24af1"
Jul 05 19:33:04.781725 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:04.781699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:04.782182 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:04.781740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:04.782182 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.781855    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:33:04.782182 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.781916    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs podName:d6b0a84d-d3e5-4362-827b-8f15f3e69016 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:36.781902153 +0000 UTC m=+66.176224813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs") pod "network-metrics-daemon-2jb8c" (UID: "d6b0a84d-d3e5-4362-827b-8f15f3e69016") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 19:33:04.782182 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.781858    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 19:33:04.782182 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.781941    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 19:33:04.782182 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.781952    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2qx76 for pod openshift-network-diagnostics/network-check-target-z8s9h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:33:04.782182 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.782002    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76 podName:dae6d384-942c-4b69-9b6d-94474ea24af1 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:36.781990424 +0000 UTC m=+66.176313083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2qx76" (UniqueName: "kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76") pod "network-check-target-z8s9h" (UID: "dae6d384-942c-4b69-9b6d-94474ea24af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 19:33:04.882842 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:04.882808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:04.882990 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.882945    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 19:33:04.883030 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:04.883006    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret podName:f11b3971-c796-40a6-9551-d1dc85239212 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:36.882992044 +0000 UTC m=+66.277314708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret") pod "global-pull-secret-syncer-8grkm" (UID: "f11b3971-c796-40a6-9551-d1dc85239212") : object "kube-system"/"original-pull-secret" not registered
Jul 05 19:33:05.117115 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.117027    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:05.117255 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:05.117161    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8grkm" podUID="f11b3971-c796-40a6-9551-d1dc85239212"
Jul 05 19:33:05.117255 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.117194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:05.117386 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:05.117258    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jb8c" podUID="d6b0a84d-d3e5-4362-827b-8f15f3e69016"
Jul 05 19:33:05.877920 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.877891    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-140.ec2.internal" event="NodeReady"
Jul 05 19:33:05.878382 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.878047    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 05 19:33:05.922053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.922012    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-655b8b9ff8-pjjnq"]
Jul 05 19:33:05.954319 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.954289    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2rs6n"]
Jul 05 19:33:05.954473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.954398    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.957551 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.957527    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 05 19:33:05.957672 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.957530    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 05 19:33:05.957672 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.957644    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 05 19:33:05.957788 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.957748    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cndlv\""
Jul 05 19:33:05.964069 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.964047    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 05 19:33:05.968258 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.968239    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bdzgz"]
Jul 05 19:33:05.968388 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.968373    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:05.971173 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.971157    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 05 19:33:05.971305 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.971236    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n6b4c\""
Jul 05 19:33:05.971305 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.971255    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 05 19:33:05.985840 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.985821    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655b8b9ff8-pjjnq"]
Jul 05 19:33:05.985925 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.985855    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rs6n"]
Jul 05 19:33:05.985925 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.985880    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bdzgz"]
Jul 05 19:33:05.986021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.985932    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:05.988800 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.988783    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 05 19:33:05.988800 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.988792    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 05 19:33:05.988909 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.988823    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 05 19:33:05.988909 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.988828    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jcsgz\""
Jul 05 19:33:05.991718 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991695    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nc6b\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-kube-api-access-9nc6b\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.991814 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991726    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-image-registry-private-configuration\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.991814 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-bound-sa-token\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.991916 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a358f46c-c182-4cdf-9ae1-5c268b271ceb-tmp-dir\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:05.991916 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-trusted-ca\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.992021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-ca-trust-extracted\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.992021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a358f46c-c182-4cdf-9ae1-5c268b271ceb-config-volume\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:05.992021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991965    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zqmc\" (UniqueName: \"kubernetes.io/projected/ef0a5fca-63b0-4081-9f0f-0f76a9960f93-kube-api-access-6zqmc\") pod \"ingress-canary-bdzgz\" (UID: \"ef0a5fca-63b0-4081-9f0f-0f76a9960f93\") " pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:05.992021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.991991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.992021 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.992015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-certificates\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.992228 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.992040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-installation-pull-secrets\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:05.992228 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.992127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:05.992228 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.992160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef0a5fca-63b0-4081-9f0f-0f76a9960f93-cert\") pod \"ingress-canary-bdzgz\" (UID: \"ef0a5fca-63b0-4081-9f0f-0f76a9960f93\") " pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:05.992228 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:05.992202    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv9k5\" (UniqueName: \"kubernetes.io/projected/a358f46c-c182-4cdf-9ae1-5c268b271ceb-kube-api-access-rv9k5\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.092991 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.092963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-bound-sa-token\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a358f46c-c182-4cdf-9ae1-5c268b271ceb-tmp-dir\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.093165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-trusted-ca\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-ca-trust-extracted\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a358f46c-c182-4cdf-9ae1-5c268b271ceb-config-volume\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.093165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqmc\" (UniqueName: \"kubernetes.io/projected/ef0a5fca-63b0-4081-9f0f-0f76a9960f93-kube-api-access-6zqmc\") pod \"ingress-canary-bdzgz\" (UID: \"ef0a5fca-63b0-4081-9f0f-0f76a9960f93\") " pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:06.093165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-certificates\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-installation-pull-secrets\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef0a5fca-63b0-4081-9f0f-0f76a9960f93-cert\") pod \"ingress-canary-bdzgz\" (UID: \"ef0a5fca-63b0-4081-9f0f-0f76a9960f93\") " pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv9k5\" (UniqueName: \"kubernetes.io/projected/a358f46c-c182-4cdf-9ae1-5c268b271ceb-kube-api-access-rv9k5\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nc6b\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-kube-api-access-9nc6b\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093399    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a358f46c-c182-4cdf-9ae1-5c268b271ceb-tmp-dir\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.093459    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 19:33:06.093473 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.093477    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b8b9ff8-pjjnq: secret "image-registry-tls" not found
Jul 05 19:33:06.093941 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.093528    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:06.093941 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.093543    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls podName:506ffe68-0464-4f2b-a81a-8f4c5947a4d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:06.593522649 +0000 UTC m=+35.987845324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls") pod "image-registry-655b8b9ff8-pjjnq" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6") : secret "image-registry-tls" not found
Jul 05 19:33:06.093941 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.093576    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls podName:a358f46c-c182-4cdf-9ae1-5c268b271ceb nodeName:}" failed. No retries permitted until 2026-07-05 19:33:06.593560417 +0000 UTC m=+35.987883088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls") pod "dns-default-2rs6n" (UID: "a358f46c-c182-4cdf-9ae1-5c268b271ceb") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:06.093941 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093463    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-ca-trust-extracted\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.093941 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093710    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a358f46c-c182-4cdf-9ae1-5c268b271ceb-config-volume\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.093941 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.093885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-image-registry-private-configuration\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.094248 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.094038    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-certificates\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.094509 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.094479    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-trusted-ca\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.097926 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.097906    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-image-registry-private-configuration\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.098023 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.097928    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef0a5fca-63b0-4081-9f0f-0f76a9960f93-cert\") pod \"ingress-canary-bdzgz\" (UID: \"ef0a5fca-63b0-4081-9f0f-0f76a9960f93\") " pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:06.098023 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.097936    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-installation-pull-secrets\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.102585 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.102554    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-bound-sa-token\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.103178 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.102714    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nc6b\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-kube-api-access-9nc6b\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.103178 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.102973    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv9k5\" (UniqueName: \"kubernetes.io/projected/a358f46c-c182-4cdf-9ae1-5c268b271ceb-kube-api-access-rv9k5\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.103178 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.103135    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zqmc\" (UniqueName: \"kubernetes.io/projected/ef0a5fca-63b0-4081-9f0f-0f76a9960f93-kube-api-access-6zqmc\") pod \"ingress-canary-bdzgz\" (UID: \"ef0a5fca-63b0-4081-9f0f-0f76a9960f93\") " pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:06.117422 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.117396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:06.120819 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.120799    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 19:33:06.120925 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.120850    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmzkm\""
Jul 05 19:33:06.120994 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.120980    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 19:33:06.295132 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.295046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bdzgz"
Jul 05 19:33:06.597103 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.596930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:06.597247 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.597125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:06.597247 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.597087    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 19:33:06.597247 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.597175    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b8b9ff8-pjjnq: secret "image-registry-tls" not found
Jul 05 19:33:06.597446 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.597248    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls podName:506ffe68-0464-4f2b-a81a-8f4c5947a4d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:07.597226814 +0000 UTC m=+36.991549490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls") pod "image-registry-655b8b9ff8-pjjnq" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6") : secret "image-registry-tls" not found
Jul 05 19:33:06.597446 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.597280    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:06.597446 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:06.597329    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls podName:a358f46c-c182-4cdf-9ae1-5c268b271ceb nodeName:}" failed. No retries permitted until 2026-07-05 19:33:07.597316788 +0000 UTC m=+36.991639448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls") pod "dns-default-2rs6n" (UID: "a358f46c-c182-4cdf-9ae1-5c268b271ceb") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:06.627023 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:06.626993    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bdzgz"]
Jul 05 19:33:06.722306 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:06.722258    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0a5fca_63b0_4081_9f0f_0f76a9960f93.slice/crio-0f8c7213071eb62d1617cd254b0fed588a971d76d26fe51e9fa541827010ca36 WatchSource:0}: Error finding container 0f8c7213071eb62d1617cd254b0fed588a971d76d26fe51e9fa541827010ca36: Status 404 returned error can't find the container with id 0f8c7213071eb62d1617cd254b0fed588a971d76d26fe51e9fa541827010ca36
Jul 05 19:33:07.116864 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.116771    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:07.117521 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.116956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:07.119997 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.119978    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 19:33:07.121239 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.121222    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 19:33:07.121349 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.121245    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dghwm\""
Jul 05 19:33:07.312392 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.312356    2583 generic.go:356] "Generic (PLEG): container finished" podID="844bf420-3791-474e-9869-dd1d52bbafac" containerID="db08659afcb3eb70ee476ca40962a70f4e282b9b4963da8cc2b95e7314807f76" exitCode=0
Jul 05 19:33:07.312537 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.312439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerDied","Data":"db08659afcb3eb70ee476ca40962a70f4e282b9b4963da8cc2b95e7314807f76"}
Jul 05 19:33:07.313445 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.313427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bdzgz" event={"ID":"ef0a5fca-63b0-4081-9f0f-0f76a9960f93","Type":"ContainerStarted","Data":"0f8c7213071eb62d1617cd254b0fed588a971d76d26fe51e9fa541827010ca36"}
Jul 05 19:33:07.604260 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.604227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:07.604441 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:07.604310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:07.604441 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:07.604380    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 19:33:07.604441 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:07.604396    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b8b9ff8-pjjnq: secret "image-registry-tls" not found
Jul 05 19:33:07.604582 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:07.604452    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls podName:506ffe68-0464-4f2b-a81a-8f4c5947a4d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.604437532 +0000 UTC m=+38.998760203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls") pod "image-registry-655b8b9ff8-pjjnq" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6") : secret "image-registry-tls" not found
Jul 05 19:33:07.604582 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:07.604464    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:07.604582 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:07.604525    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls podName:a358f46c-c182-4cdf-9ae1-5c268b271ceb nodeName:}" failed. No retries permitted until 2026-07-05 19:33:09.604506389 +0000 UTC m=+38.998829054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls") pod "dns-default-2rs6n" (UID: "a358f46c-c182-4cdf-9ae1-5c268b271ceb") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:08.320100 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:08.320070    2583 generic.go:356] "Generic (PLEG): container finished" podID="844bf420-3791-474e-9869-dd1d52bbafac" containerID="a1ae440c4b6c1e37996779ed6df638c9b12471de292d8e3d4cc413abab341719" exitCode=0
Jul 05 19:33:08.320532 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:08.320142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerDied","Data":"a1ae440c4b6c1e37996779ed6df638c9b12471de292d8e3d4cc413abab341719"}
Jul 05 19:33:09.325839 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:09.325562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xk59r" event={"ID":"844bf420-3791-474e-9869-dd1d52bbafac","Type":"ContainerStarted","Data":"551ffa7cc18ca9910d2bcece979d0d6cd58b8c60bd08ad65be1cedb2233be020"}
Jul 05 19:33:09.326917 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:09.326894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bdzgz" event={"ID":"ef0a5fca-63b0-4081-9f0f-0f76a9960f93","Type":"ContainerStarted","Data":"41a8d52ce7e328e38e59cd14d67163bf3df807bae638d86d8b6ac98d26c3590d"}
Jul 05 19:33:09.351299 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:09.351212    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xk59r" podStartSLOduration=8.528442169 podStartE2EDuration="38.351194195s" totalImagesPullingTime="29.822752026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:09.349857862 +0000 UTC m=+38.744180545" watchObservedRunningTime="2026-07-05 19:33:09.351194195 +0000 UTC m=+38.745516876"
Jul 05 19:33:09.367261 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:09.367214    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bdzgz" podStartSLOduration=2.068279226 podStartE2EDuration="4.367198844s" totalImagesPullingTime="2.298919618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:09.367009254 +0000 UTC m=+38.761331936" watchObservedRunningTime="2026-07-05 19:33:09.367198844 +0000 UTC m=+38.761521521"
Jul 05 19:33:09.619513 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:09.619482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:09.619663 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:09.619560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:09.619663 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:09.619639    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:09.619736 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:09.619706    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls podName:a358f46c-c182-4cdf-9ae1-5c268b271ceb nodeName:}" failed. No retries permitted until 2026-07-05 19:33:13.619689755 +0000 UTC m=+43.014012414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls") pod "dns-default-2rs6n" (UID: "a358f46c-c182-4cdf-9ae1-5c268b271ceb") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:09.619736 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:09.619643    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 19:33:09.619804 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:09.619744    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b8b9ff8-pjjnq: secret "image-registry-tls" not found
Jul 05 19:33:09.619835 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:09.619822    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls podName:506ffe68-0464-4f2b-a81a-8f4c5947a4d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:13.619811257 +0000 UTC m=+43.014133916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls") pod "image-registry-655b8b9ff8-pjjnq" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6") : secret "image-registry-tls" not found
Jul 05 19:33:13.647186 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:13.647146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:13.647186 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:13.647195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:13.647728 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:13.647307    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:13.647728 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:13.647310    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 19:33:13.647728 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:13.647327    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b8b9ff8-pjjnq: secret "image-registry-tls" not found
Jul 05 19:33:13.647728 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:13.647351    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls podName:a358f46c-c182-4cdf-9ae1-5c268b271ceb nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.647338379 +0000 UTC m=+51.041661038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls") pod "dns-default-2rs6n" (UID: "a358f46c-c182-4cdf-9ae1-5c268b271ceb") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:13.647728 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:13.647372    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls podName:506ffe68-0464-4f2b-a81a-8f4c5947a4d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.647357434 +0000 UTC m=+51.041680096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls") pod "image-registry-655b8b9ff8-pjjnq" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6") : secret "image-registry-tls" not found
Jul 05 19:33:14.054741 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.054661    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vwrll"]
Jul 05 19:33:14.082258 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.082230    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwrll"]
Jul 05 19:33:14.082404 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.082362    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.085085 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.085058    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 05 19:33:14.085233 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.085213    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 05 19:33:14.085333 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.085218    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 05 19:33:14.085333 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.085246    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 05 19:33:14.086729 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.086715    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-phcbk\""
Jul 05 19:33:14.151743 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.151719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qr6w\" (UniqueName: \"kubernetes.io/projected/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-api-access-7qr6w\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.151834 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.151789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-crio-socket\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.151834 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.151806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-data-volume\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.152003 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.151905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.152003 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.151957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.252213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.252187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.252336 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.252216    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.252336 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.252244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qr6w\" (UniqueName: \"kubernetes.io/projected/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-api-access-7qr6w\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.252336 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.252320    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-crio-socket\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.252495 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.252335    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.252495 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.252366    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:14.252495 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.252389    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:14.752374806 +0000 UTC m=+44.146697468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.252495 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.252426    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:14.75240739 +0000 UTC m=+44.146730063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:14.252495 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.252336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-data-volume\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.252670 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.252529    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-crio-socket\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.252670 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.252621    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-data-volume\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.267800 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.267767    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qr6w\" (UniqueName: \"kubernetes.io/projected/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-api-access-7qr6w\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.756126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.756085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.756126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:14.756127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:14.756561 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.756196    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.756561 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.756231    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:14.756561 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.756248    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:15.756235648 +0000 UTC m=+45.150558306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:14.756561 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:14.756315    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:15.756300655 +0000 UTC m=+45.150623314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:15.763642 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:15.763599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:15.763642 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:15.763646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:15.764243 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:15.763739    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:15.764243 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:15.763752    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:15.764243 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:15.763818    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.763799477 +0000 UTC m=+47.158122136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:15.764243 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:15.763838    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:17.763829866 +0000 UTC m=+47.158152525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:15.826592 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:15.826566    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6pbfm_91a3b5eb-2b30-460a-807a-9b22b68845f6/dns-node-resolver/0.log"
Jul 05 19:33:17.027025 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:17.026998    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jc8f9_918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac/node-ca/0.log"
Jul 05 19:33:17.777350 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:17.777313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:17.777350 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:17.777352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:17.777551 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:17.777455    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 19:33:17.777551 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:17.777462    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:17.777551 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:17.777508    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.777494464 +0000 UTC m=+51.171817123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : configmap "kube-rbac-proxy" not found
Jul 05 19:33:17.777551 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:17.777521    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:21.777515435 +0000 UTC m=+51.171838094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:17.831334 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:17.831301    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bdzgz_ef0a5fca-63b0-4081-9f0f-0f76a9960f93/serve-healthcheck-canary/0.log"
Jul 05 19:33:21.710367 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:21.710315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:21.710821 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:21.710392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:21.710821 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:21.710477    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 19:33:21.710821 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:21.710499    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b8b9ff8-pjjnq: secret "image-registry-tls" not found
Jul 05 19:33:21.710821 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:21.710515    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 19:33:21.710821 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:21.710565    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls podName:506ffe68-0464-4f2b-a81a-8f4c5947a4d6 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:37.71054829 +0000 UTC m=+67.104870950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls") pod "image-registry-655b8b9ff8-pjjnq" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6") : secret "image-registry-tls" not found
Jul 05 19:33:21.710821 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:21.710579    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls podName:a358f46c-c182-4cdf-9ae1-5c268b271ceb nodeName:}" failed. No retries permitted until 2026-07-05 19:33:37.710573376 +0000 UTC m=+67.104896035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls") pod "dns-default-2rs6n" (UID: "a358f46c-c182-4cdf-9ae1-5c268b271ceb") : secret "dns-default-metrics-tls" not found
Jul 05 19:33:21.811594 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:21.811554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:21.811594 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:21.811606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:21.811840 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:21.811716    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:21.811840 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:21.811784    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls podName:9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe nodeName:}" failed. No retries permitted until 2026-07-05 19:33:29.811768994 +0000 UTC m=+59.206091652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vwrll" (UID: "9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe") : secret "insights-runtime-extractor-tls" not found
Jul 05 19:33:21.812173 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:21.812154    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:29.876608 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:29.876574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:29.878791 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:29.878769    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vwrll\" (UID: \"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe\") " pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:29.991646 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:29.991618    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vwrll"
Jul 05 19:33:30.109491 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:30.109461    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vwrll"]
Jul 05 19:33:30.114072 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:30.114047    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcd0991_7349_4811_bf1a_a1e2aa4eb7fe.slice/crio-f283f969918395633fa456591521fd396f02a89f1225ef9a209331d899e8f319 WatchSource:0}: Error finding container f283f969918395633fa456591521fd396f02a89f1225ef9a209331d899e8f319: Status 404 returned error can't find the container with id f283f969918395633fa456591521fd396f02a89f1225ef9a209331d899e8f319
Jul 05 19:33:30.377614 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:30.377581    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwrll" event={"ID":"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe","Type":"ContainerStarted","Data":"f283f969918395633fa456591521fd396f02a89f1225ef9a209331d899e8f319"}
Jul 05 19:33:31.303636 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:31.303605    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whl76"
Jul 05 19:33:34.388762 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:34.388728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwrll" event={"ID":"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe","Type":"ContainerStarted","Data":"f69a7142387b3f7e4dfba30f717176b654a73a22e78286a3c9aa92d66c829bf6"}
Jul 05 19:33:35.393340 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:35.393300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwrll" event={"ID":"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe","Type":"ContainerStarted","Data":"83d2df3a04dcf18de8726151a7834219e232a8b192a627586618121f1bfb4370"}
Jul 05 19:33:36.476359 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.476318    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655b8b9ff8-pjjnq"]
Jul 05 19:33:36.476740 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:36.476541    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq" podUID="506ffe68-0464-4f2b-a81a-8f4c5947a4d6"
Jul 05 19:33:36.485681 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.485653    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-m5fr6"]
Jul 05 19:33:36.489657 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.489636    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-m5fr6"
Jul 05 19:33:36.492651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.492598    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 05 19:33:36.492651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.492611    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 05 19:33:36.492651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.492623    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-w6p6r\""
Jul 05 19:33:36.502087 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.502035    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-m5fr6"]
Jul 05 19:33:36.631375 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.631342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87rgm\" (UniqueName: \"kubernetes.io/projected/5edd1742-a691-4994-b925-e5b5deadb370-kube-api-access-87rgm\") pod \"downloads-685bfb5f64-m5fr6\" (UID: \"5edd1742-a691-4994-b925-e5b5deadb370\") " pod="openshift-console/downloads-685bfb5f64-m5fr6"
Jul 05 19:33:36.732695 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.732616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87rgm\" (UniqueName: \"kubernetes.io/projected/5edd1742-a691-4994-b925-e5b5deadb370-kube-api-access-87rgm\") pod \"downloads-685bfb5f64-m5fr6\" (UID: \"5edd1742-a691-4994-b925-e5b5deadb370\") " pod="openshift-console/downloads-685bfb5f64-m5fr6"
Jul 05 19:33:36.743644 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.743615    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87rgm\" (UniqueName: \"kubernetes.io/projected/5edd1742-a691-4994-b925-e5b5deadb370-kube-api-access-87rgm\") pod \"downloads-685bfb5f64-m5fr6\" (UID: \"5edd1742-a691-4994-b925-e5b5deadb370\") " pod="openshift-console/downloads-685bfb5f64-m5fr6"
Jul 05 19:33:36.800577 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.800553    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-m5fr6"
Jul 05 19:33:36.834070 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.834034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:36.834220 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.834109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:36.837232 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.837203    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 19:33:36.837364 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.837306    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 19:33:36.847561 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.847540    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b0a84d-d3e5-4362-827b-8f15f3e69016-metrics-certs\") pod \"network-metrics-daemon-2jb8c\" (UID: \"d6b0a84d-d3e5-4362-827b-8f15f3e69016\") " pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:36.847758 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.847742    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 19:33:36.858729 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.858706    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qx76\" (UniqueName: \"kubernetes.io/projected/dae6d384-942c-4b69-9b6d-94474ea24af1-kube-api-access-2qx76\") pod \"network-check-target-z8s9h\" (UID: \"dae6d384-942c-4b69-9b6d-94474ea24af1\") " pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:36.934555 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.934514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:36.937388 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.937364    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 19:33:36.947147 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:36.947119    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f11b3971-c796-40a6-9551-d1dc85239212-original-pull-secret\") pod \"global-pull-secret-syncer-8grkm\" (UID: \"f11b3971-c796-40a6-9551-d1dc85239212\") " pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:37.031257 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.031182    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmzkm\""
Jul 05 19:33:37.038690 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.038668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:37.126071 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.126046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8grkm"
Jul 05 19:33:37.133639 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.133617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dghwm\""
Jul 05 19:33:37.141082 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.141061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jb8c"
Jul 05 19:33:37.330480 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:37.330439    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b0a84d_d3e5_4362_827b_8f15f3e69016.slice/crio-2becb86c5f08ca14cf7d44c0c3cc55c58085c5e10f4a062f656762a650bb752e WatchSource:0}: Error finding container 2becb86c5f08ca14cf7d44c0c3cc55c58085c5e10f4a062f656762a650bb752e: Status 404 returned error can't find the container with id 2becb86c5f08ca14cf7d44c0c3cc55c58085c5e10f4a062f656762a650bb752e
Jul 05 19:33:37.335741 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.335713    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jb8c"]
Jul 05 19:33:37.340043 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.340018    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8s9h"]
Jul 05 19:33:37.342595 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:37.342572    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae6d384_942c_4b69_9b6d_94474ea24af1.slice/crio-e6d09b81f5406c690c76affb70f7e5d8fcffef33044089c4eb584e9584642c61 WatchSource:0}: Error finding container e6d09b81f5406c690c76affb70f7e5d8fcffef33044089c4eb584e9584642c61: Status 404 returned error can't find the container with id e6d09b81f5406c690c76affb70f7e5d8fcffef33044089c4eb584e9584642c61
Jul 05 19:33:37.399169 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.399132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8s9h" event={"ID":"dae6d384-942c-4b69-9b6d-94474ea24af1","Type":"ContainerStarted","Data":"e6d09b81f5406c690c76affb70f7e5d8fcffef33044089c4eb584e9584642c61"}
Jul 05 19:33:37.401156 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.401132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vwrll" event={"ID":"9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe","Type":"ContainerStarted","Data":"e6c501c40944a021a5fd278f0a43690f7701d6e4c0cdedac03ce913433e8c07b"}
Jul 05 19:33:37.402234 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.402217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:37.402335 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.402255    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jb8c" event={"ID":"d6b0a84d-d3e5-4362-827b-8f15f3e69016","Type":"ContainerStarted","Data":"2becb86c5f08ca14cf7d44c0c3cc55c58085c5e10f4a062f656762a650bb752e"}
Jul 05 19:33:37.407713 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.407697    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:37.419321 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.419280    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vwrll" podStartSLOduration=16.43670592 podStartE2EDuration="23.419252803s" totalImagesPullingTime="6.982546883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:33:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:37.418918411 +0000 UTC m=+66.813241093" watchObservedRunningTime="2026-07-05 19:33:37.419252803 +0000 UTC m=+66.813575507"
Jul 05 19:33:37.538674 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538616    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-ca-trust-extracted\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.538674 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538659    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-bound-sa-token\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.539126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538687    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-trusted-ca\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.539126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538728    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nc6b\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-kube-api-access-9nc6b\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.539126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538777    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-certificates\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.539126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-image-registry-private-configuration\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.539126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538853    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-installation-pull-secrets\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.539126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.538899    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:33:37.539551 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.539145    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-ca-trust-extracted\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:37.539551 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.539175    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:33:37.539830 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.539795    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:33:37.541382 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.541352    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:33:37.541477 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.541409    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:33:37.541477 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.541455    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:33:37.541800 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.541771    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-kube-api-access-9nc6b" (OuterVolumeSpecName: "kube-api-access-9nc6b") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "kube-api-access-9nc6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:33:37.562809 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.562726    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8grkm"]
Jul 05 19:33:37.565065 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:37.565039    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11b3971_c796_40a6_9551_d1dc85239212.slice/crio-d2d1488829b38755dab3f32760fe3e7163e79bedcfd6338331849dd178bff6cb WatchSource:0}: Error finding container d2d1488829b38755dab3f32760fe3e7163e79bedcfd6338331849dd178bff6cb: Status 404 returned error can't find the container with id d2d1488829b38755dab3f32760fe3e7163e79bedcfd6338331849dd178bff6cb
Jul 05 19:33:37.567549 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.567494    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-m5fr6"]
Jul 05 19:33:37.571722 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:37.571702    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edd1742_a691_4994_b925_e5b5deadb370.slice/crio-c6a5a029633a34e52877d9370cc4c6bccccf3620f65acbe8a6870d98afc0337e WatchSource:0}: Error finding container c6a5a029633a34e52877d9370cc4c6bccccf3620f65acbe8a6870d98afc0337e: Status 404 returned error can't find the container with id c6a5a029633a34e52877d9370cc4c6bccccf3620f65acbe8a6870d98afc0337e
Jul 05 19:33:37.639654 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.639634    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nc6b\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-kube-api-access-9nc6b\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:37.639654 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.639653    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-certificates\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:37.639761 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.639663    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-image-registry-private-configuration\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:37.639761 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.639672    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-installation-pull-secrets\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:37.639761 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.639682    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-bound-sa-token\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:37.639761 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.639690    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-trusted-ca\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:37.740933 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.740907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:37.741049 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.740950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:37.743537 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.743508    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"image-registry-655b8b9ff8-pjjnq\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") " pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:37.743654 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.743569    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a358f46c-c182-4cdf-9ae1-5c268b271ceb-metrics-tls\") pod \"dns-default-2rs6n\" (UID: \"a358f46c-c182-4cdf-9ae1-5c268b271ceb\") " pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:37.780767 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.780745    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n6b4c\""
Jul 05 19:33:37.788160 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.788136    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:37.841466 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.841425    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") pod \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\" (UID: \"506ffe68-0464-4f2b-a81a-8f4c5947a4d6\") "
Jul 05 19:33:37.847326 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.847255    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "506ffe68-0464-4f2b-a81a-8f4c5947a4d6" (UID: "506ffe68-0464-4f2b-a81a-8f4c5947a4d6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:33:37.935285 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.935198    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2rs6n"]
Jul 05 19:33:37.939365 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:37.939336    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda358f46c_c182_4cdf_9ae1_5c268b271ceb.slice/crio-e78f5072142e94bade0969ce9f04dea06cce7b09c37207fc03278520a578a00a WatchSource:0}: Error finding container e78f5072142e94bade0969ce9f04dea06cce7b09c37207fc03278520a578a00a: Status 404 returned error can't find the container with id e78f5072142e94bade0969ce9f04dea06cce7b09c37207fc03278520a578a00a
Jul 05 19:33:37.942002 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:37.941969    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506ffe68-0464-4f2b-a81a-8f4c5947a4d6-registry-tls\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:33:38.408733 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:38.408700    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jb8c" event={"ID":"d6b0a84d-d3e5-4362-827b-8f15f3e69016","Type":"ContainerStarted","Data":"8d502321ec3e8d7ad43b8d242de32de39f3296e1532a4f3ac9b461fb5bdacfc0"}
Jul 05 19:33:38.410093 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:38.410062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rs6n" event={"ID":"a358f46c-c182-4cdf-9ae1-5c268b271ceb","Type":"ContainerStarted","Data":"e78f5072142e94bade0969ce9f04dea06cce7b09c37207fc03278520a578a00a"}
Jul 05 19:33:38.411943 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:38.411918    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-m5fr6" event={"ID":"5edd1742-a691-4994-b925-e5b5deadb370","Type":"ContainerStarted","Data":"c6a5a029633a34e52877d9370cc4c6bccccf3620f65acbe8a6870d98afc0337e"}
Jul 05 19:33:38.414801 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:38.413839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8grkm" event={"ID":"f11b3971-c796-40a6-9551-d1dc85239212","Type":"ContainerStarted","Data":"d2d1488829b38755dab3f32760fe3e7163e79bedcfd6338331849dd178bff6cb"}
Jul 05 19:33:38.414801 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:38.414142    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b8b9ff8-pjjnq"
Jul 05 19:33:38.455821 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:38.455790    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655b8b9ff8-pjjnq"]
Jul 05 19:33:38.462165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:38.462134    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-655b8b9ff8-pjjnq"]
Jul 05 19:33:39.122995 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:39.122959    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="506ffe68-0464-4f2b-a81a-8f4c5947a4d6" path="/var/lib/kubelet/pods/506ffe68-0464-4f2b-a81a-8f4c5947a4d6/volumes"
Jul 05 19:33:39.420519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:39.420420    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jb8c" event={"ID":"d6b0a84d-d3e5-4362-827b-8f15f3e69016","Type":"ContainerStarted","Data":"3525a6a68db28c79f0517d8e9e0187e3bf9126c7bd9c53638ff8cd26a75faaaa"}
Jul 05 19:33:39.436265 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:39.436216    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2jb8c" podStartSLOduration=67.493157777 podStartE2EDuration="1m8.436194677s" totalImagesPullingTime="943.0369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:39.435725892 +0000 UTC m=+68.830048575" watchObservedRunningTime="2026-07-05 19:33:39.436194677 +0000 UTC m=+68.830517360"
Jul 05 19:33:42.143772 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.143652    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"]
Jul 05 19:33:42.163133 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.163104    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"]
Jul 05 19:33:42.163294 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.163205    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"
Jul 05 19:33:42.166248 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.166224    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 05 19:33:42.166387 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.166227    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lrv5w\""
Jul 05 19:33:42.275189 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.275159    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4261d94-2c64-4bc0-bc87-4910d5b98f2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tjqt5\" (UID: \"c4261d94-2c64-4bc0-bc87-4910d5b98f2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"
Jul 05 19:33:42.376058 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.376024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4261d94-2c64-4bc0-bc87-4910d5b98f2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tjqt5\" (UID: \"c4261d94-2c64-4bc0-bc87-4910d5b98f2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"
Jul 05 19:33:42.379213 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.379182    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4261d94-2c64-4bc0-bc87-4910d5b98f2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tjqt5\" (UID: \"c4261d94-2c64-4bc0-bc87-4910d5b98f2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"
Jul 05 19:33:42.476030 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:42.475962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"
Jul 05 19:33:43.367110 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.366948    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"]
Jul 05 19:33:43.371541 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:43.371509    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4261d94_2c64_4bc0_bc87_4910d5b98f2f.slice/crio-2f72a8f1933ef8293a9f3e6669e37c2f9ae315f09f42dff63897360e02af5c14 WatchSource:0}: Error finding container 2f72a8f1933ef8293a9f3e6669e37c2f9ae315f09f42dff63897360e02af5c14: Status 404 returned error can't find the container with id 2f72a8f1933ef8293a9f3e6669e37c2f9ae315f09f42dff63897360e02af5c14
Jul 05 19:33:43.439734 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.439619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8s9h" event={"ID":"dae6d384-942c-4b69-9b6d-94474ea24af1","Type":"ContainerStarted","Data":"d61c4d68384f4b60ab2383251373e23845ecb87b9e3c543f54469229208fe43e"}
Jul 05 19:33:43.439734 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.439703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:33:43.441331 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.441300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rs6n" event={"ID":"a358f46c-c182-4cdf-9ae1-5c268b271ceb","Type":"ContainerStarted","Data":"7d28135347e9b9acef224602732fe0face4085c7318d95a1f0f3dfccea54c41b"}
Jul 05 19:33:43.442762 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.442721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8grkm" event={"ID":"f11b3971-c796-40a6-9551-d1dc85239212","Type":"ContainerStarted","Data":"37756e59397bebefb512b45b5b00791e34d40a84d765e7c31708e7f16c3b70fa"}
Jul 05 19:33:43.443999 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.443975    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5" event={"ID":"c4261d94-2c64-4bc0-bc87-4910d5b98f2f","Type":"ContainerStarted","Data":"2f72a8f1933ef8293a9f3e6669e37c2f9ae315f09f42dff63897360e02af5c14"}
Jul 05 19:33:43.459386 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.459290    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z8s9h" podStartSLOduration=66.582739955 podStartE2EDuration="1m12.459258692s" totalImagesPullingTime="5.876518737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:43.457906978 +0000 UTC m=+72.852229661" watchObservedRunningTime="2026-07-05 19:33:43.459258692 +0000 UTC m=+72.853581374"
Jul 05 19:33:43.476535 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:43.476233    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8grkm" podStartSLOduration=66.803444618 podStartE2EDuration="1m12.476214494s" totalImagesPullingTime="5.672769876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:43.475589189 +0000 UTC m=+72.869911870" watchObservedRunningTime="2026-07-05 19:33:43.476214494 +0000 UTC m=+72.870537175"
Jul 05 19:33:44.060861 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.060825    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-788498d867-z67cg"]
Jul 05 19:33:44.062812 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.062790    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.065676 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.065653    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 05 19:33:44.065676 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.065665    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 05 19:33:44.065676 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.065672    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 05 19:33:44.066986 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.066966    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 05 19:33:44.067094 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.067016    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l2czl\""
Jul 05 19:33:44.068256 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.067452    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 05 19:33:44.074065 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.074043    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788498d867-z67cg"]
Jul 05 19:33:44.190151 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.190120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-oauth-serving-cert\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.190317 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.190163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-config\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.190317 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.190192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-service-ca\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.190444 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.190317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cwsk\" (UniqueName: \"kubernetes.io/projected/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-kube-api-access-8cwsk\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.190444 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.190356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-oauth-config\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.190444 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.190389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-serving-cert\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.291006 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.290972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cwsk\" (UniqueName: \"kubernetes.io/projected/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-kube-api-access-8cwsk\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.291144 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.291014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-oauth-config\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.291209 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.291146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-serving-cert\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.291300 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.291210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-oauth-serving-cert\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.291300 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.291241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-config\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.291300 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.291285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-service-ca\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.292029 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.292002    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-config\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.292029 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.292013    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-oauth-serving-cert\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.292217 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.292194    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-service-ca\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.293811 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.293790    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-serving-cert\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.293925 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.293818    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-oauth-config\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.300467 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.300445    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cwsk\" (UniqueName: \"kubernetes.io/projected/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-kube-api-access-8cwsk\") pod \"console-788498d867-z67cg\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") " pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.375430 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.375405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:44.452922 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.452383    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2rs6n" event={"ID":"a358f46c-c182-4cdf-9ae1-5c268b271ceb","Type":"ContainerStarted","Data":"1110da1831a6af9a83eb344ebf6d3668fc2a78497feaa4553b333e794552e20a"}
Jul 05 19:33:44.452922 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.452794    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:44.479043 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.478858    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2rs6n" podStartSLOduration=34.215811569 podStartE2EDuration="39.478834495s" totalImagesPullingTime="5.263022926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:44.478735313 +0000 UTC m=+73.873057996" watchObservedRunningTime="2026-07-05 19:33:44.478834495 +0000 UTC m=+73.873157177"
Jul 05 19:33:44.525516 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:44.525487    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788498d867-z67cg"]
Jul 05 19:33:44.735768 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:44.735677    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275aec01_f3a5_45c2_92f7_c74d4eefc3f9.slice/crio-46d80db0b7913284934a516b19ff6511042aa72a73cb2660beedc4c0ec3799f8 WatchSource:0}: Error finding container 46d80db0b7913284934a516b19ff6511042aa72a73cb2660beedc4c0ec3799f8: Status 404 returned error can't find the container with id 46d80db0b7913284934a516b19ff6511042aa72a73cb2660beedc4c0ec3799f8
Jul 05 19:33:45.457841 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:45.457801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788498d867-z67cg" event={"ID":"275aec01-f3a5-45c2-92f7-c74d4eefc3f9","Type":"ContainerStarted","Data":"46d80db0b7913284934a516b19ff6511042aa72a73cb2660beedc4c0ec3799f8"}
Jul 05 19:33:45.459927 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:45.459899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5" event={"ID":"c4261d94-2c64-4bc0-bc87-4910d5b98f2f","Type":"ContainerStarted","Data":"7932b0339f92bf0c958869c41a51ff3f5b52e3d61b1d91d1d56c3d0668e4dc0b"}
Jul 05 19:33:45.460296 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:45.460246    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"
Jul 05 19:33:45.465767 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:45.465744    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5"
Jul 05 19:33:45.476393 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:45.476344    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tjqt5" podStartSLOduration=2.090947484 podStartE2EDuration="3.476329066s" totalImagesPullingTime="1.385381582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:45.475459699 +0000 UTC m=+74.869782384" watchObservedRunningTime="2026-07-05 19:33:45.476329066 +0000 UTC m=+74.870651741"
Jul 05 19:33:46.210480 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.210444    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"]
Jul 05 19:33:46.212646 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.212624    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.216482 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.216455    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 05 19:33:46.216482 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.216464    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 05 19:33:46.217710 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.217691    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 05 19:33:46.218404 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.217938    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 05 19:33:46.218404 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.217943    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 05 19:33:46.218404 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.218221    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x2l8t\""
Jul 05 19:33:46.229061 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.229039    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"]
Jul 05 19:33:46.244453 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.244428    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5566975d74-5vtqm"]
Jul 05 19:33:46.246986 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.246961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.256593 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.256542    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 05 19:33:46.259687 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.259626    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5566975d74-5vtqm"]
Jul 05 19:33:46.309881 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.309845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.310062 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.309898    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.310062 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.309918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.310062 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.309945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqpzm\" (UniqueName: \"kubernetes.io/projected/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-kube-api-access-lqpzm\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.411319 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.411483 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.411483 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-trusted-ca-bundle\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.411483 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqpzm\" (UniqueName: \"kubernetes.io/projected/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-kube-api-access-lqpzm\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.411483 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:46.411426    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 05 19:33:46.411483 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mkk8\" (UniqueName: \"kubernetes.io/projected/9f103e4a-2e30-4fd8-a10a-d024059db7af-kube-api-access-5mkk8\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.411696 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:46.411503    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-tls podName:e790ae71-1bba-46cf-afd4-bbc0f54ea7ef nodeName:}" failed. No retries permitted until 2026-07-05 19:33:46.911486243 +0000 UTC m=+76.305808906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-2bnv7" (UID: "e790ae71-1bba-46cf-afd4-bbc0f54ea7ef") : secret "prometheus-operator-tls" not found
Jul 05 19:33:46.411696 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.411696 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411640    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-oauth-serving-cert\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.411946 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-config\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.411946 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-serving-cert\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.411946 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-service-ca\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.411946 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.411895    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-oauth-config\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.412220 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.412198    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.415168 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.415143    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.423958 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.423915    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqpzm\" (UniqueName: \"kubernetes.io/projected/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-kube-api-access-lqpzm\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.512548 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.512434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-oauth-config\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.512940 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.512567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-trusted-ca-bundle\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.512940 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.512671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mkk8\" (UniqueName: \"kubernetes.io/projected/9f103e4a-2e30-4fd8-a10a-d024059db7af-kube-api-access-5mkk8\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.512940 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.512705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-oauth-serving-cert\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.512940 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.512741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-config\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.512940 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.512768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-serving-cert\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.512940 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.512820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-service-ca\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.513607 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.513572    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-trusted-ca-bundle\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.513737 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.513625    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-service-ca\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.514349 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.514196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-config\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.514349 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.514301    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-oauth-serving-cert\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.515426 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.515403    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-oauth-config\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.516763 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.516740    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-serving-cert\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.531533 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.531506    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mkk8\" (UniqueName: \"kubernetes.io/projected/9f103e4a-2e30-4fd8-a10a-d024059db7af-kube-api-access-5mkk8\") pod \"console-5566975d74-5vtqm\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") " pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.559491 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.559458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:46.917237 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.917190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:46.920004 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:46.919976    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e790ae71-1bba-46cf-afd4-bbc0f54ea7ef-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-2bnv7\" (UID: \"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:47.124574 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:47.124541    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"
Jul 05 19:33:47.859163 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:47.858901    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5566975d74-5vtqm"]
Jul 05 19:33:47.867311 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:47.867281    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f103e4a_2e30_4fd8_a10a_d024059db7af.slice/crio-61ebe3dff1199c4e60107eab874076387f1d7cb1887cf832ead649af17827d5a WatchSource:0}: Error finding container 61ebe3dff1199c4e60107eab874076387f1d7cb1887cf832ead649af17827d5a: Status 404 returned error can't find the container with id 61ebe3dff1199c4e60107eab874076387f1d7cb1887cf832ead649af17827d5a
Jul 05 19:33:47.874412 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:47.874089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7"]
Jul 05 19:33:47.876249 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:47.876217    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode790ae71_1bba_46cf_afd4_bbc0f54ea7ef.slice/crio-53c4c967024098d7de8a24e03ba04ac3f61c88fe078563bd771365ef8a603995 WatchSource:0}: Error finding container 53c4c967024098d7de8a24e03ba04ac3f61c88fe078563bd771365ef8a603995: Status 404 returned error can't find the container with id 53c4c967024098d7de8a24e03ba04ac3f61c88fe078563bd771365ef8a603995
Jul 05 19:33:48.477068 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:48.477019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788498d867-z67cg" event={"ID":"275aec01-f3a5-45c2-92f7-c74d4eefc3f9","Type":"ContainerStarted","Data":"ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69"}
Jul 05 19:33:48.478617 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:48.478532    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7" event={"ID":"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef","Type":"ContainerStarted","Data":"53c4c967024098d7de8a24e03ba04ac3f61c88fe078563bd771365ef8a603995"}
Jul 05 19:33:48.480343 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:48.480321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5566975d74-5vtqm" event={"ID":"9f103e4a-2e30-4fd8-a10a-d024059db7af","Type":"ContainerStarted","Data":"ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f"}
Jul 05 19:33:48.480435 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:48.480360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5566975d74-5vtqm" event={"ID":"9f103e4a-2e30-4fd8-a10a-d024059db7af","Type":"ContainerStarted","Data":"61ebe3dff1199c4e60107eab874076387f1d7cb1887cf832ead649af17827d5a"}
Jul 05 19:33:48.498516 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:48.498466    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-788498d867-z67cg" podStartSLOduration=1.496962229 podStartE2EDuration="4.498447736s" totalImagesPullingTime="3.001485507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:48.498113213 +0000 UTC m=+77.892435893" watchObservedRunningTime="2026-07-05 19:33:48.498447736 +0000 UTC m=+77.892770418"
Jul 05 19:33:48.526704 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:48.526659    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5566975d74-5vtqm" podStartSLOduration=2.526640999 podStartE2EDuration="2.526640999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:48.525916925 +0000 UTC m=+77.920239608" watchObservedRunningTime="2026-07-05 19:33:48.526640999 +0000 UTC m=+77.920963681"
Jul 05 19:33:49.487076 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:49.486978    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7" event={"ID":"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef","Type":"ContainerStarted","Data":"710878a3311181744408a6b2897f6440df5dcd7f89d9fc570558ff91299df226"}
Jul 05 19:33:49.487076 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:49.487058    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7" event={"ID":"e790ae71-1bba-46cf-afd4-bbc0f54ea7ef","Type":"ContainerStarted","Data":"b5e7952e16fd5f04c88fbf5ebc7cc2cacdb96fdf4ca26cd2e18793c02391fda4"}
Jul 05 19:33:49.505008 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:49.504964    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-2bnv7" podStartSLOduration=2.206346141 podStartE2EDuration="3.504948779s" totalImagesPullingTime="1.298602638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:49.503812224 +0000 UTC m=+78.898134905" watchObservedRunningTime="2026-07-05 19:33:49.504948779 +0000 UTC m=+78.899271479"
Jul 05 19:33:51.587183 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.587141    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"]
Jul 05 19:33:51.590449 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.590427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.593499 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.593469    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 05 19:33:51.594804 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.594780    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4wws8\""
Jul 05 19:33:51.594935 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.594780    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 05 19:33:51.594935 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.594832    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 05 19:33:51.606861 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.606823    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"]
Jul 05 19:33:51.610230 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.610200    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g6m8j"]
Jul 05 19:33:51.613684 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.613658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.617110 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.617085    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 05 19:33:51.617546 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.617524    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 05 19:33:51.617707 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.617637    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 05 19:33:51.617819 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.617802    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-frhf9\""
Jul 05 19:33:51.757419 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-textfile\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757419 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-tls\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-wtmp\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757474    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.757610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmcx\" (UniqueName: \"kubernetes.io/projected/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-api-access-fjmcx\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.757610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-sys\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ecb63b-9600-48cd-b48a-f495c05d0306-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57d26\" (UniqueName: \"kubernetes.io/projected/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-kube-api-access-57d26\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-metrics-client-ca\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-root\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.757815 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.757809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81ecb63b-9600-48cd-b48a-f495c05d0306-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.858316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57d26\" (UniqueName: \"kubernetes.io/projected/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-kube-api-access-57d26\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858334    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-metrics-client-ca\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-root\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81ecb63b-9600-48cd-b48a-f495c05d0306-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-textfile\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-tls\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-wtmp\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmcx\" (UniqueName: \"kubernetes.io/projected/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-api-access-fjmcx\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.858643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-sys\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.859176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ecb63b-9600-48cd-b48a-f495c05d0306-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.859176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.858818    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-root\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.859176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.859066    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-metrics-client-ca\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.859406 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.859383    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/81ecb63b-9600-48cd-b48a-f495c05d0306-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.859553 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.859532    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-wtmp\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.859797 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.859776    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-textfile\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.859895 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.859829    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81ecb63b-9600-48cd-b48a-f495c05d0306-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.860154 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.860023    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.860154 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.860102    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-sys\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.860345 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.860247    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.861540 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.861495    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-tls\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.861540 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.861513    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.862004 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.861980    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.862583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.862564    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.868144 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.868120    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57d26\" (UniqueName: \"kubernetes.io/projected/93f37666-78e9-48ad-bf0c-17dfc8ecde1a-kube-api-access-57d26\") pod \"node-exporter-g6m8j\" (UID: \"93f37666-78e9-48ad-bf0c-17dfc8ecde1a\") " pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:51.869386 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.869362    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmcx\" (UniqueName: \"kubernetes.io/projected/81ecb63b-9600-48cd-b48a-f495c05d0306-kube-api-access-fjmcx\") pod \"kube-state-metrics-7c9dbb8b7d-755k4\" (UID: \"81ecb63b-9600-48cd-b48a-f495c05d0306\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.902338 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.902291    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"
Jul 05 19:33:51.925717 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:51.925682    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g6m8j"
Jul 05 19:33:52.624629 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.624594    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:33:52.630223 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.630191    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.633252 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633229    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 05 19:33:52.633483 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633463    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 05 19:33:52.633538 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633490    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7wtbx\""
Jul 05 19:33:52.633538 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633492    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 05 19:33:52.633631 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633537    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 05 19:33:52.633631 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633494    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 05 19:33:52.633700 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633691    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 05 19:33:52.633795 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633741    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 05 19:33:52.633795 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.633743    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 05 19:33:52.634363 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.634342    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 05 19:33:52.642632 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.642610    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:33:52.767129 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-web-config\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767323 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767323 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767164    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767323 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767323 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767248    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767323 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-config-volume\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-config-out\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkmzh\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-kube-api-access-vkmzh\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767478    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.767597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.767534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-tls-assets\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868123 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-config-out\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868336 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868336 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868336 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkmzh\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-kube-api-access-vkmzh\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868520 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868574 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868631 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-tls-assets\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868631 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-web-config\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868730 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868730 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868730 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868878 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868878 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868772    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-config-volume\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.868970 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.868897    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.869550 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.869521    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.869673 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.869629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.873007 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.872984    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.874015 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.873993    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-config-volume\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.874101 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.873995    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-tls-assets\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.874610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.874590    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-config-out\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.874773 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.874668    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.874912 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.874684    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-web-config\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.874967 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.874834    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.875261 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.875236    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.876139 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.876114    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.877639 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.877542    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkmzh\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-kube-api-access-vkmzh\") pod \"alertmanager-main-0\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:52.943764 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:52.943732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:33:54.375828 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:54.375790    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:54.376287 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:54.375880    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:54.380960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:54.380938    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:54.462349 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:54.462322    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2rs6n"
Jul 05 19:33:54.511796 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:54.511766    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:33:55.874111 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:55.874072    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5ccd476c58-48qqh"]
Jul 05 19:33:55.996208 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:55.996177    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ccd476c58-48qqh"]
Jul 05 19:33:55.996420 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:55.996336    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.001158 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.001128    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-46p1jlvt4g13r\""
Jul 05 19:33:56.001319 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.001260    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 05 19:33:56.001319 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.001309    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-j962x\""
Jul 05 19:33:56.001447 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.001334    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 05 19:33:56.001447 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.001414    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 05 19:33:56.001565 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.001550    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 05 19:33:56.097467 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.097427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-secret-metrics-server-tls\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.097652 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.097492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-secret-metrics-server-client-certs\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.097652 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.097531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-client-ca-bundle\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.097652 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.097563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/641c3511-6cef-49f5-9545-59fbb0b7b6d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.097652 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.097639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/641c3511-6cef-49f5-9545-59fbb0b7b6d9-metrics-server-audit-profiles\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.097867 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.097719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/641c3511-6cef-49f5-9545-59fbb0b7b6d9-audit-log\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.097867 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.097780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trcr\" (UniqueName: \"kubernetes.io/projected/641c3511-6cef-49f5-9545-59fbb0b7b6d9-kube-api-access-9trcr\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.198485 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.198402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-secret-metrics-server-client-certs\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.198485 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.198448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-client-ca-bundle\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.198485 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.198472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/641c3511-6cef-49f5-9545-59fbb0b7b6d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.198761 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.198643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/641c3511-6cef-49f5-9545-59fbb0b7b6d9-metrics-server-audit-profiles\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.198761 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.198697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/641c3511-6cef-49f5-9545-59fbb0b7b6d9-audit-log\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.198761 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.198731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trcr\" (UniqueName: \"kubernetes.io/projected/641c3511-6cef-49f5-9545-59fbb0b7b6d9-kube-api-access-9trcr\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.198902 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.198792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-secret-metrics-server-tls\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.199531 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.199463    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/641c3511-6cef-49f5-9545-59fbb0b7b6d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.199643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.199573    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/641c3511-6cef-49f5-9545-59fbb0b7b6d9-audit-log\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.199811 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.199765    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/641c3511-6cef-49f5-9545-59fbb0b7b6d9-metrics-server-audit-profiles\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.201317 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.201292    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-client-ca-bundle\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.201490 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.201466    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-secret-metrics-server-tls\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.201579 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.201527    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/641c3511-6cef-49f5-9545-59fbb0b7b6d9-secret-metrics-server-client-certs\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.207673 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.207612    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trcr\" (UniqueName: \"kubernetes.io/projected/641c3511-6cef-49f5-9545-59fbb0b7b6d9-kube-api-access-9trcr\") pod \"metrics-server-5ccd476c58-48qqh\" (UID: \"641c3511-6cef-49f5-9545-59fbb0b7b6d9\") " pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.308484 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.308449    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:33:56.380537 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.380506    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"]
Jul 05 19:33:56.392152 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.391586    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:56.393465 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.393431    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"]
Jul 05 19:33:56.395287 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.395121    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 05 19:33:56.395287 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.395180    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kzjw2\""
Jul 05 19:33:56.500658 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.500569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rphsd\" (UID: \"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:56.500658 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.500649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcrp8\" (UniqueName: \"kubernetes.io/projected/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-kube-api-access-jcrp8\") pod \"monitoring-plugin-d5dcff7cf-rphsd\" (UID: \"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:56.559630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.559590    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:56.559813 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.559659    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:56.566333 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.565649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:56.601472 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.601445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rphsd\" (UID: \"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:56.601622 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.601499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcrp8\" (UniqueName: \"kubernetes.io/projected/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-kube-api-access-jcrp8\") pod \"monitoring-plugin-d5dcff7cf-rphsd\" (UID: \"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:56.601622 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:56.601588    2583 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 05 19:33:56.601701 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:33:56.601645    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-monitoring-plugin-cert podName:36c30296-cbc4-4ef6-a70d-3a6bebe93dc8 nodeName:}" failed. No retries permitted until 2026-07-05 19:33:57.101629694 +0000 UTC m=+86.495952353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-rphsd" (UID: "36c30296-cbc4-4ef6-a70d-3a6bebe93dc8") : secret "monitoring-plugin-cert" not found
Jul 05 19:33:56.612424 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.612396    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcrp8\" (UniqueName: \"kubernetes.io/projected/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-kube-api-access-jcrp8\") pod \"monitoring-plugin-d5dcff7cf-rphsd\" (UID: \"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:56.648915 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:56.648883    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f37666_78e9_48ad_bf0c_17dfc8ecde1a.slice/crio-bec63213ff11d391209d9b4251c5615344cb1259d6b2c26f11a3ee4607acd15c WatchSource:0}: Error finding container bec63213ff11d391209d9b4251c5615344cb1259d6b2c26f11a3ee4607acd15c: Status 404 returned error can't find the container with id bec63213ff11d391209d9b4251c5615344cb1259d6b2c26f11a3ee4607acd15c
Jul 05 19:33:56.798218 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.798186    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:33:56.803447 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.803421    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4"]
Jul 05 19:33:56.822818 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:56.822799    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ccd476c58-48qqh"]
Jul 05 19:33:56.934787 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:56.934736    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947606f4_cce6_4bee_8545_27e4356dc380.slice/crio-7dda329694a8c00c69d045da57d09d8ad95f26dc85f24e404357762d50cd8950 WatchSource:0}: Error finding container 7dda329694a8c00c69d045da57d09d8ad95f26dc85f24e404357762d50cd8950: Status 404 returned error can't find the container with id 7dda329694a8c00c69d045da57d09d8ad95f26dc85f24e404357762d50cd8950
Jul 05 19:33:56.935249 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:56.935223    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ecb63b_9600_48cd_b48a_f495c05d0306.slice/crio-9ef994be4d56be496d323aa1e81602d36da05cfad7fbf62b6721aa8efca80587 WatchSource:0}: Error finding container 9ef994be4d56be496d323aa1e81602d36da05cfad7fbf62b6721aa8efca80587: Status 404 returned error can't find the container with id 9ef994be4d56be496d323aa1e81602d36da05cfad7fbf62b6721aa8efca80587
Jul 05 19:33:56.936245 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:56.936221    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod641c3511_6cef_49f5_9545_59fbb0b7b6d9.slice/crio-76cc68dad6f70f7dec52cb18bef3f7c2586c42b7b07ad23b398d7652ba23c7d3 WatchSource:0}: Error finding container 76cc68dad6f70f7dec52cb18bef3f7c2586c42b7b07ad23b398d7652ba23c7d3: Status 404 returned error can't find the container with id 76cc68dad6f70f7dec52cb18bef3f7c2586c42b7b07ad23b398d7652ba23c7d3
Jul 05 19:33:57.107288 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.107153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rphsd\" (UID: \"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:57.109999 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.109977    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/36c30296-cbc4-4ef6-a70d-3a6bebe93dc8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-rphsd\" (UID: \"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:57.304283 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.304200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:33:57.467844 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.467793    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"]
Jul 05 19:33:57.521202 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.521156    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4" event={"ID":"81ecb63b-9600-48cd-b48a-f495c05d0306","Type":"ContainerStarted","Data":"9ef994be4d56be496d323aa1e81602d36da05cfad7fbf62b6721aa8efca80587"}
Jul 05 19:33:57.522940 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.522878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh" event={"ID":"641c3511-6cef-49f5-9545-59fbb0b7b6d9","Type":"ContainerStarted","Data":"76cc68dad6f70f7dec52cb18bef3f7c2586c42b7b07ad23b398d7652ba23c7d3"}
Jul 05 19:33:57.524618 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.524509    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerStarted","Data":"7dda329694a8c00c69d045da57d09d8ad95f26dc85f24e404357762d50cd8950"}
Jul 05 19:33:57.529206 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.526536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-m5fr6" event={"ID":"5edd1742-a691-4994-b925-e5b5deadb370","Type":"ContainerStarted","Data":"b3c506462f6b30c98d4825a13d170c51d0cc38a1dbed49a2d5ea332150e3ff7c"}
Jul 05 19:33:57.529206 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.527684    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-m5fr6"
Jul 05 19:33:57.530297 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.530249    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g6m8j" event={"ID":"93f37666-78e9-48ad-bf0c-17dfc8ecde1a","Type":"ContainerStarted","Data":"bec63213ff11d391209d9b4251c5615344cb1259d6b2c26f11a3ee4607acd15c"}
Jul 05 19:33:57.534950 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.534929    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:33:57.540470 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.540426    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-m5fr6"
Jul 05 19:33:57.572913 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.572337    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-m5fr6" podStartSLOduration=2.139106174 podStartE2EDuration="21.572316941s" totalImagesPullingTime="19.433210767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:57.549140646 +0000 UTC m=+86.943463317" watchObservedRunningTime="2026-07-05 19:33:57.572316941 +0000 UTC m=+86.966639637"
Jul 05 19:33:57.644545 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.644026    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788498d867-z67cg"]
Jul 05 19:33:57.729810 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:57.729765    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c30296_cbc4_4ef6_a70d_3a6bebe93dc8.slice/crio-a29f2264029728e0952e74a55d4ccd62ee394041b4284360cb4d6347c7bd3006 WatchSource:0}: Error finding container a29f2264029728e0952e74a55d4ccd62ee394041b4284360cb4d6347c7bd3006: Status 404 returned error can't find the container with id a29f2264029728e0952e74a55d4ccd62ee394041b4284360cb4d6347c7bd3006
Jul 05 19:33:57.961470 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.961434    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:33:57.983240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.983206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.987079    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.987410    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.987917    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.988128    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.988190    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.988327    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.988443    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.988521    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dvt8k\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.988631    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 05 19:33:57.989083 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.988739    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ei59k6rbkrgrg\""
Jul 05 19:33:57.989855 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.989145    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 05 19:33:57.989855 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.989191    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 05 19:33:57.989855 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.989387    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 05 19:33:57.989855 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.989782    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 05 19:33:57.991043 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.991019    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 05 19:33:57.997707 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.997600    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:33:57.999523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:57.999502    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 05 19:33:58.115344 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115444 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115506 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-config-out\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115558 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115558 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115660 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115568    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115660 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115660 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115629    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115660 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115844 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115685    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115844 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115723    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115844 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115844 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-config\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.115844 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.116079 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.116079 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115968    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-web-config\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.116079 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.115997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s22qz\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-kube-api-access-s22qz\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.116215 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.116092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.116215 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.116125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.116215 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.116165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.218984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-config\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-web-config\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s22qz\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-kube-api-access-s22qz\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-config-out\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.221519 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.222529 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.222529 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.222529 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.219663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.226053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.223070    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.226053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.223510    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.226053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.223652    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.226053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.224482    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.226053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.225109    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.226053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.225778    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.227448 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.227070    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-web-config\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.228458 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.227813    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.228893 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.228848    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.228983 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.228969    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-config\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.229036 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.228991    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.230784 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.229318    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-config-out\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.230784 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.229819    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.230784 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.230037    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.232835 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.232220    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.233037 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.232959    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.233037 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.232969    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.233349 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.233195    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.235720 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.235671    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s22qz\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-kube-api-access-s22qz\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.236148 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.236123    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.300713 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.298616    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:33:58.540345 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.539768    2583 generic.go:356] "Generic (PLEG): container finished" podID="93f37666-78e9-48ad-bf0c-17dfc8ecde1a" containerID="7410f710ffec0dafe3e92882db016eff910957d6a319a1732109740b41ddfa7c" exitCode=0
Jul 05 19:33:58.540345 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.539862    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g6m8j" event={"ID":"93f37666-78e9-48ad-bf0c-17dfc8ecde1a","Type":"ContainerDied","Data":"7410f710ffec0dafe3e92882db016eff910957d6a319a1732109740b41ddfa7c"}
Jul 05 19:33:58.543147 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.543110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd" event={"ID":"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8","Type":"ContainerStarted","Data":"a29f2264029728e0952e74a55d4ccd62ee394041b4284360cb4d6347c7bd3006"}
Jul 05 19:33:58.553757 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:58.553601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:33:58.558730 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:33:58.558638    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26b606b_ee78_4bd0_a278_6de55d13b549.slice/crio-9aa7262a99f1b6b191d23a9dfa1835f56c651796b684e1607d246f75c4564ec7 WatchSource:0}: Error finding container 9aa7262a99f1b6b191d23a9dfa1835f56c651796b684e1607d246f75c4564ec7: Status 404 returned error can't find the container with id 9aa7262a99f1b6b191d23a9dfa1835f56c651796b684e1607d246f75c4564ec7
Jul 05 19:33:59.553206 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:59.553115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g6m8j" event={"ID":"93f37666-78e9-48ad-bf0c-17dfc8ecde1a","Type":"ContainerStarted","Data":"d0e9a306cec1217b3d0d451f5be5bf281ea469ff48308745e0f13daf939e261a"}
Jul 05 19:33:59.553206 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:59.553189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g6m8j" event={"ID":"93f37666-78e9-48ad-bf0c-17dfc8ecde1a","Type":"ContainerStarted","Data":"1ae2f79203896b67906d458b14a4ffe0672f42a7327d46d00ad5275d30c34824"}
Jul 05 19:33:59.556890 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:59.556854    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerStarted","Data":"9aa7262a99f1b6b191d23a9dfa1835f56c651796b684e1607d246f75c4564ec7"}
Jul 05 19:33:59.600902 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:33:59.600836    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g6m8j" podStartSLOduration=6.997062546 podStartE2EDuration="8.60081369s" totalImagesPullingTime="1.428307767s" totalInitContainerRuntime="175.443377ms" isStatefulPod=true podCreationTimestamp="2026-07-05 19:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:33:59.599152006 +0000 UTC m=+88.993474678" watchObservedRunningTime="2026-07-05 19:33:59.60081369 +0000 UTC m=+88.995136369"
Jul 05 19:34:02.572185 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.572101    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4" event={"ID":"81ecb63b-9600-48cd-b48a-f495c05d0306","Type":"ContainerStarted","Data":"747b952661d7afe24f4c4988434859ce00c275e2f109f1c6c02385682213ac33"}
Jul 05 19:34:02.572756 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.572222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4" event={"ID":"81ecb63b-9600-48cd-b48a-f495c05d0306","Type":"ContainerStarted","Data":"0caae58dd9b68f14c88ab34351d72ace6ac66cc6306e342240d75e7c9c18ac54"}
Jul 05 19:34:02.574065 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.573946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd" event={"ID":"36c30296-cbc4-4ef6-a70d-3a6bebe93dc8","Type":"ContainerStarted","Data":"72c3fd9406cc891d5eea89730c5d83f11b3d031f00e95462fe17b088f16038ba"}
Jul 05 19:34:02.575451 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.575379    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:34:02.580856 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.578646    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a" exitCode=0
Jul 05 19:34:02.580856 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.578774    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"}
Jul 05 19:34:02.584310 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.584189    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd"
Jul 05 19:34:02.586284 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.586204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh" event={"ID":"641c3511-6cef-49f5-9545-59fbb0b7b6d9","Type":"ContainerStarted","Data":"d03f81181862a99c782084ed07a17a92059388029fcd6058ce2bad6b310f14b7"}
Jul 05 19:34:02.589880 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.588926    2583 generic.go:356] "Generic (PLEG): container finished" podID="947606f4-cce6-4bee-8545-27e4356dc380" containerID="165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168" exitCode=0
Jul 05 19:34:02.589880 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.588971    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168"}
Jul 05 19:34:02.593305 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:02.592770    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-rphsd" podStartSLOduration=2.14418827 podStartE2EDuration="6.592721127s" totalImagesPullingTime="4.448532857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:34:02.592356916 +0000 UTC m=+91.986679598" watchObservedRunningTime="2026-07-05 19:34:02.592721127 +0000 UTC m=+91.987043798"
Jul 05 19:34:03.605912 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:03.605866    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4" event={"ID":"81ecb63b-9600-48cd-b48a-f495c05d0306","Type":"ContainerStarted","Data":"cecd00de51133fe8b05fb0e9520489297879808ba17af06984887150f08d8d45"}
Jul 05 19:34:03.628006 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:03.627694    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh" podStartSLOduration=3.412073892 podStartE2EDuration="8.627677421s" totalImagesPullingTime="5.215603529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:34:02.686714569 +0000 UTC m=+92.081037250" watchObservedRunningTime="2026-07-05 19:34:03.627677421 +0000 UTC m=+93.022000161"
Jul 05 19:34:06.622191 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:06.622151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerStarted","Data":"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"}
Jul 05 19:34:07.630178 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:07.630137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerStarted","Data":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"}
Jul 05 19:34:07.630915 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:07.630289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerStarted","Data":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"}
Jul 05 19:34:07.634370 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:07.634296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerStarted","Data":"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"}
Jul 05 19:34:07.634521 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:07.634424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerStarted","Data":"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"}
Jul 05 19:34:07.634572 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:07.634516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerStarted","Data":"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"}
Jul 05 19:34:07.634619 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:07.634598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerStarted","Data":"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"}
Jul 05 19:34:09.646364 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:09.646319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerStarted","Data":"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"}
Jul 05 19:34:09.678512 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:09.678444    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.325949556 podStartE2EDuration="17.678416967s" totalImagesPullingTime="9.326598369s" totalInitContainerRuntime="25.869042ms" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:34:09.67579405 +0000 UTC m=+99.070116733" watchObservedRunningTime="2026-07-05 19:34:09.678416967 +0000 UTC m=+99.072739649"
Jul 05 19:34:09.679020 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:09.678985    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-755k4" podStartSLOduration=13.461110824 podStartE2EDuration="18.678973518s" totalImagesPullingTime="5.217862694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:34:03.62946495 +0000 UTC m=+93.023787632" watchObservedRunningTime="2026-07-05 19:34:09.678973518 +0000 UTC m=+99.073296199"
Jul 05 19:34:10.653402 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:10.653366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerStarted","Data":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"}
Jul 05 19:34:10.653798 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:10.653439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerStarted","Data":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"}
Jul 05 19:34:10.653798 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:10.653466    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerStarted","Data":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"}
Jul 05 19:34:10.653798 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:10.653490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerStarted","Data":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"}
Jul 05 19:34:10.686258 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:10.686197    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.996944164 podStartE2EDuration="13.686175558s" totalImagesPullingTime="10.662912995s" totalInitContainerRuntime="26.318399ms" isStatefulPod=false podCreationTimestamp="2026-07-05 19:33:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:34:10.684504622 +0000 UTC m=+100.078827305" watchObservedRunningTime="2026-07-05 19:34:10.686175558 +0000 UTC m=+100.080498240"
Jul 05 19:34:13.299400 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:13.299362    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:34:13.326867 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:13.326839    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5566975d74-5vtqm"]
Jul 05 19:34:14.455184 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:14.455153    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z8s9h"
Jul 05 19:34:16.309179 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:16.309147    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:34:16.309769 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:16.309211    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:34:22.682826 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:22.682760    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-788498d867-z67cg" podUID="275aec01-f3a5-45c2-92f7-c74d4eefc3f9" containerName="console" containerID="cri-o://ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69" gracePeriod=15
Jul 05 19:34:22.943567 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:22.943503    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:34:23.081540 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081512    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-oauth-config\") pod \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") "
Jul 05 19:34:23.081663 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-service-ca\") pod \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") "
Jul 05 19:34:23.081663 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081610    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cwsk\" (UniqueName: \"kubernetes.io/projected/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-kube-api-access-8cwsk\") pod \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") "
Jul 05 19:34:23.081663 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081643    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-serving-cert\") pod \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") "
Jul 05 19:34:23.081830 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081677    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-oauth-serving-cert\") pod \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") "
Jul 05 19:34:23.081830 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081699    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-config\") pod \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\" (UID: \"275aec01-f3a5-45c2-92f7-c74d4eefc3f9\") "
Jul 05 19:34:23.082026 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081986    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "275aec01-f3a5-45c2-92f7-c74d4eefc3f9" (UID: "275aec01-f3a5-45c2-92f7-c74d4eefc3f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:34:23.082153 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.081994    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "275aec01-f3a5-45c2-92f7-c74d4eefc3f9" (UID: "275aec01-f3a5-45c2-92f7-c74d4eefc3f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:34:23.082153 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.082085    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-config" (OuterVolumeSpecName: "console-config") pod "275aec01-f3a5-45c2-92f7-c74d4eefc3f9" (UID: "275aec01-f3a5-45c2-92f7-c74d4eefc3f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:34:23.083803 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.083776    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-kube-api-access-8cwsk" (OuterVolumeSpecName: "kube-api-access-8cwsk") pod "275aec01-f3a5-45c2-92f7-c74d4eefc3f9" (UID: "275aec01-f3a5-45c2-92f7-c74d4eefc3f9"). InnerVolumeSpecName "kube-api-access-8cwsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:34:23.083893 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.083804    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "275aec01-f3a5-45c2-92f7-c74d4eefc3f9" (UID: "275aec01-f3a5-45c2-92f7-c74d4eefc3f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:34:23.083893 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.083828    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "275aec01-f3a5-45c2-92f7-c74d4eefc3f9" (UID: "275aec01-f3a5-45c2-92f7-c74d4eefc3f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:34:23.182384 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.182353    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-service-ca\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:23.182384 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.182382    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cwsk\" (UniqueName: \"kubernetes.io/projected/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-kube-api-access-8cwsk\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:23.182523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.182393    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-serving-cert\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:23.182523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.182402    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-oauth-serving-cert\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:23.182523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.182410    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:23.182523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.182418    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/275aec01-f3a5-45c2-92f7-c74d4eefc3f9-console-oauth-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:23.704686 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.704645    2583 generic.go:356] "Generic (PLEG): container finished" podID="275aec01-f3a5-45c2-92f7-c74d4eefc3f9" containerID="ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69" exitCode=0
Jul 05 19:34:23.705108 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.704722    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788498d867-z67cg"
Jul 05 19:34:23.705108 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.704727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788498d867-z67cg" event={"ID":"275aec01-f3a5-45c2-92f7-c74d4eefc3f9","Type":"ContainerDied","Data":"ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69"}
Jul 05 19:34:23.705108 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.704781    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788498d867-z67cg" event={"ID":"275aec01-f3a5-45c2-92f7-c74d4eefc3f9","Type":"ContainerDied","Data":"46d80db0b7913284934a516b19ff6511042aa72a73cb2660beedc4c0ec3799f8"}
Jul 05 19:34:23.717807 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.713896    2583 scope.go:117] "RemoveContainer" containerID="ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69"
Jul 05 19:34:23.729321 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.729255    2583 scope.go:117] "RemoveContainer" containerID="ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69"
Jul 05 19:34:23.729664 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:34:23.729640    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69\": container with ID starting with ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69 not found: ID does not exist" containerID="ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69"
Jul 05 19:34:23.729744 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.729687    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69"} err="failed to get container status \"ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69\": rpc error: code = NotFound desc = could not find container \"ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69\": container with ID starting with ef4fe2c150e5f2abe17a285684b13cc4f0dc24cd5c5ad277a57d5e1126138c69 not found: ID does not exist"
Jul 05 19:34:23.729985 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.729967    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788498d867-z67cg"]
Jul 05 19:34:23.733138 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:23.733102    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-788498d867-z67cg"]
Jul 05 19:34:24.294496 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:24.294466    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bdzgz_ef0a5fca-63b0-4081-9f0f-0f76a9960f93/serve-healthcheck-canary/0.log"
Jul 05 19:34:25.122517 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:25.122481    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275aec01-f3a5-45c2-92f7-c74d4eefc3f9" path="/var/lib/kubelet/pods/275aec01-f3a5-45c2-92f7-c74d4eefc3f9/volumes"
Jul 05 19:34:36.315117 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:36.315081    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:34:36.319198 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:36.319170    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5ccd476c58-48qqh"
Jul 05 19:34:38.347396 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.347340    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5566975d74-5vtqm" podUID="9f103e4a-2e30-4fd8-a10a-d024059db7af" containerName="console" containerID="cri-o://ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f" gracePeriod=15
Jul 05 19:34:38.620888 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.620869    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:34:38.721004 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.720967    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-trusted-ca-bundle\") pod \"9f103e4a-2e30-4fd8-a10a-d024059db7af\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") "
Jul 05 19:34:38.721152 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721017    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-service-ca\") pod \"9f103e4a-2e30-4fd8-a10a-d024059db7af\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") "
Jul 05 19:34:38.721152 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721042    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mkk8\" (UniqueName: \"kubernetes.io/projected/9f103e4a-2e30-4fd8-a10a-d024059db7af-kube-api-access-5mkk8\") pod \"9f103e4a-2e30-4fd8-a10a-d024059db7af\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") "
Jul 05 19:34:38.721152 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721082    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-oauth-config\") pod \"9f103e4a-2e30-4fd8-a10a-d024059db7af\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") "
Jul 05 19:34:38.721152 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721137    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-oauth-serving-cert\") pod \"9f103e4a-2e30-4fd8-a10a-d024059db7af\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") "
Jul 05 19:34:38.721368 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721180    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-serving-cert\") pod \"9f103e4a-2e30-4fd8-a10a-d024059db7af\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") "
Jul 05 19:34:38.721368 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721214    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-config\") pod \"9f103e4a-2e30-4fd8-a10a-d024059db7af\" (UID: \"9f103e4a-2e30-4fd8-a10a-d024059db7af\") "
Jul 05 19:34:38.721567 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721536    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9f103e4a-2e30-4fd8-a10a-d024059db7af" (UID: "9f103e4a-2e30-4fd8-a10a-d024059db7af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:34:38.721567 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721554    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-service-ca" (OuterVolumeSpecName: "service-ca") pod "9f103e4a-2e30-4fd8-a10a-d024059db7af" (UID: "9f103e4a-2e30-4fd8-a10a-d024059db7af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:34:38.721720 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721664    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9f103e4a-2e30-4fd8-a10a-d024059db7af" (UID: "9f103e4a-2e30-4fd8-a10a-d024059db7af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:34:38.721763 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.721745    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-config" (OuterVolumeSpecName: "console-config") pod "9f103e4a-2e30-4fd8-a10a-d024059db7af" (UID: "9f103e4a-2e30-4fd8-a10a-d024059db7af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:34:38.723412 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.723376    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9f103e4a-2e30-4fd8-a10a-d024059db7af" (UID: "9f103e4a-2e30-4fd8-a10a-d024059db7af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:34:38.723523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.723433    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9f103e4a-2e30-4fd8-a10a-d024059db7af" (UID: "9f103e4a-2e30-4fd8-a10a-d024059db7af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:34:38.723523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.723487    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f103e4a-2e30-4fd8-a10a-d024059db7af-kube-api-access-5mkk8" (OuterVolumeSpecName: "kube-api-access-5mkk8") pod "9f103e4a-2e30-4fd8-a10a-d024059db7af" (UID: "9f103e4a-2e30-4fd8-a10a-d024059db7af"). InnerVolumeSpecName "kube-api-access-5mkk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:34:38.767481 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.767448    2583 generic.go:356] "Generic (PLEG): container finished" podID="9f103e4a-2e30-4fd8-a10a-d024059db7af" containerID="ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f" exitCode=0
Jul 05 19:34:38.767628 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.767493    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5566975d74-5vtqm"
Jul 05 19:34:38.767628 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.767490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5566975d74-5vtqm" event={"ID":"9f103e4a-2e30-4fd8-a10a-d024059db7af","Type":"ContainerDied","Data":"ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f"}
Jul 05 19:34:38.767628 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.767617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5566975d74-5vtqm" event={"ID":"9f103e4a-2e30-4fd8-a10a-d024059db7af","Type":"ContainerDied","Data":"61ebe3dff1199c4e60107eab874076387f1d7cb1887cf832ead649af17827d5a"}
Jul 05 19:34:38.767753 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.767645    2583 scope.go:117] "RemoveContainer" containerID="ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f"
Jul 05 19:34:38.776316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.776302    2583 scope.go:117] "RemoveContainer" containerID="ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f"
Jul 05 19:34:38.776584 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:34:38.776565    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f\": container with ID starting with ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f not found: ID does not exist" containerID="ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f"
Jul 05 19:34:38.776625 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.776592    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f"} err="failed to get container status \"ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f\": rpc error: code = NotFound desc = could not find container \"ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f\": container with ID starting with ec978eda8e4333e4cf94e9e91e4d4040ffa7ed0ac62550397b3dc258c797219f not found: ID does not exist"
Jul 05 19:34:38.788633 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.788608    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5566975d74-5vtqm"]
Jul 05 19:34:38.793810 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.793788    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5566975d74-5vtqm"]
Jul 05 19:34:38.821946 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.821921    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mkk8\" (UniqueName: \"kubernetes.io/projected/9f103e4a-2e30-4fd8-a10a-d024059db7af-kube-api-access-5mkk8\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:38.821946 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.821944    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-oauth-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:38.822075 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.821959    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-oauth-serving-cert\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:38.822075 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.821972    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-serving-cert\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:38.822075 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.821985    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-console-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:38.822075 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.821998    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-trusted-ca-bundle\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:38.822075 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:38.822010    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f103e4a-2e30-4fd8-a10a-d024059db7af-service-ca\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:34:39.122727 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:39.122698    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f103e4a-2e30-4fd8-a10a-d024059db7af" path="/var/lib/kubelet/pods/9f103e4a-2e30-4fd8-a10a-d024059db7af/volumes"
Jul 05 19:34:58.299003 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:58.298973    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:34:58.316252 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:58.316227    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:34:58.858867 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:34:58.858839    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:11.931964 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:11.931925    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:35:11.932536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:11.932236    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="alertmanager" containerID="cri-o://272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087" gracePeriod=120
Jul 05 19:35:11.932536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:11.932311    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-metric" containerID="cri-o://cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89" gracePeriod=120
Jul 05 19:35:11.932536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:11.932368    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="prom-label-proxy" containerID="cri-o://d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54" gracePeriod=120
Jul 05 19:35:11.932536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:11.932409    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-web" containerID="cri-o://fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c" gracePeriod=120
Jul 05 19:35:11.932536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:11.932387    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy" containerID="cri-o://850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2" gracePeriod=120
Jul 05 19:35:11.932536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:11.932507    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="config-reloader" containerID="cri-o://3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4" gracePeriod=120
Jul 05 19:35:12.900722 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900690    2583 generic.go:356] "Generic (PLEG): container finished" podID="947606f4-cce6-4bee-8545-27e4356dc380" containerID="d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54" exitCode=0
Jul 05 19:35:12.900722 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900715    2583 generic.go:356] "Generic (PLEG): container finished" podID="947606f4-cce6-4bee-8545-27e4356dc380" containerID="850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2" exitCode=0
Jul 05 19:35:12.900722 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900722    2583 generic.go:356] "Generic (PLEG): container finished" podID="947606f4-cce6-4bee-8545-27e4356dc380" containerID="3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4" exitCode=0
Jul 05 19:35:12.900722 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900728    2583 generic.go:356] "Generic (PLEG): container finished" podID="947606f4-cce6-4bee-8545-27e4356dc380" containerID="272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087" exitCode=0
Jul 05 19:35:12.901052 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"}
Jul 05 19:35:12.901052 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"}
Jul 05 19:35:12.901052 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"}
Jul 05 19:35:12.901052 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:12.900878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"}
Jul 05 19:35:13.169194 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.169170    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:13.303736 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.303703    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-trusted-ca-bundle\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.303736 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.303739    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-main-db\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.303977 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.303761    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-config-out\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.303977 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.303781    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-main-tls\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.303977 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.303897    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-metrics-client-ca\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.303977 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.303943    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-web-config\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.303982    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkmzh\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-kube-api-access-vkmzh\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304010    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304043    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-tls-assets\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304098    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-metric\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304136    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:35:13.304176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304151    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:13.304176 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-web\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304556 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304225    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-cluster-tls-config\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304556 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304259    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:13.304556 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304292    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-config-volume\") pod \"947606f4-cce6-4bee-8545-27e4356dc380\" (UID: \"947606f4-cce6-4bee-8545-27e4356dc380\") "
Jul 05 19:35:13.304707 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304604    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.304707 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304626    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-alertmanager-main-db\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.304707 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.304642    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/947606f4-cce6-4bee-8545-27e4356dc380-metrics-client-ca\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.306609 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.306576    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:13.306759 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.306663    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-kube-api-access-vkmzh" (OuterVolumeSpecName: "kube-api-access-vkmzh") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "kube-api-access-vkmzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:35:13.306827 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.306801    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-config-volume" (OuterVolumeSpecName: "config-volume") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:13.307513 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.307211    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:13.307513 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.307465    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:35:13.307677 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.307593    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-config-out" (OuterVolumeSpecName: "config-out") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:35:13.308033 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.308003    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:13.308811 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.308784    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:13.312124 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.312094    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:13.318390 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.318366    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-web-config" (OuterVolumeSpecName: "web-config") pod "947606f4-cce6-4bee-8545-27e4356dc380" (UID: "947606f4-cce6-4bee-8545-27e4356dc380"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405861    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-cluster-tls-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405903    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-config-volume\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405913    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/947606f4-cce6-4bee-8545-27e4356dc380-config-out\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405921    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-main-tls\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405929    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-web-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405938    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkmzh\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-kube-api-access-vkmzh\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405947    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405958    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/947606f4-cce6-4bee-8545-27e4356dc380-tls-assets\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405966    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.405960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.405975    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/947606f4-cce6-4bee-8545-27e4356dc380-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:13.907301 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.907254    2583 generic.go:356] "Generic (PLEG): container finished" podID="947606f4-cce6-4bee-8545-27e4356dc380" containerID="cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89" exitCode=0
Jul 05 19:35:13.907301 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.907293    2583 generic.go:356] "Generic (PLEG): container finished" podID="947606f4-cce6-4bee-8545-27e4356dc380" containerID="fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c" exitCode=0
Jul 05 19:35:13.907498 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.907342    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:13.907498 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.907339    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"}
Jul 05 19:35:13.907498 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.907490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"}
Jul 05 19:35:13.907603 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.907518    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"947606f4-cce6-4bee-8545-27e4356dc380","Type":"ContainerDied","Data":"7dda329694a8c00c69d045da57d09d8ad95f26dc85f24e404357762d50cd8950"}
Jul 05 19:35:13.907603 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.907555    2583 scope.go:117] "RemoveContainer" containerID="d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"
Jul 05 19:35:13.919772 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.919753    2583 scope.go:117] "RemoveContainer" containerID="cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"
Jul 05 19:35:13.926539 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.926523    2583 scope.go:117] "RemoveContainer" containerID="850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"
Jul 05 19:35:13.934076 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.933611    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:35:13.934076 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.933875    2583 scope.go:117] "RemoveContainer" containerID="fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"
Jul 05 19:35:13.941125 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.941103    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:35:13.941901 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.941885    2583 scope.go:117] "RemoveContainer" containerID="3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"
Jul 05 19:35:13.948553 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.948538    2583 scope.go:117] "RemoveContainer" containerID="272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"
Jul 05 19:35:13.955088 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.955072    2583 scope.go:117] "RemoveContainer" containerID="165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168"
Jul 05 19:35:13.961594 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.961578    2583 scope.go:117] "RemoveContainer" containerID="d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"
Jul 05 19:35:13.961820 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:13.961797    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54\": container with ID starting with d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54 not found: ID does not exist" containerID="d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"
Jul 05 19:35:13.961908 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.961825    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"} err="failed to get container status \"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54\": rpc error: code = NotFound desc = could not find container \"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54\": container with ID starting with d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54 not found: ID does not exist"
Jul 05 19:35:13.961908 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.961844    2583 scope.go:117] "RemoveContainer" containerID="cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"
Jul 05 19:35:13.962085 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:13.962068    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89\": container with ID starting with cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89 not found: ID does not exist" containerID="cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"
Jul 05 19:35:13.962131 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962091    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"} err="failed to get container status \"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89\": rpc error: code = NotFound desc = could not find container \"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89\": container with ID starting with cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89 not found: ID does not exist"
Jul 05 19:35:13.962131 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962106    2583 scope.go:117] "RemoveContainer" containerID="850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"
Jul 05 19:35:13.962366 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:13.962350    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2\": container with ID starting with 850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2 not found: ID does not exist" containerID="850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"
Jul 05 19:35:13.962420 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962369    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"} err="failed to get container status \"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2\": rpc error: code = NotFound desc = could not find container \"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2\": container with ID starting with 850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2 not found: ID does not exist"
Jul 05 19:35:13.962420 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962382    2583 scope.go:117] "RemoveContainer" containerID="fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"
Jul 05 19:35:13.962609 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:13.962592    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c\": container with ID starting with fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c not found: ID does not exist" containerID="fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"
Jul 05 19:35:13.962649 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962613    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"} err="failed to get container status \"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c\": rpc error: code = NotFound desc = could not find container \"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c\": container with ID starting with fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c not found: ID does not exist"
Jul 05 19:35:13.962649 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962627    2583 scope.go:117] "RemoveContainer" containerID="3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"
Jul 05 19:35:13.962842 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:13.962825    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4\": container with ID starting with 3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4 not found: ID does not exist" containerID="3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"
Jul 05 19:35:13.962882 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962846    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"} err="failed to get container status \"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4\": rpc error: code = NotFound desc = could not find container \"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4\": container with ID starting with 3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4 not found: ID does not exist"
Jul 05 19:35:13.962882 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.962860    2583 scope.go:117] "RemoveContainer" containerID="272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"
Jul 05 19:35:13.963039 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:13.963025    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087\": container with ID starting with 272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087 not found: ID does not exist" containerID="272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"
Jul 05 19:35:13.963080 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963041    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"} err="failed to get container status \"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087\": rpc error: code = NotFound desc = could not find container \"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087\": container with ID starting with 272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087 not found: ID does not exist"
Jul 05 19:35:13.963080 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963053    2583 scope.go:117] "RemoveContainer" containerID="165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168"
Jul 05 19:35:13.963252 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:13.963238    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168\": container with ID starting with 165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168 not found: ID does not exist" containerID="165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168"
Jul 05 19:35:13.963302 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963253    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168"} err="failed to get container status \"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168\": rpc error: code = NotFound desc = could not find container \"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168\": container with ID starting with 165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168 not found: ID does not exist"
Jul 05 19:35:13.963302 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963264    2583 scope.go:117] "RemoveContainer" containerID="d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"
Jul 05 19:35:13.963482 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963465    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54"} err="failed to get container status \"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54\": rpc error: code = NotFound desc = could not find container \"d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54\": container with ID starting with d8026f9702ab80be8b4b75b07c0dcc09b1d8972d5f2828a38388892aae438d54 not found: ID does not exist"
Jul 05 19:35:13.963535 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963482    2583 scope.go:117] "RemoveContainer" containerID="cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"
Jul 05 19:35:13.963692 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963673    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89"} err="failed to get container status \"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89\": rpc error: code = NotFound desc = could not find container \"cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89\": container with ID starting with cff3c2f4177e9a90f13304b7ff94d63b8e614443494c1bdd8c52ed18b3cb7e89 not found: ID does not exist"
Jul 05 19:35:13.963762 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963694    2583 scope.go:117] "RemoveContainer" containerID="850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"
Jul 05 19:35:13.963915 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963889    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2"} err="failed to get container status \"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2\": rpc error: code = NotFound desc = could not find container \"850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2\": container with ID starting with 850daa000502d7a3bab217cf63945471293534323951187ef0d631eb70a8a7e2 not found: ID does not exist"
Jul 05 19:35:13.963915 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.963908    2583 scope.go:117] "RemoveContainer" containerID="fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"
Jul 05 19:35:13.964152 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.964126    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c"} err="failed to get container status \"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c\": rpc error: code = NotFound desc = could not find container \"fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c\": container with ID starting with fab3331b6a1d4c00e03e8259403f7075eb5b79f1813910dc59d6067bfb272a5c not found: ID does not exist"
Jul 05 19:35:13.964152 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.964153    2583 scope.go:117] "RemoveContainer" containerID="3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"
Jul 05 19:35:13.964478 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.964452    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4"} err="failed to get container status \"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4\": rpc error: code = NotFound desc = could not find container \"3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4\": container with ID starting with 3e605ccc80990b142f756fb0a6db79cb5112cb9d5cc5b8a2007770daf1eb39f4 not found: ID does not exist"
Jul 05 19:35:13.964609 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.964499    2583 scope.go:117] "RemoveContainer" containerID="272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"
Jul 05 19:35:13.964867 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.964840    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087"} err="failed to get container status \"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087\": rpc error: code = NotFound desc = could not find container \"272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087\": container with ID starting with 272773237c4869fca3ede9cc28689cd70e2288c158b0e4cf5617874ce0f39087 not found: ID does not exist"
Jul 05 19:35:13.964867 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.964861    2583 scope.go:117] "RemoveContainer" containerID="165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168"
Jul 05 19:35:13.965221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.965198    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168"} err="failed to get container status \"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168\": rpc error: code = NotFound desc = could not find container \"165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168\": container with ID starting with 165e6b877540783db2aa2403e1c99debc307327f1aa56433c6ec1426a5203168 not found: ID does not exist"
Jul 05 19:35:13.966311 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966258    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:35:13.966593 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966580    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-metric"
Jul 05 19:35:13.966635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966595    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-metric"
Jul 05 19:35:13.966635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966604    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="config-reloader"
Jul 05 19:35:13.966635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966609    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="config-reloader"
Jul 05 19:35:13.966635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966616    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="prom-label-proxy"
Jul 05 19:35:13.966635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966622    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="prom-label-proxy"
Jul 05 19:35:13.966635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966631    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="init-config-reloader"
Jul 05 19:35:13.966635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966636    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="init-config-reloader"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966646    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275aec01-f3a5-45c2-92f7-c74d4eefc3f9" containerName="console"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966651    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="275aec01-f3a5-45c2-92f7-c74d4eefc3f9" containerName="console"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966658    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f103e4a-2e30-4fd8-a10a-d024059db7af" containerName="console"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966663    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f103e4a-2e30-4fd8-a10a-d024059db7af" containerName="console"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966669    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="alertmanager"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966673    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="alertmanager"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966683    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-web"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966688    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-web"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966694    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966699    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966736    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="275aec01-f3a5-45c2-92f7-c74d4eefc3f9" containerName="console"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966743    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="config-reloader"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966748    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="prom-label-proxy"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966754    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f103e4a-2e30-4fd8-a10a-d024059db7af" containerName="console"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966760    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-web"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966765    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy-metric"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966769    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="kube-rbac-proxy"
Jul 05 19:35:13.966831 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.966774    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="947606f4-cce6-4bee-8545-27e4356dc380" containerName="alertmanager"
Jul 05 19:35:13.971129 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.970296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:13.973615 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.973595    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 05 19:35:13.973708 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.973636    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 05 19:35:13.973840 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.973825    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 05 19:35:13.973909 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.973838    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 05 19:35:13.973909 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.973879    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 05 19:35:13.973989 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.973914    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 05 19:35:13.974361 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.974346    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 05 19:35:13.974437 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.974400    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 05 19:35:13.974437 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.974350    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7wtbx\""
Jul 05 19:35:13.979209 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.979191    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 05 19:35:13.984911 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:13.984884    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:35:14.111183 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59b9477-854b-4eb8-a84e-ee37d61e9b72-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111183 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnfxz\" (UniqueName: \"kubernetes.io/projected/b59b9477-854b-4eb8-a84e-ee37d61e9b72-kube-api-access-pnfxz\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111398 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b59b9477-854b-4eb8-a84e-ee37d61e9b72-config-out\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111398 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111253    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111398 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b59b9477-854b-4eb8-a84e-ee37d61e9b72-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111494 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111404    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-config-volume\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111494 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b59b9477-854b-4eb8-a84e-ee37d61e9b72-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111494 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111494 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-web-config\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59b9477-854b-4eb8-a84e-ee37d61e9b72-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.111693 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.111612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.212662 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.212553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.212662 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.212600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59b9477-854b-4eb8-a84e-ee37d61e9b72-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.212662 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.212623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.212870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.212932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59b9477-854b-4eb8-a84e-ee37d61e9b72-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.212957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnfxz\" (UniqueName: \"kubernetes.io/projected/b59b9477-854b-4eb8-a84e-ee37d61e9b72-kube-api-access-pnfxz\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b59b9477-854b-4eb8-a84e-ee37d61e9b72-config-out\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b59b9477-854b-4eb8-a84e-ee37d61e9b72-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-config-volume\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213240 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b59b9477-854b-4eb8-a84e-ee37d61e9b72-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213686 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213246    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213686 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-web-config\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213686 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213422    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59b9477-854b-4eb8-a84e-ee37d61e9b72-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213845 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213679    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b59b9477-854b-4eb8-a84e-ee37d61e9b72-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.213919 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.213889    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b59b9477-854b-4eb8-a84e-ee37d61e9b72-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.215977 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.215948    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.215977 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.215964    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.216178 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.216077    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.216178 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.216110    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-config-volume\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.216364 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.216331    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b59b9477-854b-4eb8-a84e-ee37d61e9b72-config-out\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.216364 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.216352    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-web-config\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.216732 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.216714    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.216908 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.216890    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b59b9477-854b-4eb8-a84e-ee37d61e9b72-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.217858 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.217838    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b59b9477-854b-4eb8-a84e-ee37d61e9b72-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.221447 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.221422    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnfxz\" (UniqueName: \"kubernetes.io/projected/b59b9477-854b-4eb8-a84e-ee37d61e9b72-kube-api-access-pnfxz\") pod \"alertmanager-main-0\" (UID: \"b59b9477-854b-4eb8-a84e-ee37d61e9b72\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.281050 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.281013    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 05 19:35:14.413953 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.413920    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 05 19:35:14.416847 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:35:14.416820    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59b9477_854b_4eb8_a84e_ee37d61e9b72.slice/crio-dece1150ba5adae7939494e9c287d222d068c11e81cc43f627b491179aa9d8eb WatchSource:0}: Error finding container dece1150ba5adae7939494e9c287d222d068c11e81cc43f627b491179aa9d8eb: Status 404 returned error can't find the container with id dece1150ba5adae7939494e9c287d222d068c11e81cc43f627b491179aa9d8eb
Jul 05 19:35:14.912053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.912019    2583 generic.go:356] "Generic (PLEG): container finished" podID="b59b9477-854b-4eb8-a84e-ee37d61e9b72" containerID="e7ed7d7eb02365146c202aab738cabe9d8deda009ad0b1c5d87281ddf92a085c" exitCode=0
Jul 05 19:35:14.912231 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.912110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerDied","Data":"e7ed7d7eb02365146c202aab738cabe9d8deda009ad0b1c5d87281ddf92a085c"}
Jul 05 19:35:14.912231 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:14.912196    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerStarted","Data":"dece1150ba5adae7939494e9c287d222d068c11e81cc43f627b491179aa9d8eb"}
Jul 05 19:35:15.121119 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.121092    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947606f4-cce6-4bee-8545-27e4356dc380" path="/var/lib/kubelet/pods/947606f4-cce6-4bee-8545-27e4356dc380/volumes"
Jul 05 19:35:15.921305 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.921245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerStarted","Data":"2ca987ae29d9c86551cd4a3aea1a4277965e55449a0ecfc9c0ea5e53a51ef3f8"}
Jul 05 19:35:15.921757 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.921366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerStarted","Data":"ff9ba3c0da96b716545d2a74c705c3795817bdfea148d97094ec43428f75d01e"}
Jul 05 19:35:15.921757 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.921407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerStarted","Data":"313afdcf429ba66aa09af13c6bcf3ca8f31cee4a058fd77fe139b63f9edd8b6d"}
Jul 05 19:35:15.921757 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.921450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerStarted","Data":"3657070beb93c22cc6cdc1b2c119067e06d92054d795a76e0a161468229a7f7a"}
Jul 05 19:35:15.921757 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.921487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerStarted","Data":"4115b028d0b29dbd909f91312cf267127a425cb513b1cdaa71b4e2a261d15473"}
Jul 05 19:35:15.921757 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.921525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b59b9477-854b-4eb8-a84e-ee37d61e9b72","Type":"ContainerStarted","Data":"c4468f5a0b73fc64a91d3d57ceaebea9d13db5409287afe71f80fc8e7a1162b3"}
Jul 05 19:35:15.957350 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:15.957291    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.94180584 podStartE2EDuration="2.95725697s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.45113ms" isStatefulPod=false podCreationTimestamp="2026-07-05 19:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:35:15.956242177 +0000 UTC m=+165.350564859" watchObservedRunningTime="2026-07-05 19:35:15.95725697 +0000 UTC m=+165.351579667"
Jul 05 19:35:16.260765 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.260681    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:35:16.261042 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.261013    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="prometheus" containerID="cri-o://0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb" gracePeriod=600
Jul 05 19:35:16.261129 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.261029    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="thanos-sidecar" containerID="cri-o://17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915" gracePeriod=600
Jul 05 19:35:16.261129 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.261078    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy" containerID="cri-o://ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed" gracePeriod=600
Jul 05 19:35:16.261229 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.261083    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="config-reloader" containerID="cri-o://95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b" gracePeriod=600
Jul 05 19:35:16.261229 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.261038    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-thanos" containerID="cri-o://592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a" gracePeriod=600
Jul 05 19:35:16.261426 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.261082    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-web" containerID="cri-o://068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5" gracePeriod=600
Jul 05 19:35:16.514147 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.514081    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:16.636471 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636434    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-web-config\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636471 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636474    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-db\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-tls\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636539    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-kube-rbac-proxy\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636560    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-config-out\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636592    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-trusted-ca-bundle\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636630    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-kubelet-serving-ca-bundle\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636657    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s22qz\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-kube-api-access-s22qz\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636679    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-config\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.636714 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636710    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-2\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636748    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-1\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636774    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-thanos-prometheus-http-client-file\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636810    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-metrics-client-certs\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636840    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-metrics-client-ca\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-0\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636888    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-serving-certs-ca-bundle\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636961    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.636989    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-tls-assets\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.637027    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.637063    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-grpc-tls\") pod \"a26b606b-ee78-4bd0-a278-6de55d13b549\" (UID: \"a26b606b-ee78-4bd0-a278-6de55d13b549\") "
Jul 05 19:35:16.637612 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.637343    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:16.637702 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.637669    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:16.637756 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.637707    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:35:16.638369 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.638072    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:16.638775 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.638752    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:16.639717 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.639687    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:16.639937 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.639905    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.640097 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.640070    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:16.640166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.640146    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.640348 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.640324    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 19:35:16.640705 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.640678    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-config" (OuterVolumeSpecName: "config") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.641096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.641054    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-config-out" (OuterVolumeSpecName: "config-out") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 19:35:16.641192 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.641103    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.641361 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.641337    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.641603 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.641577    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:35:16.641744 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.641595    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-kube-api-access-s22qz" (OuterVolumeSpecName: "kube-api-access-s22qz") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "kube-api-access-s22qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 19:35:16.641883 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.641864    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.642316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.642255    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.642535 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.642514    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.649785 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.649760    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-web-config" (OuterVolumeSpecName: "web-config") pod "a26b606b-ee78-4bd0-a278-6de55d13b549" (UID: "a26b606b-ee78-4bd0-a278-6de55d13b549"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 19:35:16.738367 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738319    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738367 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738362    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738367 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738374    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-metrics-client-certs\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738367 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738385    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-metrics-client-ca\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738394    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738402    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738412    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738421    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-tls-assets\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738429    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738441    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-grpc-tls\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738450    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-web-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738458    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-db\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738466    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738475    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-secret-kube-rbac-proxy\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738482    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a26b606b-ee78-4bd0-a278-6de55d13b549-config-out\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738491    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738498    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738506    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s22qz\" (UniqueName: \"kubernetes.io/projected/a26b606b-ee78-4bd0-a278-6de55d13b549-kube-api-access-s22qz\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738514    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a26b606b-ee78-4bd0-a278-6de55d13b549-config\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.738630 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.738522    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a26b606b-ee78-4bd0-a278-6de55d13b549-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 19:35:16.928564 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928533    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a" exitCode=0
Jul 05 19:35:16.928564 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928557    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed" exitCode=0
Jul 05 19:35:16.928564 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928564    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5" exitCode=0
Jul 05 19:35:16.928564 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928570    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915" exitCode=0
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928577    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b" exitCode=0
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928583    2583 generic.go:356] "Generic (PLEG): container finished" podID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb" exitCode=0
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928618    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928612    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"}
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"}
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928813    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"}
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928827    2583 scope.go:117] "RemoveContainer" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"}
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"}
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"}
Jul 05 19:35:16.929060 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.928992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a26b606b-ee78-4bd0-a278-6de55d13b549","Type":"ContainerDied","Data":"9aa7262a99f1b6b191d23a9dfa1835f56c651796b684e1607d246f75c4564ec7"}
Jul 05 19:35:16.936887 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.936808    2583 scope.go:117] "RemoveContainer" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.945333 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.945257    2583 scope.go:117] "RemoveContainer" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.952486 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.952468    2583 scope.go:117] "RemoveContainer" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.952832 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.952812    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:35:16.957259 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.957235    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:35:16.959248 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.959233    2583 scope.go:117] "RemoveContainer" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.965788 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.965770    2583 scope.go:117] "RemoveContainer" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.972441 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.972421    2583 scope.go:117] "RemoveContainer" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.978587 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.978570    2583 scope.go:117] "RemoveContainer" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.978823 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:16.978804    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": container with ID starting with 592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a not found: ID does not exist" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.978892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.978831    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"} err="failed to get container status \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": rpc error: code = NotFound desc = could not find container \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": container with ID starting with 592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a not found: ID does not exist"
Jul 05 19:35:16.978892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.978852    2583 scope.go:117] "RemoveContainer" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.979134 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:16.979105    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": container with ID starting with ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed not found: ID does not exist" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.979209 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.979138    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"} err="failed to get container status \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": rpc error: code = NotFound desc = could not find container \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": container with ID starting with ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed not found: ID does not exist"
Jul 05 19:35:16.979209 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.979166    2583 scope.go:117] "RemoveContainer" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.979636 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:16.979585    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": container with ID starting with 068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5 not found: ID does not exist" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.979636 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.979629    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"} err="failed to get container status \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": rpc error: code = NotFound desc = could not find container \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": container with ID starting with 068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5 not found: ID does not exist"
Jul 05 19:35:16.979986 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.979649    2583 scope.go:117] "RemoveContainer" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.979986 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:16.979931    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": container with ID starting with 17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915 not found: ID does not exist" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.979986 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.979960    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"} err="failed to get container status \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": rpc error: code = NotFound desc = could not find container \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": container with ID starting with 17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915 not found: ID does not exist"
Jul 05 19:35:16.979986 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.979980    2583 scope.go:117] "RemoveContainer" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.980255 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:16.980236    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": container with ID starting with 95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b not found: ID does not exist" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.980316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.980283    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"} err="failed to get container status \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": rpc error: code = NotFound desc = could not find container \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": container with ID starting with 95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b not found: ID does not exist"
Jul 05 19:35:16.980316 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.980298    2583 scope.go:117] "RemoveContainer" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.980540 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:16.980521    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": container with ID starting with 0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb not found: ID does not exist" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.980618 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.980545    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"} err="failed to get container status \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": rpc error: code = NotFound desc = could not find container \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": container with ID starting with 0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb not found: ID does not exist"
Jul 05 19:35:16.980618 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.980563    2583 scope.go:117] "RemoveContainer" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.980803 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:35:16.980786    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": container with ID starting with bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a not found: ID does not exist" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.980843 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.980806    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"} err="failed to get container status \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": rpc error: code = NotFound desc = could not find container \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": container with ID starting with bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a not found: ID does not exist"
Jul 05 19:35:16.980843 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.980819    2583 scope.go:117] "RemoveContainer" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.981041 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981024    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"} err="failed to get container status \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": rpc error: code = NotFound desc = could not find container \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": container with ID starting with 592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a not found: ID does not exist"
Jul 05 19:35:16.981041 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981040    2583 scope.go:117] "RemoveContainer" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.981130 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981111    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:35:16.981256 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981241    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"} err="failed to get container status \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": rpc error: code = NotFound desc = could not find container \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": container with ID starting with ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed not found: ID does not exist"
Jul 05 19:35:16.981323 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981257    2583 scope.go:117] "RemoveContainer" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.981422 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981408    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="config-reloader"
Jul 05 19:35:16.981461 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981426    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="config-reloader"
Jul 05 19:35:16.981461 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981437    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy"
Jul 05 19:35:16.981461 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981446    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy"
Jul 05 19:35:16.981554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981461    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-web"
Jul 05 19:35:16.981554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981470    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-web"
Jul 05 19:35:16.981554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981480    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-thanos"
Jul 05 19:35:16.981554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981488    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-thanos"
Jul 05 19:35:16.981554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981500    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="init-config-reloader"
Jul 05 19:35:16.981554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981497    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"} err="failed to get container status \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": rpc error: code = NotFound desc = could not find container \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": container with ID starting with 068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5 not found: ID does not exist"
Jul 05 19:35:16.981554 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981520    2583 scope.go:117] "RemoveContainer" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981507    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="init-config-reloader"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981580    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="thanos-sidecar"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981589    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="thanos-sidecar"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981597    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="prometheus"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981603    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="prometheus"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981699    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="thanos-sidecar"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981708    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-web"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981718    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="config-reloader"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981727    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="prometheus"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981733    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy-thanos"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981739    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" containerName="kube-rbac-proxy"
Jul 05 19:35:16.981768 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981761    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"} err="failed to get container status \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": rpc error: code = NotFound desc = could not find container \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": container with ID starting with 17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915 not found: ID does not exist"
Jul 05 19:35:16.982192 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981777    2583 scope.go:117] "RemoveContainer" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.982192 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981962    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"} err="failed to get container status \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": rpc error: code = NotFound desc = could not find container \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": container with ID starting with 95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b not found: ID does not exist"
Jul 05 19:35:16.982192 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.981979    2583 scope.go:117] "RemoveContainer" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.982192 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982176    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"} err="failed to get container status \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": rpc error: code = NotFound desc = could not find container \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": container with ID starting with 0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb not found: ID does not exist"
Jul 05 19:35:16.982350 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982198    2583 scope.go:117] "RemoveContainer" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.982441 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982420    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"} err="failed to get container status \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": rpc error: code = NotFound desc = could not find container \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": container with ID starting with bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a not found: ID does not exist"
Jul 05 19:35:16.982477 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982443    2583 scope.go:117] "RemoveContainer" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.982682 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982665    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"} err="failed to get container status \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": rpc error: code = NotFound desc = could not find container \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": container with ID starting with 592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a not found: ID does not exist"
Jul 05 19:35:16.982721 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982683    2583 scope.go:117] "RemoveContainer" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.982935 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982913    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"} err="failed to get container status \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": rpc error: code = NotFound desc = could not find container \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": container with ID starting with ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed not found: ID does not exist"
Jul 05 19:35:16.983019 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.982938    2583 scope.go:117] "RemoveContainer" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.983166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.983141    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"} err="failed to get container status \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": rpc error: code = NotFound desc = could not find container \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": container with ID starting with 068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5 not found: ID does not exist"
Jul 05 19:35:16.983166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.983165    2583 scope.go:117] "RemoveContainer" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.983570 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.983545    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"} err="failed to get container status \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": rpc error: code = NotFound desc = could not find container \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": container with ID starting with 17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915 not found: ID does not exist"
Jul 05 19:35:16.983570 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.983570    2583 scope.go:117] "RemoveContainer" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.983846 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.983812    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"} err="failed to get container status \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": rpc error: code = NotFound desc = could not find container \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": container with ID starting with 95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b not found: ID does not exist"
Jul 05 19:35:16.983903 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.983848    2583 scope.go:117] "RemoveContainer" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.984137 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.984109    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"} err="failed to get container status \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": rpc error: code = NotFound desc = could not find container \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": container with ID starting with 0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb not found: ID does not exist"
Jul 05 19:35:16.984137 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.984137    2583 scope.go:117] "RemoveContainer" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.984469 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.984376    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"} err="failed to get container status \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": rpc error: code = NotFound desc = could not find container \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": container with ID starting with bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a not found: ID does not exist"
Jul 05 19:35:16.984469 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.984408    2583 scope.go:117] "RemoveContainer" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.986259 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.986239    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"} err="failed to get container status \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": rpc error: code = NotFound desc = could not find container \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": container with ID starting with 592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a not found: ID does not exist"
Jul 05 19:35:16.986259 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.986258    2583 scope.go:117] "RemoveContainer" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.986546 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.986522    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"} err="failed to get container status \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": rpc error: code = NotFound desc = could not find container \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": container with ID starting with ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed not found: ID does not exist"
Jul 05 19:35:16.986546 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.986545    2583 scope.go:117] "RemoveContainer" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.986818 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.986791    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"} err="failed to get container status \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": rpc error: code = NotFound desc = could not find container \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": container with ID starting with 068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5 not found: ID does not exist"
Jul 05 19:35:16.986818 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.986812    2583 scope.go:117] "RemoveContainer" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.987093 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.987070    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"} err="failed to get container status \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": rpc error: code = NotFound desc = could not find container \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": container with ID starting with 17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915 not found: ID does not exist"
Jul 05 19:35:16.987093 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.987093    2583 scope.go:117] "RemoveContainer" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.987234 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.987129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:16.987558 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.987534    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"} err="failed to get container status \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": rpc error: code = NotFound desc = could not find container \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": container with ID starting with 95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b not found: ID does not exist"
Jul 05 19:35:16.987616 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.987561    2583 scope.go:117] "RemoveContainer" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.987896 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.987853    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"} err="failed to get container status \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": rpc error: code = NotFound desc = could not find container \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": container with ID starting with 0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb not found: ID does not exist"
Jul 05 19:35:16.987896 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.987879    2583 scope.go:117] "RemoveContainer" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.988155 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988117    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"} err="failed to get container status \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": rpc error: code = NotFound desc = could not find container \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": container with ID starting with bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a not found: ID does not exist"
Jul 05 19:35:16.988155 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988137    2583 scope.go:117] "RemoveContainer" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.988374 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988354    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"} err="failed to get container status \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": rpc error: code = NotFound desc = could not find container \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": container with ID starting with 592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a not found: ID does not exist"
Jul 05 19:35:16.988419 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988376    2583 scope.go:117] "RemoveContainer" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.988599 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988584    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"} err="failed to get container status \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": rpc error: code = NotFound desc = could not find container \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": container with ID starting with ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed not found: ID does not exist"
Jul 05 19:35:16.988645 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988600    2583 scope.go:117] "RemoveContainer" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.988851 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988831    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"} err="failed to get container status \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": rpc error: code = NotFound desc = could not find container \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": container with ID starting with 068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5 not found: ID does not exist"
Jul 05 19:35:16.988906 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.988852    2583 scope.go:117] "RemoveContainer" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.989148 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989128    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"} err="failed to get container status \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": rpc error: code = NotFound desc = could not find container \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": container with ID starting with 17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915 not found: ID does not exist"
Jul 05 19:35:16.989220 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989149    2583 scope.go:117] "RemoveContainer" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.989462 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989443    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"} err="failed to get container status \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": rpc error: code = NotFound desc = could not find container \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": container with ID starting with 95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b not found: ID does not exist"
Jul 05 19:35:16.989462 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989461    2583 scope.go:117] "RemoveContainer" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.989682 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989664    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"} err="failed to get container status \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": rpc error: code = NotFound desc = could not find container \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": container with ID starting with 0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb not found: ID does not exist"
Jul 05 19:35:16.989682 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989682    2583 scope.go:117] "RemoveContainer" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.989897 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989873    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"} err="failed to get container status \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": rpc error: code = NotFound desc = could not find container \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": container with ID starting with bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a not found: ID does not exist"
Jul 05 19:35:16.989897 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.989890    2583 scope.go:117] "RemoveContainer" containerID="592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"
Jul 05 19:35:16.990191 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990170    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a"} err="failed to get container status \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": rpc error: code = NotFound desc = could not find container \"592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a\": container with ID starting with 592ba87e6825def5b9b2c583b673f586c179e1b0829a1928f850118c98ae135a not found: ID does not exist"
Jul 05 19:35:16.990251 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990192    2583 scope.go:117] "RemoveContainer" containerID="ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"
Jul 05 19:35:16.990251 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990173    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 05 19:35:16.990251 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990241    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 05 19:35:16.990499 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990478    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed"} err="failed to get container status \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": rpc error: code = NotFound desc = could not find container \"ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed\": container with ID starting with ceb8f6bbabc8640fe17c6864cfcb91a1cceb069aa1cf83470426c19b35a217ed not found: ID does not exist"
Jul 05 19:35:16.990583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990497    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 05 19:35:16.990583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990502    2583 scope.go:117] "RemoveContainer" containerID="068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"
Jul 05 19:35:16.990583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990544    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 05 19:35:16.990583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990563    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 05 19:35:16.990774 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 05 19:35:16.990891 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990871    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 05 19:35:16.990995 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990874    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 05 19:35:16.990995 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990927    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dvt8k\""
Jul 05 19:35:16.990995 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990966    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5"} err="failed to get container status \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": rpc error: code = NotFound desc = could not find container \"068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5\": container with ID starting with 068c10e62d6151a4a9cd252fc83fcd22b46460b4d141ffcb189a39ed1723f6e5 not found: ID does not exist"
Jul 05 19:35:16.990995 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.990988    2583 scope.go:117] "RemoveContainer" containerID="17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"
Jul 05 19:35:16.991166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991003    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 05 19:35:16.991166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991022    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 05 19:35:16.991166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991028    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 05 19:35:16.991166 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991071    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ei59k6rbkrgrg\""
Jul 05 19:35:16.991360 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991340    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915"} err="failed to get container status \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": rpc error: code = NotFound desc = could not find container \"17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915\": container with ID starting with 17d7cf6ab311371ef3e217403c88d9cb9e1eb25057b6607d41ea45c62027f915 not found: ID does not exist"
Jul 05 19:35:16.991423 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991361    2583 scope.go:117] "RemoveContainer" containerID="95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"
Jul 05 19:35:16.991617 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991598    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 05 19:35:16.991994 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991614    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b"} err="failed to get container status \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": rpc error: code = NotFound desc = could not find container \"95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b\": container with ID starting with 95b5418b0fbc1458752357768cf9e7581a3d93d7118555f3a71baef32f84289b not found: ID does not exist"
Jul 05 19:35:16.991994 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991646    2583 scope.go:117] "RemoveContainer" containerID="0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"
Jul 05 19:35:16.991994 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991901    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb"} err="failed to get container status \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": rpc error: code = NotFound desc = could not find container \"0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb\": container with ID starting with 0e63fae7db32b470ad55b74ecf8e959aa43a1af26846da74ca98e7eadb3343bb not found: ID does not exist"
Jul 05 19:35:16.991994 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.991920    2583 scope.go:117] "RemoveContainer" containerID="bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"
Jul 05 19:35:16.992234 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.992127    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a"} err="failed to get container status \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": rpc error: code = NotFound desc = could not find container \"bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a\": container with ID starting with bdfcb3e4bf8b9991acee8f3b47a676313efc3112821354f13aa51180653fd12a not found: ID does not exist"
Jul 05 19:35:16.993634 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.993617    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 05 19:35:16.995701 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:16.995683    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 05 19:35:17.004472 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.004448    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:35:17.122803 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.122772    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26b606b-ee78-4bd0-a278-6de55d13b549" path="/var/lib/kubelet/pods/a26b606b-ee78-4bd0-a278-6de55d13b549/volumes"
Jul 05 19:35:17.143249 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143326 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143326 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143293    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143404 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143404 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143344    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143404 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143511 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143511 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143511 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143436    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbdr\" (UniqueName: \"kubernetes.io/projected/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-kube-api-access-vzbdr\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143511 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-config\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143865 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143657    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143865 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143865 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143865 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143744    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.143865 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.143790    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.244717 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.244717 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.244717 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.244892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.244892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.244892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.244892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245058 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245058 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.244989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245058 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245205 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245205 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245205 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbdr\" (UniqueName: \"kubernetes.io/projected/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-kube-api-access-vzbdr\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245205 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245132    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245205 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-config\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245205 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245526 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245238    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245526 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245526 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245526 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245526 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.245886 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.245860    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.247835 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.247809    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.247942 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.247843    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.247942 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.247861    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248041 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.247956    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-config\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248041 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.247966    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248153 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.248122    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248393 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.248373    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248471 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.248394    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248523 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.248491    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248842 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.248797    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.248970 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.248857    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.249033 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.249010    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.249067 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.249041    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.250211 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.250196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.250546 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.250531    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.250933 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.250915    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.251594 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.251579    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.261326 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.261311    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbdr\" (UniqueName: \"kubernetes.io/projected/a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6-kube-api-access-vzbdr\") pod \"prometheus-k8s-0\" (UID: \"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.297332 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.297317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:35:17.427564 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.427524    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 05 19:35:17.430179 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:35:17.430151    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23a0b79_eb1c_4c8d_a7f5_74ac162d05d6.slice/crio-fb9cd9df12b19798b4ff95af260481860353a5de2b375bd3c25b110d0f9287b1 WatchSource:0}: Error finding container fb9cd9df12b19798b4ff95af260481860353a5de2b375bd3c25b110d0f9287b1: Status 404 returned error can't find the container with id fb9cd9df12b19798b4ff95af260481860353a5de2b375bd3c25b110d0f9287b1
Jul 05 19:35:17.934678 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.934643    2583 generic.go:356] "Generic (PLEG): container finished" podID="a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6" containerID="4b641ad263b93b8c91863d7808e9ecb4fcdb2537a62ce911d8c4d1a8ea8af9e1" exitCode=0
Jul 05 19:35:17.935090 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.934727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerDied","Data":"4b641ad263b93b8c91863d7808e9ecb4fcdb2537a62ce911d8c4d1a8ea8af9e1"}
Jul 05 19:35:17.935090 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:17.934819    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerStarted","Data":"fb9cd9df12b19798b4ff95af260481860353a5de2b375bd3c25b110d0f9287b1"}
Jul 05 19:35:18.943693 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:18.943655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerStarted","Data":"4a0e2a3f5e81777de95c0a26ae552caf1083245692340daa2057ba9849adab1e"}
Jul 05 19:35:18.944145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:18.943738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerStarted","Data":"89d1e09e6a40c357b825dd485bc2eef3ef225bc52de8d5e1751f24fff999b5db"}
Jul 05 19:35:18.944145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:18.943778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerStarted","Data":"79ee1e866d923be3fe71d28bc8da3c9fbc95e7e624f33386f7b308834a33e57e"}
Jul 05 19:35:18.944145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:18.943820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerStarted","Data":"7c117775bf5814a890c230c3493da33cb104be5b246ddaee5ae5329042f0c935"}
Jul 05 19:35:18.944145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:18.943863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerStarted","Data":"0382c4e0ffb0665627b65f816698bf73112b0118f05e27ee8a004e6d15633386"}
Jul 05 19:35:18.944145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:18.943899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6","Type":"ContainerStarted","Data":"dd771f67b749046e7b65f9a10eee2f6f7721a89335bf13793e843028991796b9"}
Jul 05 19:35:18.978074 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:18.977995    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9564208020000002 podStartE2EDuration="2.977974087s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.553285ms" isStatefulPod=false podCreationTimestamp="2026-07-05 19:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:35:18.976157888 +0000 UTC m=+168.370480574" watchObservedRunningTime="2026-07-05 19:35:18.977974087 +0000 UTC m=+168.372296771"
Jul 05 19:35:22.297765 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:35:22.297731    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:36:17.297631 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:36:17.297595    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:36:17.312508 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:36:17.312479    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:36:18.177767 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:36:18.177742    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 05 19:37:31.015380 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:31.015356    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 05 19:37:52.610812 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.610778    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vddvt"]
Jul 05 19:37:52.612962 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.612946    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:52.615861 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.615842    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 05 19:37:52.617221 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.617194    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rvnrr\""
Jul 05 19:37:52.617328 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.617206    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 05 19:37:52.621876 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.621850    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vddvt"]
Jul 05 19:37:52.812000 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.811974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2fc4\" (UniqueName: \"kubernetes.io/projected/c557242c-adc5-4a89-aff1-f5b4564e8558-kube-api-access-m2fc4\") pod \"cert-manager-webhook-6486ffd997-vddvt\" (UID: \"c557242c-adc5-4a89-aff1-f5b4564e8558\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:52.812110 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.812023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c557242c-adc5-4a89-aff1-f5b4564e8558-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vddvt\" (UID: \"c557242c-adc5-4a89-aff1-f5b4564e8558\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:52.912752 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.912723    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2fc4\" (UniqueName: \"kubernetes.io/projected/c557242c-adc5-4a89-aff1-f5b4564e8558-kube-api-access-m2fc4\") pod \"cert-manager-webhook-6486ffd997-vddvt\" (UID: \"c557242c-adc5-4a89-aff1-f5b4564e8558\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:52.912874 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.912767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c557242c-adc5-4a89-aff1-f5b4564e8558-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vddvt\" (UID: \"c557242c-adc5-4a89-aff1-f5b4564e8558\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:52.920876 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.920845    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2fc4\" (UniqueName: \"kubernetes.io/projected/c557242c-adc5-4a89-aff1-f5b4564e8558-kube-api-access-m2fc4\") pod \"cert-manager-webhook-6486ffd997-vddvt\" (UID: \"c557242c-adc5-4a89-aff1-f5b4564e8558\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:52.920876 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.920863    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c557242c-adc5-4a89-aff1-f5b4564e8558-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vddvt\" (UID: \"c557242c-adc5-4a89-aff1-f5b4564e8558\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:52.931660 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:52.931641    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:53.053238 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:53.053214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vddvt"]
Jul 05 19:37:53.056505 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:37:53.056480    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc557242c_adc5_4a89_aff1_f5b4564e8558.slice/crio-41a8da541ea02f4b360192b23705d67f9b7f9b76fb9d5726c002f8698d6676ad WatchSource:0}: Error finding container 41a8da541ea02f4b360192b23705d67f9b7f9b76fb9d5726c002f8698d6676ad: Status 404 returned error can't find the container with id 41a8da541ea02f4b360192b23705d67f9b7f9b76fb9d5726c002f8698d6676ad
Jul 05 19:37:53.058712 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:53.058695    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 19:37:53.496115 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:53.496082    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt" event={"ID":"c557242c-adc5-4a89-aff1-f5b4564e8558","Type":"ContainerStarted","Data":"41a8da541ea02f4b360192b23705d67f9b7f9b76fb9d5726c002f8698d6676ad"}
Jul 05 19:37:55.400408 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.400372    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"]
Jul 05 19:37:55.404162 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.404134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:55.407545 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.407521    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dkg5m\""
Jul 05 19:37:55.412610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.412091    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"]
Jul 05 19:37:55.534869 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.534828    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b649943f-88bc-4535-90cc-d18425cc71e2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-42tjg\" (UID: \"b649943f-88bc-4535-90cc-d18425cc71e2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:55.535036 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.534977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm6h5\" (UniqueName: \"kubernetes.io/projected/b649943f-88bc-4535-90cc-d18425cc71e2-kube-api-access-mm6h5\") pod \"cert-manager-cainjector-559cdd8c87-42tjg\" (UID: \"b649943f-88bc-4535-90cc-d18425cc71e2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:55.635971 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.635942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm6h5\" (UniqueName: \"kubernetes.io/projected/b649943f-88bc-4535-90cc-d18425cc71e2-kube-api-access-mm6h5\") pod \"cert-manager-cainjector-559cdd8c87-42tjg\" (UID: \"b649943f-88bc-4535-90cc-d18425cc71e2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:55.636126 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.636007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b649943f-88bc-4535-90cc-d18425cc71e2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-42tjg\" (UID: \"b649943f-88bc-4535-90cc-d18425cc71e2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:55.645763 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.645738    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b649943f-88bc-4535-90cc-d18425cc71e2-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-42tjg\" (UID: \"b649943f-88bc-4535-90cc-d18425cc71e2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:55.645879 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.645847    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm6h5\" (UniqueName: \"kubernetes.io/projected/b649943f-88bc-4535-90cc-d18425cc71e2-kube-api-access-mm6h5\") pod \"cert-manager-cainjector-559cdd8c87-42tjg\" (UID: \"b649943f-88bc-4535-90cc-d18425cc71e2\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:55.715610 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:55.715547    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"
Jul 05 19:37:56.296900 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:56.296880    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-42tjg"]
Jul 05 19:37:56.298526 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:37:56.298499    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb649943f_88bc_4535_90cc_d18425cc71e2.slice/crio-79c15579f8dd24eed13c38b918200fa3446cada1406ea9a6378bda53d3aec86b WatchSource:0}: Error finding container 79c15579f8dd24eed13c38b918200fa3446cada1406ea9a6378bda53d3aec86b: Status 404 returned error can't find the container with id 79c15579f8dd24eed13c38b918200fa3446cada1406ea9a6378bda53d3aec86b
Jul 05 19:37:56.511292 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:56.511187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt" event={"ID":"c557242c-adc5-4a89-aff1-f5b4564e8558","Type":"ContainerStarted","Data":"64178b683ef607db6e306ed3cbbf129cd68d4300c54f26920a0120230e4747a0"}
Jul 05 19:37:56.511672 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:56.511307    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:37:56.512752 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:56.512731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg" event={"ID":"b649943f-88bc-4535-90cc-d18425cc71e2","Type":"ContainerStarted","Data":"4a3c620f9f39061a43d490caf0f2888f792f2646aec455a0f704d0baaeb5c2b2"}
Jul 05 19:37:56.512869 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:56.512774    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg" event={"ID":"b649943f-88bc-4535-90cc-d18425cc71e2","Type":"ContainerStarted","Data":"79c15579f8dd24eed13c38b918200fa3446cada1406ea9a6378bda53d3aec86b"}
Jul 05 19:37:56.536631 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:56.536579    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt" podStartSLOduration=1.354503792 podStartE2EDuration="4.536562482s" totalImagesPullingTime="3.18205869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:37:56.536188361 +0000 UTC m=+325.930511044" watchObservedRunningTime="2026-07-05 19:37:56.536562482 +0000 UTC m=+325.930885163"
Jul 05 19:37:56.553283 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:37:56.553224    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-42tjg" podStartSLOduration=1.5532110220000002 podStartE2EDuration="1.553211022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:37:56.551417155 +0000 UTC m=+325.945739837" watchObservedRunningTime="2026-07-05 19:37:56.553211022 +0000 UTC m=+325.947533703"
Jul 05 19:38:02.518794 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:02.518766    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vddvt"
Jul 05 19:38:25.878676 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.878599    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"]
Jul 05 19:38:25.881963 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.881946    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:25.885450 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.885426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 05 19:38:25.886129 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.886112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 05 19:38:25.886190 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.886137    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 05 19:38:25.892233 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.886916    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 05 19:38:25.892233 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.887017    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gl5hl\""
Jul 05 19:38:25.900373 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.900345    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"]
Jul 05 19:38:25.961290 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.961229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:25.961466 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.961372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:25.961466 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.961431    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:25.961466 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.961460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:25.961565 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:25.961497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6mr5\" (UniqueName: \"kubernetes.io/projected/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-kube-api-access-f6mr5\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.062442 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.062408    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.062611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.062460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.062611 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.062580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.062711 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.062611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.062711 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.062652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6mr5\" (UniqueName: \"kubernetes.io/projected/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-kube-api-access-f6mr5\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.062963 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.062923    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-manifests\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.064736 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.064711    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-tmp\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.064968 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.064946    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-webhook-cert\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.065145 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.065125    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.072407 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.072386    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6mr5\" (UniqueName: \"kubernetes.io/projected/bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20-kube-api-access-f6mr5\") pod \"opendatahub-operator-controller-manager-547755b757-dd54x\" (UID: \"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20\") " pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.197470 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.197378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:26.342536 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.342506    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"]
Jul 05 19:38:26.345391 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:38:26.345363    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1a12c1_125b_40f9_8f0a_c9f66b3c2c20.slice/crio-1b47476b0ed0d85c082464814470e5dbabf5ef0fb3fd04632a4aea8a283cce5e WatchSource:0}: Error finding container 1b47476b0ed0d85c082464814470e5dbabf5ef0fb3fd04632a4aea8a283cce5e: Status 404 returned error can't find the container with id 1b47476b0ed0d85c082464814470e5dbabf5ef0fb3fd04632a4aea8a283cce5e
Jul 05 19:38:26.628832 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:26.628750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x" event={"ID":"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20","Type":"ContainerStarted","Data":"1b47476b0ed0d85c082464814470e5dbabf5ef0fb3fd04632a4aea8a283cce5e"}
Jul 05 19:38:30.649474 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:30.649429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x" event={"ID":"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20","Type":"ContainerStarted","Data":"75eb9cd3cf1ce28953629817ffcc4a6302e912f881537886b3ef4cbe637b8d5d"}
Jul 05 19:38:31.654885 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:31.654851    2583 generic.go:356] "Generic (PLEG): container finished" podID="bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20" containerID="75eb9cd3cf1ce28953629817ffcc4a6302e912f881537886b3ef4cbe637b8d5d" exitCode=0
Jul 05 19:38:31.655298 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:31.654916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x" event={"ID":"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20","Type":"ContainerDied","Data":"75eb9cd3cf1ce28953629817ffcc4a6302e912f881537886b3ef4cbe637b8d5d"}
Jul 05 19:38:32.660841 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:32.660799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x" event={"ID":"bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20","Type":"ContainerStarted","Data":"8c2831895cbb44f2025568b3900bb00a568c690ffcf4e6b6f1d4de8e59941ba1"}
Jul 05 19:38:32.661367 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:32.660927    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:32.699185 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:32.699129    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x" podStartSLOduration=2.948633212 podStartE2EDuration="7.699114156s" totalImagesPullingTime="3.682129998s" totalInitContainerRuntime="1.068350946s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:32.697322516 +0000 UTC m=+362.091645197" watchObservedRunningTime="2026-07-05 19:38:32.699114156 +0000 UTC m=+362.093436836"
Jul 05 19:38:43.192541 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.192504    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"]
Jul 05 19:38:43.201352 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.201329    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.204165 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.204136    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"]
Jul 05 19:38:43.204356 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.204241    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 05 19:38:43.206378 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.205776    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 05 19:38:43.206378 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.205814    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wncdm\""
Jul 05 19:38:43.206378 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.205836    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 05 19:38:43.206378 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.205851    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 05 19:38:43.206378 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.205881    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 05 19:38:43.327403 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.327366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-manager-config\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.327403 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.327411    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-cert\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.327634 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.327458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9z44\" (UniqueName: \"kubernetes.io/projected/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-kube-api-access-m9z44\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.327634 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.327485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-metrics-cert\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.428677 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.428633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-manager-config\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.428677 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.428684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-cert\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.428935 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.428727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9z44\" (UniqueName: \"kubernetes.io/projected/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-kube-api-access-m9z44\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.428935 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.428751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-metrics-cert\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.429485 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.429456    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-manager-config\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.431362 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.431336    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-metrics-cert\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.431450 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.431397    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-cert\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.436599 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.436576    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9z44\" (UniqueName: \"kubernetes.io/projected/e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20-kube-api-access-m9z44\") pod \"lws-controller-manager-644c79ff99-lt5p9\" (UID: \"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20\") " pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.511882 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.511783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:43.644118 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.644083    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"]
Jul 05 19:38:43.649149 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:38:43.649110    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b1f7fc_c5f8_48a3_bc42_cd2e93583e20.slice/crio-1f6bd18f5a6463cb61b38cdcf979d2f23a413c05649b37eed272fc8e405f23bc WatchSource:0}: Error finding container 1f6bd18f5a6463cb61b38cdcf979d2f23a413c05649b37eed272fc8e405f23bc: Status 404 returned error can't find the container with id 1f6bd18f5a6463cb61b38cdcf979d2f23a413c05649b37eed272fc8e405f23bc
Jul 05 19:38:43.667209 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.667182    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-547755b757-dd54x"
Jul 05 19:38:43.710290 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:43.710226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9" event={"ID":"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20","Type":"ContainerStarted","Data":"1f6bd18f5a6463cb61b38cdcf979d2f23a413c05649b37eed272fc8e405f23bc"}
Jul 05 19:38:46.725842 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:46.725795    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9" event={"ID":"e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20","Type":"ContainerStarted","Data":"c5fd8a09ea94853d85813896aa95a103c51d5a0b715c6f2c966fbc60bc24ce75"}
Jul 05 19:38:46.726389 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:46.725916    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:46.744086 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:46.744033    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9" podStartSLOduration=1.40791024 podStartE2EDuration="3.744016232s" totalImagesPullingTime="2.336105992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:38:46.743124113 +0000 UTC m=+376.137446796" watchObservedRunningTime="2026-07-05 19:38:46.744016232 +0000 UTC m=+376.138338912"
Jul 05 19:38:56.880173 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:56.880132    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"]
Jul 05 19:38:56.883794 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:56.883777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:56.895871 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:56.895841    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-138-140.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-140.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret"
Jul 05 19:38:56.895871 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:56.895841    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-jlnwq\" is forbidden: User \"system:node:ip-10-0-138-140.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-140.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jlnwq\"" type="*v1.Secret"
Jul 05 19:38:56.896026 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:56.895861    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-138-140.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-140.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret"
Jul 05 19:38:56.911531 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:56.911495    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-140.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-140.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 05 19:38:56.911701 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:56.911574    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-140.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-140.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 05 19:38:56.911701 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:56.911632    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-f6b494dcc-rwhnk\" is forbidden: User \"system:node:ip-10-0-138-140.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-140.ec2.internal' and this object" podUID="efa07977-e2ef-4e3b-b6f7-f7b25320c947" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:56.930740 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:56.930711    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"]
Jul 05 19:38:56.946840 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:56.946804    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tls-certs\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:56.946984 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:56.946886    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbrnc\" (UniqueName: \"kubernetes.io/projected/efa07977-e2ef-4e3b-b6f7-f7b25320c947-kube-api-access-rbrnc\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:56.946984 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:56.946931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tmp\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:57.048306 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:57.048256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tls-certs\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:57.048480 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:57.048346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbrnc\" (UniqueName: \"kubernetes.io/projected/efa07977-e2ef-4e3b-b6f7-f7b25320c947-kube-api-access-rbrnc\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:57.048480 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:57.048390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tmp\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:57.050757 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:57.050731    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tmp\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:57.734257 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:57.734222    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-644c79ff99-lt5p9"
Jul 05 19:38:57.810952 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:57.810917    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 05 19:38:57.855357 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:57.855322    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 05 19:38:58.049510 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:58.049415    2583 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition
Jul 05 19:38:58.049510 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:38:58.049511    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tls-certs podName:efa07977-e2ef-4e3b-b6f7-f7b25320c947 nodeName:}" failed. No retries permitted until 2026-07-05 19:38:58.549492789 +0000 UTC m=+387.943815451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tls-certs") pod "kube-auth-proxy-f6b494dcc-rwhnk" (UID: "efa07977-e2ef-4e3b-b6f7-f7b25320c947") : failed to sync secret cache: timed out waiting for the condition
Jul 05 19:38:58.370704 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.370681    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jlnwq\""
Jul 05 19:38:58.388837 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.388814    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 05 19:38:58.394917 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.394887    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbrnc\" (UniqueName: \"kubernetes.io/projected/efa07977-e2ef-4e3b-b6f7-f7b25320c947-kube-api-access-rbrnc\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:58.453766 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.453735    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 05 19:38:58.561173 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.561129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tls-certs\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:58.563587 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.563567    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efa07977-e2ef-4e3b-b6f7-f7b25320c947-tls-certs\") pod \"kube-auth-proxy-f6b494dcc-rwhnk\" (UID: \"efa07977-e2ef-4e3b-b6f7-f7b25320c947\") " pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:58.695053 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.694953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"
Jul 05 19:38:58.873892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:58.873867    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk"]
Jul 05 19:38:58.875723 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:38:58.875696    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa07977_e2ef_4e3b_b6f7_f7b25320c947.slice/crio-e16a8bf94f2eeb1c95713a38093e0549afe5d7e6c1de355a5d103a3a370ad0a4 WatchSource:0}: Error finding container e16a8bf94f2eeb1c95713a38093e0549afe5d7e6c1de355a5d103a3a370ad0a4: Status 404 returned error can't find the container with id e16a8bf94f2eeb1c95713a38093e0549afe5d7e6c1de355a5d103a3a370ad0a4
Jul 05 19:38:59.797533 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:38:59.797486    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk" event={"ID":"efa07977-e2ef-4e3b-b6f7-f7b25320c947","Type":"ContainerStarted","Data":"e16a8bf94f2eeb1c95713a38093e0549afe5d7e6c1de355a5d103a3a370ad0a4"}
Jul 05 19:39:01.808998 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:39:01.808954    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk" event={"ID":"efa07977-e2ef-4e3b-b6f7-f7b25320c947","Type":"ContainerStarted","Data":"c17d5670e38d49b8dca4d22a6f45516b4a684890677e75461c212459b1152b13"}
Jul 05 19:39:01.826390 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:39:01.826324    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f6b494dcc-rwhnk" podStartSLOduration=3.654180247 podStartE2EDuration="5.82630918s" totalImagesPullingTime="2.172128933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:39:01.825087273 +0000 UTC m=+391.219409954" watchObservedRunningTime="2026-07-05 19:39:01.82630918 +0000 UTC m=+391.220631862"
Jul 05 19:40:30.267731 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.267699    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"]
Jul 05 19:40:30.271813 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.271793    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"
Jul 05 19:40:30.274958 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.274935    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2mp84\""
Jul 05 19:40:30.275443 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.275425    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 05 19:40:30.275734 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.275720    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 05 19:40:30.280632 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.280613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"]
Jul 05 19:40:30.416415 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.416391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxghl\" (UniqueName: \"kubernetes.io/projected/5c112e41-0261-4ace-9a95-da329b9ba624-kube-api-access-hxghl\") pod \"authorino-operator-75cc8d5cb7-65zp9\" (UID: \"5c112e41-0261-4ace-9a95-da329b9ba624\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"
Jul 05 19:40:30.517198 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.517174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxghl\" (UniqueName: \"kubernetes.io/projected/5c112e41-0261-4ace-9a95-da329b9ba624-kube-api-access-hxghl\") pod \"authorino-operator-75cc8d5cb7-65zp9\" (UID: \"5c112e41-0261-4ace-9a95-da329b9ba624\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"
Jul 05 19:40:30.525581 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.525538    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxghl\" (UniqueName: \"kubernetes.io/projected/5c112e41-0261-4ace-9a95-da329b9ba624-kube-api-access-hxghl\") pod \"authorino-operator-75cc8d5cb7-65zp9\" (UID: \"5c112e41-0261-4ace-9a95-da329b9ba624\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"
Jul 05 19:40:30.584396 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.584377    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"
Jul 05 19:40:30.711114 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.711090    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"]
Jul 05 19:40:30.714068 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:40:30.714037    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c112e41_0261_4ace_9a95_da329b9ba624.slice/crio-0b42411c198612ce33eaa4cc8aea44519e6cd84e0189c6f5d2af5b932ece238b WatchSource:0}: Error finding container 0b42411c198612ce33eaa4cc8aea44519e6cd84e0189c6f5d2af5b932ece238b: Status 404 returned error can't find the container with id 0b42411c198612ce33eaa4cc8aea44519e6cd84e0189c6f5d2af5b932ece238b
Jul 05 19:40:30.896872 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.896848    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"]
Jul 05 19:40:30.901044 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.901030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:30.904244 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.904220    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 05 19:40:30.904395 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.904298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kb27n\""
Jul 05 19:40:30.904395 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.904363    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 05 19:40:30.920471 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:30.920450    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"]
Jul 05 19:40:31.021499 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.021461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6ca5a-fc5b-4711-957c-b819fa8454fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.021656 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.021543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fad6ca5a-fc5b-4711-957c-b819fa8454fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.021656 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.021615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwd4q\" (UniqueName: \"kubernetes.io/projected/fad6ca5a-fc5b-4711-957c-b819fa8454fd-kube-api-access-kwd4q\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.122701 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.122671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fad6ca5a-fc5b-4711-957c-b819fa8454fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.122843 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.122715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwd4q\" (UniqueName: \"kubernetes.io/projected/fad6ca5a-fc5b-4711-957c-b819fa8454fd-kube-api-access-kwd4q\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.122843 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.122763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6ca5a-fc5b-4711-957c-b819fa8454fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.125366 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.125335    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 05 19:40:31.125548 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.125534    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 05 19:40:31.130530 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.130513    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwd4q\" (UniqueName: \"kubernetes.io/projected/fad6ca5a-fc5b-4711-957c-b819fa8454fd-kube-api-access-kwd4q\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.133250 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:40:31.133237    2583 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 05 19:40:31.133340 ip-10-0-138-140 kubenswrapper[2583]: E0705 19:40:31.133306    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad6ca5a-fc5b-4711-957c-b819fa8454fd-plugin-serving-cert podName:fad6ca5a-fc5b-4711-957c-b819fa8454fd nodeName:}" failed. No retries permitted until 2026-07-05 19:40:31.633287203 +0000 UTC m=+481.027609863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/fad6ca5a-fc5b-4711-957c-b819fa8454fd-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-f6q4x" (UID: "fad6ca5a-fc5b-4711-957c-b819fa8454fd") : secret "plugin-serving-cert" not found
Jul 05 19:40:31.133756 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.133733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fad6ca5a-fc5b-4711-957c-b819fa8454fd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.203954 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.203883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9" event={"ID":"5c112e41-0261-4ace-9a95-da329b9ba624","Type":"ContainerStarted","Data":"0b42411c198612ce33eaa4cc8aea44519e6cd84e0189c6f5d2af5b932ece238b"}
Jul 05 19:40:31.729320 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.729291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6ca5a-fc5b-4711-957c-b819fa8454fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.732370 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.732323    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fad6ca5a-fc5b-4711-957c-b819fa8454fd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-f6q4x\" (UID: \"fad6ca5a-fc5b-4711-957c-b819fa8454fd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.812894 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.812849    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kb27n\""
Jul 05 19:40:31.820416 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.820384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"
Jul 05 19:40:31.968234 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:31.968197    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x"]
Jul 05 19:40:31.974498 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:40:31.974468    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfad6ca5a_fc5b_4711_957c_b819fa8454fd.slice/crio-5564dc50b53f5dd708700a18f3629ce1410467aecb1d66b4f44f17eacf05543a WatchSource:0}: Error finding container 5564dc50b53f5dd708700a18f3629ce1410467aecb1d66b4f44f17eacf05543a: Status 404 returned error can't find the container with id 5564dc50b53f5dd708700a18f3629ce1410467aecb1d66b4f44f17eacf05543a
Jul 05 19:40:32.209321 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:32.209288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x" event={"ID":"fad6ca5a-fc5b-4711-957c-b819fa8454fd","Type":"ContainerStarted","Data":"5564dc50b53f5dd708700a18f3629ce1410467aecb1d66b4f44f17eacf05543a"}
Jul 05 19:40:33.215125 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:33.215086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9" event={"ID":"5c112e41-0261-4ace-9a95-da329b9ba624","Type":"ContainerStarted","Data":"5ea0841a95c7ad74b9a8ef468906f84fdb291cabbd442e33bb654da03ccfdeb5"}
Jul 05 19:40:33.215564 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:33.215214    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"
Jul 05 19:40:33.233651 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:33.233606    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9" podStartSLOduration=0.962295168 podStartE2EDuration="3.233591318s" totalImagesPullingTime="2.27129615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:33.232222492 +0000 UTC m=+482.626545174" watchObservedRunningTime="2026-07-05 19:40:33.233591318 +0000 UTC m=+482.627914028"
Jul 05 19:40:44.224842 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:44.224804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-65zp9"
Jul 05 19:40:54.320226 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:54.320179    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x" event={"ID":"fad6ca5a-fc5b-4711-957c-b819fa8454fd","Type":"ContainerStarted","Data":"f44a62a0db411ce2980cbf52ae283ae19bf25f6211733ce2816818413d9fc0fd"}
Jul 05 19:40:54.338246 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:40:54.338190    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-f6q4x" podStartSLOduration=2.220308158 podStartE2EDuration="24.338176421s" totalImagesPullingTime="22.117868263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:40:54.336488831 +0000 UTC m=+503.730811511" watchObservedRunningTime="2026-07-05 19:40:54.338176421 +0000 UTC m=+503.732499119"
Jul 05 19:43:06.587765 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.587726    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"]
Jul 05 19:43:06.590870 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.590849    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.593787 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.593768    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 05 19:43:06.593892 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.593773    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nd7wp\""
Jul 05 19:43:06.595251 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.595232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 05 19:43:06.595344 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.595326    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 05 19:43:06.599288 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.599246    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"]
Jul 05 19:43:06.610089 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.610059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.610265 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.610101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112ea727-a1d1-43e3-8b85-f0955899bbcb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.610265 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.610129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.610265 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.610239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.610449 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.610317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.610449 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.610352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxbwm\" (UniqueName: \"kubernetes.io/projected/112ea727-a1d1-43e3-8b85-f0955899bbcb-kube-api-access-hxbwm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711342 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711342 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxbwm\" (UniqueName: \"kubernetes.io/projected/112ea727-a1d1-43e3-8b85-f0955899bbcb-kube-api-access-hxbwm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711583 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711558    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112ea727-a1d1-43e3-8b85-f0955899bbcb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711742 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711797 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711738    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711854 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711821    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.711995 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.711972    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.713667 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.713644    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/112ea727-a1d1-43e3-8b85-f0955899bbcb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.714057 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.714034    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/112ea727-a1d1-43e3-8b85-f0955899bbcb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.719928 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.719902    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxbwm\" (UniqueName: \"kubernetes.io/projected/112ea727-a1d1-43e3-8b85-f0955899bbcb-kube-api-access-hxbwm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5hx2z\" (UID: \"112ea727-a1d1-43e3-8b85-f0955899bbcb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:06.902375 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:06.902335    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:07.036430 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:07.036402    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"]
Jul 05 19:43:07.038946 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:43:07.038920    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112ea727_a1d1_43e3_8b85_f0955899bbcb.slice/crio-35890e138c79b35903d900755100829425e81f23ebf331dd0305cf294f542136 WatchSource:0}: Error finding container 35890e138c79b35903d900755100829425e81f23ebf331dd0305cf294f542136: Status 404 returned error can't find the container with id 35890e138c79b35903d900755100829425e81f23ebf331dd0305cf294f542136
Jul 05 19:43:07.040255 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:07.040235    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 19:43:07.907508 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:07.907471    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z" event={"ID":"112ea727-a1d1-43e3-8b85-f0955899bbcb","Type":"ContainerStarted","Data":"35890e138c79b35903d900755100829425e81f23ebf331dd0305cf294f542136"}
Jul 05 19:43:08.914045 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:08.914004    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z" event={"ID":"112ea727-a1d1-43e3-8b85-f0955899bbcb","Type":"ContainerStarted","Data":"55100933b760488c0e82d169d14ebcb8cd7dd3fc722779dac1f47c321d134a65"}
Jul 05 19:43:08.933383 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:08.933298    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z" podStartSLOduration=1.925545573 podStartE2EDuration="2.933256534s" totalImagesPullingTime="1.007710961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:43:08.932674124 +0000 UTC m=+638.326996833" watchObservedRunningTime="2026-07-05 19:43:08.933256534 +0000 UTC m=+638.327579215"
Jul 05 19:43:16.903292 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:16.903228    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:16.903749 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:16.903319    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:16.915960 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:16.915924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:16.960662 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:16.960628    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5hx2z"
Jul 05 19:43:32.095874 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.095831    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"]
Jul 05 19:43:32.099458 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.099434    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.102151 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.102131    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 05 19:43:32.112296 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.111479    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"]
Jul 05 19:43:32.245672 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.245605    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e268a75-c864-4c24-ae13-88eb68f3ced1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.245672 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.245676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjf6g\" (UniqueName: \"kubernetes.io/projected/1e268a75-c864-4c24-ae13-88eb68f3ced1-kube-api-access-vjf6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.245949 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.245708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.245949 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.245726    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.246072 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.245959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.246072 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.246064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.346644 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.346547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.346644 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.346600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e268a75-c864-4c24-ae13-88eb68f3ced1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.346644 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.346630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjf6g\" (UniqueName: \"kubernetes.io/projected/1e268a75-c864-4c24-ae13-88eb68f3ced1-kube-api-access-vjf6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.346928 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.346655    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.346928 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.346679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.346928 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.346724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.347062 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.347021    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.347062 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.347045    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.347171 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.347067    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.348956 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.348935    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e268a75-c864-4c24-ae13-88eb68f3ced1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.349128 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.349109    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e268a75-c864-4c24-ae13-88eb68f3ced1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.355212 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.355180    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjf6g\" (UniqueName: \"kubernetes.io/projected/1e268a75-c864-4c24-ae13-88eb68f3ced1-kube-api-access-vjf6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh\" (UID: \"1e268a75-c864-4c24-ae13-88eb68f3ced1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.410976 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.410921    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:32.545107 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:32.545073    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"]
Jul 05 19:43:32.549523 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:43:32.549495    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e268a75_c864_4c24_ae13_88eb68f3ced1.slice/crio-98903d86511c7eb8669ef9cfd2f2f72b79aa93f332625a75661c0512a9647ce4 WatchSource:0}: Error finding container 98903d86511c7eb8669ef9cfd2f2f72b79aa93f332625a75661c0512a9647ce4: Status 404 returned error can't find the container with id 98903d86511c7eb8669ef9cfd2f2f72b79aa93f332625a75661c0512a9647ce4
Jul 05 19:43:33.024502 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:33.024401    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh" event={"ID":"1e268a75-c864-4c24-ae13-88eb68f3ced1","Type":"ContainerStarted","Data":"ece3db90bf815f7082e3e50cb2999f4cc36ef56f54a9ce800d5180be599f32ec"}
Jul 05 19:43:33.024502 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:33.024463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh" event={"ID":"1e268a75-c864-4c24-ae13-88eb68f3ced1","Type":"ContainerStarted","Data":"98903d86511c7eb8669ef9cfd2f2f72b79aa93f332625a75661c0512a9647ce4"}
Jul 05 19:43:33.043665 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:33.043607    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh" podStartSLOduration=0.861880895 podStartE2EDuration="1.043589824s" totalImagesPullingTime="181.708929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:43:33.041458225 +0000 UTC m=+662.435780927" watchObservedRunningTime="2026-07-05 19:43:33.043589824 +0000 UTC m=+662.437912507"
Jul 05 19:43:42.411958 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:42.411909    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:42.412437 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:42.412026    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:42.424427 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:42.424395    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:43.083685 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:43.083658    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh"
Jul 05 19:43:54.592158 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.592122    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"]
Jul 05 19:43:54.595922 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.595900    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.598920 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.598900    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 05 19:43:54.606788 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.606760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"]
Jul 05 19:43:54.641982 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.641941    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.641982 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.641988    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61de2171-0416-43dd-8315-701fd9111498-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.642219 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.642019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.642219 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.642078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfr5r\" (UniqueName: \"kubernetes.io/projected/61de2171-0416-43dd-8315-701fd9111498-kube-api-access-nfr5r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.642219 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.642146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.642219 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.642184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743392 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743406    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfr5r\" (UniqueName: \"kubernetes.io/projected/61de2171-0416-43dd-8315-701fd9111498-kube-api-access-nfr5r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743819 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61de2171-0416-43dd-8315-701fd9111498-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743874 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743812    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.743928 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743902    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.744004 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.743981    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.745957 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.745925    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61de2171-0416-43dd-8315-701fd9111498-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.746158 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.746142    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61de2171-0416-43dd-8315-701fd9111498-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.752063 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.752037    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfr5r\" (UniqueName: \"kubernetes.io/projected/61de2171-0416-43dd-8315-701fd9111498-kube-api-access-nfr5r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lt5jp\" (UID: \"61de2171-0416-43dd-8315-701fd9111498\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:54.908078 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:54.908035    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:43:55.048635 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:55.048603    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"]
Jul 05 19:43:55.050933 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:43:55.050904    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61de2171_0416_43dd_8315_701fd9111498.slice/crio-fcb9b4ef777e2bfcf4d8c841d2022fcb28092e13c4c3868d1ef89a20bcdadec1 WatchSource:0}: Error finding container fcb9b4ef777e2bfcf4d8c841d2022fcb28092e13c4c3868d1ef89a20bcdadec1: Status 404 returned error can't find the container with id fcb9b4ef777e2bfcf4d8c841d2022fcb28092e13c4c3868d1ef89a20bcdadec1
Jul 05 19:43:55.130737 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:55.130701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp" event={"ID":"61de2171-0416-43dd-8315-701fd9111498","Type":"ContainerStarted","Data":"fcb9b4ef777e2bfcf4d8c841d2022fcb28092e13c4c3868d1ef89a20bcdadec1"}
Jul 05 19:43:56.136406 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:56.136373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp" event={"ID":"61de2171-0416-43dd-8315-701fd9111498","Type":"ContainerStarted","Data":"f5ae5a883aa1ee6107e4b8f00c347113788a01faa4de4f57d5918bd16b8704e1"}
Jul 05 19:43:56.155856 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:43:56.155801    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp" podStartSLOduration=1.981530474 podStartE2EDuration="2.155785147s" totalImagesPullingTime="174.254673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:43:56.153634558 +0000 UTC m=+685.547957238" watchObservedRunningTime="2026-07-05 19:43:56.155785147 +0000 UTC m=+685.550107826"
Jul 05 19:44:01.882120 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:01.882085    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"]
Jul 05 19:44:01.885477 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:01.885456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:01.888950 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:01.888930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 05 19:44:01.895699 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:01.895674    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"]
Jul 05 19:44:02.011385 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.011339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.011573 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.011400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.011573 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.011459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.011573 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.011534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2s6l\" (UniqueName: \"kubernetes.io/projected/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-kube-api-access-g2s6l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.011702 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.011615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.011702 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.011638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112082 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2s6l\" (UniqueName: \"kubernetes.io/projected/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-kube-api-access-g2s6l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112295 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112116    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112295 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112295 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112295 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112515 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112643 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112618    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112704 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112672    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.112741 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.112716    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.114566 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.114547    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.114827 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.114808    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.119962 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.119937    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2s6l\" (UniqueName: \"kubernetes.io/projected/14dddbdb-ebc6-441f-8e7b-3857ec9b83df-kube-api-access-g2s6l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8\" (UID: \"14dddbdb-ebc6-441f-8e7b-3857ec9b83df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.195791 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.195678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:02.333294 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:02.333254    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"]
Jul 05 19:44:02.335457 ip-10-0-138-140 kubenswrapper[2583]: W0705 19:44:02.335433    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14dddbdb_ebc6_441f_8e7b_3857ec9b83df.slice/crio-e94dc215f76193ff9292baf7619490898f0cde06617a816e7e44866faf5d6cd8 WatchSource:0}: Error finding container e94dc215f76193ff9292baf7619490898f0cde06617a816e7e44866faf5d6cd8: Status 404 returned error can't find the container with id e94dc215f76193ff9292baf7619490898f0cde06617a816e7e44866faf5d6cd8
Jul 05 19:44:03.170096 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:03.170055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8" event={"ID":"14dddbdb-ebc6-441f-8e7b-3857ec9b83df","Type":"ContainerStarted","Data":"14050193e77e3251398aed4b6f74b6a8a0f67e81405d03013f2062398b9dd2e7"}
Jul 05 19:44:03.170597 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:03.170107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8" event={"ID":"14dddbdb-ebc6-441f-8e7b-3857ec9b83df","Type":"ContainerStarted","Data":"e94dc215f76193ff9292baf7619490898f0cde06617a816e7e44866faf5d6cd8"}
Jul 05 19:44:03.188149 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:03.188091    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8" podStartSLOduration=2.024235906 podStartE2EDuration="2.188075067s" totalImagesPullingTime="163.839161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 19:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 19:44:03.186974378 +0000 UTC m=+692.581297061" watchObservedRunningTime="2026-07-05 19:44:03.188075067 +0000 UTC m=+692.582397748"
Jul 05 19:44:04.909033 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:04.908989    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:44:04.909455 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:04.909076    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:44:04.921728 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:04.921702    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:44:05.190990 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:05.190892    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lt5jp"
Jul 05 19:44:12.196340 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:12.196305    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:12.196340 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:12.196347    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:12.209047 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:12.209019    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 19:44:12.221734 ip-10-0-138-140 kubenswrapper[2583]: I0705 19:44:12.221711    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8"
Jul 05 20:04:22.683827 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.683785    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"]
Jul 05 20:04:22.687491 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.687471    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.691507 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.691478    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8dc0f0\"/\"kube-root-ca.crt\""
Jul 05 20:04:22.691654 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.691481    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8dc0f0\"/\"openshift-service-ca.crt\""
Jul 05 20:04:22.691654 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.691483    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8dc0f0\"/\"default-dockercfg-njkfx\""
Jul 05 20:04:22.691654 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.691483    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8dc0f0\"/\"test-model-8dc0f0-kserve-self-signed-certs\""
Jul 05 20:04:22.695457 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.695435    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"]
Jul 05 20:04:22.745676 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.745645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-tmp-dir\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.745676 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.745681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k5kd\" (UniqueName: \"kubernetes.io/projected/d4dae43b-fb96-4d8f-99bd-42240b373757-kube-api-access-5k5kd\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.745915 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.745725    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-home\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.745915 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.745752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-model-cache\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.745915 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.745773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-dshm\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.745915 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.745861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4dae43b-fb96-4d8f-99bd-42240b373757-tls-certs\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.846725 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.846683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-dshm\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.846936 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.846741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4dae43b-fb96-4d8f-99bd-42240b373757-tls-certs\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.846936 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.846802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-tmp-dir\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.846936 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.846822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k5kd\" (UniqueName: \"kubernetes.io/projected/d4dae43b-fb96-4d8f-99bd-42240b373757-kube-api-access-5k5kd\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.846936 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.846864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-home\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.846936 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.846885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-model-cache\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.847236 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.847211    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-tmp-dir\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.847320 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.847251    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-home\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.847380 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.847333    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-model-cache\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.849666 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.849641    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-dshm\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.849891 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.849872    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4dae43b-fb96-4d8f-99bd-42240b373757-tls-certs\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.854528 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.854505    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k5kd\" (UniqueName: \"kubernetes.io/projected/d4dae43b-fb96-4d8f-99bd-42240b373757-kube-api-access-5k5kd\") pod \"test-model-8dc0f0-kserve-56c875b555-svjlw\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") " pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:22.997383 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:22.997255    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:23.137196 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:23.137172    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"]
Jul 05 20:04:23.139466 ip-10-0-138-140 kubenswrapper[2583]: W0705 20:04:23.139436    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4dae43b_fb96_4d8f_99bd_42240b373757.slice/crio-52fa5e1f5cb3fe7a6dbfe180ae7109d8e6aef4317745da1b67b813bbd02dc496 WatchSource:0}: Error finding container 52fa5e1f5cb3fe7a6dbfe180ae7109d8e6aef4317745da1b67b813bbd02dc496: Status 404 returned error can't find the container with id 52fa5e1f5cb3fe7a6dbfe180ae7109d8e6aef4317745da1b67b813bbd02dc496
Jul 05 20:04:23.796690 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:23.796654    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw" event={"ID":"d4dae43b-fb96-4d8f-99bd-42240b373757","Type":"ContainerStarted","Data":"216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f"}
Jul 05 20:04:23.797106 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:23.796699    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw" event={"ID":"d4dae43b-fb96-4d8f-99bd-42240b373757","Type":"ContainerStarted","Data":"52fa5e1f5cb3fe7a6dbfe180ae7109d8e6aef4317745da1b67b813bbd02dc496"}
Jul 05 20:04:23.814317 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:23.814248    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw" podStartSLOduration=1.8142309110000001 podStartE2EDuration="1.814230911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:23.812652536 +0000 UTC m=+1913.206975241" watchObservedRunningTime="2026-07-05 20:04:23.814230911 +0000 UTC m=+1913.208553570"
Jul 05 20:04:32.997943 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:32.997901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:32.998389 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:32.997962    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:33.010567 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:33.010537    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:33.852401 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:33.852373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:04:57.436854 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.436818    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"]
Jul 05 20:04:57.440366 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.440344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.446254 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.446221    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b14b17\"/\"openshift-service-ca.crt\""
Jul 05 20:04:57.446436 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.446291    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b14b17\"/\"kube-root-ca.crt\""
Jul 05 20:04:57.446436 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.446301    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b14b17\"/\"default-dockercfg-qm6g6\""
Jul 05 20:04:57.446436 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.446349    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b14b17\"/\"test-model-b14b17-kserve-self-signed-certs\""
Jul 05 20:04:57.456079 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.456050    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"]
Jul 05 20:04:57.574923 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.574880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81f1e8-449e-418a-8060-316e6828998a-tls-certs\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.574923 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.574931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-home\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.575152 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.574947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-model-cache\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.575152 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.575115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-dshm\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.575152 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.575145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-tmp-dir\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.575253 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.575163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j85v4\" (UniqueName: \"kubernetes.io/projected/cf81f1e8-449e-418a-8060-316e6828998a-kube-api-access-j85v4\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676255 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-tmp-dir\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676255 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85v4\" (UniqueName: \"kubernetes.io/projected/cf81f1e8-449e-418a-8060-316e6828998a-kube-api-access-j85v4\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676507 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81f1e8-449e-418a-8060-316e6828998a-tls-certs\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676507 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676355    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-home\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676507 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-model-cache\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676507 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-dshm\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676752 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676731    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-home\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676815 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676733    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-tmp-dir\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.676815 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.676776    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-model-cache\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.678737 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.678712    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-dshm\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.678928 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.678912    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81f1e8-449e-418a-8060-316e6828998a-tls-certs\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.685293 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.685240    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j85v4\" (UniqueName: \"kubernetes.io/projected/cf81f1e8-449e-418a-8060-316e6828998a-kube-api-access-j85v4\") pod \"test-model-b14b17-kserve-78899d8dc5-qhnkm\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") " pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.749492 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.749396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:04:57.882836 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.882809    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"]
Jul 05 20:04:57.884884 ip-10-0-138-140 kubenswrapper[2583]: W0705 20:04:57.884857    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf81f1e8_449e_418a_8060_316e6828998a.slice/crio-3b4aa08e0806ed8a292ccd7e7de17f30f2561b6a5ee340de6927f69eaa31646f WatchSource:0}: Error finding container 3b4aa08e0806ed8a292ccd7e7de17f30f2561b6a5ee340de6927f69eaa31646f: Status 404 returned error can't find the container with id 3b4aa08e0806ed8a292ccd7e7de17f30f2561b6a5ee340de6927f69eaa31646f
Jul 05 20:04:57.959097 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.959066    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm" event={"ID":"cf81f1e8-449e-418a-8060-316e6828998a","Type":"ContainerStarted","Data":"fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080"}
Jul 05 20:04:57.959262 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.959109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm" event={"ID":"cf81f1e8-449e-418a-8060-316e6828998a","Type":"ContainerStarted","Data":"3b4aa08e0806ed8a292ccd7e7de17f30f2561b6a5ee340de6927f69eaa31646f"}
Jul 05 20:04:57.976724 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:04:57.976480    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm" podStartSLOduration=0.976457224 podStartE2EDuration="976.457224ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:04:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:04:57.975872915 +0000 UTC m=+1947.370195599" watchObservedRunningTime="2026-07-05 20:04:57.976457224 +0000 UTC m=+1947.370779906"
Jul 05 20:05:07.749587 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:07.749547    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:05:07.749992 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:07.749611    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:05:07.761704 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:07.761675    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:05:08.016994 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:08.016905    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:05:19.406918 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:19.406643    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"]
Jul 05 20:05:20.405881 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:20.405842    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"]
Jul 05 20:05:34.428560 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.428444    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw" podUID="d4dae43b-fb96-4d8f-99bd-42240b373757" containerName="main" containerID="cri-o://216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f" gracePeriod=45
Jul 05 20:05:34.685009 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.684939    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:05:34.840038 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.839995    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k5kd\" (UniqueName: \"kubernetes.io/projected/d4dae43b-fb96-4d8f-99bd-42240b373757-kube-api-access-5k5kd\") pod \"d4dae43b-fb96-4d8f-99bd-42240b373757\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") "
Jul 05 20:05:34.840240 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840055    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-dshm\") pod \"d4dae43b-fb96-4d8f-99bd-42240b373757\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") "
Jul 05 20:05:34.840240 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840080    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-model-cache\") pod \"d4dae43b-fb96-4d8f-99bd-42240b373757\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") "
Jul 05 20:05:34.840240 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840165    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-tmp-dir\") pod \"d4dae43b-fb96-4d8f-99bd-42240b373757\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") "
Jul 05 20:05:34.840240 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840207    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-home\") pod \"d4dae43b-fb96-4d8f-99bd-42240b373757\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") "
Jul 05 20:05:34.840240 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840229    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4dae43b-fb96-4d8f-99bd-42240b373757-tls-certs\") pod \"d4dae43b-fb96-4d8f-99bd-42240b373757\" (UID: \"d4dae43b-fb96-4d8f-99bd-42240b373757\") "
Jul 05 20:05:34.840572 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840466    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-model-cache" (OuterVolumeSpecName: "model-cache") pod "d4dae43b-fb96-4d8f-99bd-42240b373757" (UID: "d4dae43b-fb96-4d8f-99bd-42240b373757"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:34.840572 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840479    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d4dae43b-fb96-4d8f-99bd-42240b373757" (UID: "d4dae43b-fb96-4d8f-99bd-42240b373757"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:34.840572 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840490    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-home" (OuterVolumeSpecName: "home") pod "d4dae43b-fb96-4d8f-99bd-42240b373757" (UID: "d4dae43b-fb96-4d8f-99bd-42240b373757"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:34.840691 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840673    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-model-cache\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:34.840937 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840697    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-tmp-dir\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:34.840937 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.840711    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-home\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:34.842566 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.842539    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-dshm" (OuterVolumeSpecName: "dshm") pod "d4dae43b-fb96-4d8f-99bd-42240b373757" (UID: "d4dae43b-fb96-4d8f-99bd-42240b373757"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:34.842566 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.842553    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4dae43b-fb96-4d8f-99bd-42240b373757-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d4dae43b-fb96-4d8f-99bd-42240b373757" (UID: "d4dae43b-fb96-4d8f-99bd-42240b373757"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:05:34.842712 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.842567    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4dae43b-fb96-4d8f-99bd-42240b373757-kube-api-access-5k5kd" (OuterVolumeSpecName: "kube-api-access-5k5kd") pod "d4dae43b-fb96-4d8f-99bd-42240b373757" (UID: "d4dae43b-fb96-4d8f-99bd-42240b373757"). InnerVolumeSpecName "kube-api-access-5k5kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:05:34.941784 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.941695    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4dae43b-fb96-4d8f-99bd-42240b373757-tls-certs\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:34.941784 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.941726    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k5kd\" (UniqueName: \"kubernetes.io/projected/d4dae43b-fb96-4d8f-99bd-42240b373757-kube-api-access-5k5kd\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:34.941784 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:34.941736    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4dae43b-fb96-4d8f-99bd-42240b373757-dshm\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:35.135781 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.135749    2583 generic.go:356] "Generic (PLEG): container finished" podID="d4dae43b-fb96-4d8f-99bd-42240b373757" containerID="216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f" exitCode=0
Jul 05 20:05:35.135957 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.135788    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"
Jul 05 20:05:35.135957 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.135826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw" event={"ID":"d4dae43b-fb96-4d8f-99bd-42240b373757","Type":"ContainerDied","Data":"216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f"}
Jul 05 20:05:35.135957 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.135875    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw" event={"ID":"d4dae43b-fb96-4d8f-99bd-42240b373757","Type":"ContainerDied","Data":"52fa5e1f5cb3fe7a6dbfe180ae7109d8e6aef4317745da1b67b813bbd02dc496"}
Jul 05 20:05:35.135957 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.135893    2583 scope.go:117] "RemoveContainer" containerID="216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f"
Jul 05 20:05:35.144886 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.144866    2583 scope.go:117] "RemoveContainer" containerID="216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f"
Jul 05 20:05:35.145146 ip-10-0-138-140 kubenswrapper[2583]: E0705 20:05:35.145128    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f\": container with ID starting with 216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f not found: ID does not exist" containerID="216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f"
Jul 05 20:05:35.145190 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.145158    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f"} err="failed to get container status \"216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f\": rpc error: code = NotFound desc = could not find container \"216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f\": container with ID starting with 216d8a864b1b7cd5b9ae6e0e26b23c45432d0d80df5e4a6bc3babd43cd491a9f not found: ID does not exist"
Jul 05 20:05:35.153548 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.153525    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"]
Jul 05 20:05:35.156024 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.156001    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8dc0f0/test-model-8dc0f0-kserve-56c875b555-svjlw"]
Jul 05 20:05:35.427328 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.427258    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm" podUID="cf81f1e8-449e-418a-8060-316e6828998a" containerName="main" containerID="cri-o://fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080" gracePeriod=45
Jul 05 20:05:35.689712 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.689649    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:05:35.850467 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850436    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-model-cache\") pod \"cf81f1e8-449e-418a-8060-316e6828998a\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") "
Jul 05 20:05:35.850684 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850476    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-dshm\") pod \"cf81f1e8-449e-418a-8060-316e6828998a\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") "
Jul 05 20:05:35.850684 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850509    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81f1e8-449e-418a-8060-316e6828998a-tls-certs\") pod \"cf81f1e8-449e-418a-8060-316e6828998a\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") "
Jul 05 20:05:35.850684 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850566    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-tmp-dir\") pod \"cf81f1e8-449e-418a-8060-316e6828998a\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") "
Jul 05 20:05:35.850684 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850650    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-home\") pod \"cf81f1e8-449e-418a-8060-316e6828998a\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") "
Jul 05 20:05:35.850684 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j85v4\" (UniqueName: \"kubernetes.io/projected/cf81f1e8-449e-418a-8060-316e6828998a-kube-api-access-j85v4\") pod \"cf81f1e8-449e-418a-8060-316e6828998a\" (UID: \"cf81f1e8-449e-418a-8060-316e6828998a\") "
Jul 05 20:05:35.850944 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850782    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf81f1e8-449e-418a-8060-316e6828998a" (UID: "cf81f1e8-449e-418a-8060-316e6828998a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:35.850944 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850893    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf81f1e8-449e-418a-8060-316e6828998a" (UID: "cf81f1e8-449e-418a-8060-316e6828998a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:35.850944 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.850924    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-home" (OuterVolumeSpecName: "home") pod "cf81f1e8-449e-418a-8060-316e6828998a" (UID: "cf81f1e8-449e-418a-8060-316e6828998a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:35.851097 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.851071    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-home\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:35.851097 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.851099    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-model-cache\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:35.851332 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.851130    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-tmp-dir\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:35.852953 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.852925    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf81f1e8-449e-418a-8060-316e6828998a-kube-api-access-j85v4" (OuterVolumeSpecName: "kube-api-access-j85v4") pod "cf81f1e8-449e-418a-8060-316e6828998a" (UID: "cf81f1e8-449e-418a-8060-316e6828998a"). InnerVolumeSpecName "kube-api-access-j85v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:05:35.853168 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.853149    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-dshm" (OuterVolumeSpecName: "dshm") pod "cf81f1e8-449e-418a-8060-316e6828998a" (UID: "cf81f1e8-449e-418a-8060-316e6828998a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:05:35.853231 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.853164    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf81f1e8-449e-418a-8060-316e6828998a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf81f1e8-449e-418a-8060-316e6828998a" (UID: "cf81f1e8-449e-418a-8060-316e6828998a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:05:35.952165 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.952072    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j85v4\" (UniqueName: \"kubernetes.io/projected/cf81f1e8-449e-418a-8060-316e6828998a-kube-api-access-j85v4\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:35.952165 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.952106    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf81f1e8-449e-418a-8060-316e6828998a-dshm\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:35.952165 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:35.952119    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81f1e8-449e-418a-8060-316e6828998a-tls-certs\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:05:36.143233 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.143190    2583 generic.go:356] "Generic (PLEG): container finished" podID="cf81f1e8-449e-418a-8060-316e6828998a" containerID="fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080" exitCode=0
Jul 05 20:05:36.143233 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.143239    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"
Jul 05 20:05:36.143456 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.143299    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm" event={"ID":"cf81f1e8-449e-418a-8060-316e6828998a","Type":"ContainerDied","Data":"fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080"}
Jul 05 20:05:36.143456 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.143347    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm" event={"ID":"cf81f1e8-449e-418a-8060-316e6828998a","Type":"ContainerDied","Data":"3b4aa08e0806ed8a292ccd7e7de17f30f2561b6a5ee340de6927f69eaa31646f"}
Jul 05 20:05:36.143456 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.143368    2583 scope.go:117] "RemoveContainer" containerID="fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080"
Jul 05 20:05:36.152347 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.152328    2583 scope.go:117] "RemoveContainer" containerID="fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080"
Jul 05 20:05:36.152621 ip-10-0-138-140 kubenswrapper[2583]: E0705 20:05:36.152598    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080\": container with ID starting with fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080 not found: ID does not exist" containerID="fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080"
Jul 05 20:05:36.152671 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.152631    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080"} err="failed to get container status \"fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080\": rpc error: code = NotFound desc = could not find container \"fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080\": container with ID starting with fb3b4695651832a1bdea4befb7d13bfeb8d89258a566f698ef883c4cee86b080 not found: ID does not exist"
Jul 05 20:05:36.164444 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.164414    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"]
Jul 05 20:05:36.166456 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:36.166435    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b14b17/test-model-b14b17-kserve-78899d8dc5-qhnkm"]
Jul 05 20:05:37.123091 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:37.123060    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf81f1e8-449e-418a-8060-316e6828998a" path="/var/lib/kubelet/pods/cf81f1e8-449e-418a-8060-316e6828998a/volumes"
Jul 05 20:05:37.123505 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:05:37.123454    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4dae43b-fb96-4d8f-99bd-42240b373757" path="/var/lib/kubelet/pods/d4dae43b-fb96-4d8f-99bd-42240b373757/volumes"
Jul 05 20:09:52.980617 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.980541    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"]
Jul 05 20:09:52.981074 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.980989    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf81f1e8-449e-418a-8060-316e6828998a" containerName="main"
Jul 05 20:09:52.981074 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.981004    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf81f1e8-449e-418a-8060-316e6828998a" containerName="main"
Jul 05 20:09:52.981074 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.981019    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4dae43b-fb96-4d8f-99bd-42240b373757" containerName="main"
Jul 05 20:09:52.981074 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.981025    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4dae43b-fb96-4d8f-99bd-42240b373757" containerName="main"
Jul 05 20:09:52.981206 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.981092    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf81f1e8-449e-418a-8060-316e6828998a" containerName="main"
Jul 05 20:09:52.981206 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.981100    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4dae43b-fb96-4d8f-99bd-42240b373757" containerName="main"
Jul 05 20:09:52.984066 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.984048    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:52.986941 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.986923    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"kube-root-ca.crt\""
Jul 05 20:09:52.988277 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.988246    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"sub-test-model-d9296f-kserve-self-signed-certs\""
Jul 05 20:09:52.988357 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.988333    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"openshift-service-ca.crt\""
Jul 05 20:09:52.988357 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.988342    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d9296f\"/\"default-dockercfg-rkkhx\""
Jul 05 20:09:52.992871 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:52.992848    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"]
Jul 05 20:09:53.130987 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.130947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tmp-dir\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.131150 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.131009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-dshm\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.131150 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.131112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-model-cache\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.131150 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.131139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tls-certs\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.131351 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.131235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6v9z\" (UniqueName: \"kubernetes.io/projected/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-kube-api-access-l6v9z\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.131351 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.131315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-home\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232260 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232180    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-model-cache\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232260 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tls-certs\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232260 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6v9z\" (UniqueName: \"kubernetes.io/projected/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-kube-api-access-l6v9z\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232543 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-home\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232543 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tmp-dir\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232543 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-dshm\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232705 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232619    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-model-cache\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232705 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232695    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-home\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.232784 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.232759    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tmp-dir\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.234545 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.234514    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-dshm\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.234652 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.234598    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tls-certs\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.239912 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.239890    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6v9z\" (UniqueName: \"kubernetes.io/projected/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-kube-api-access-l6v9z\") pod \"sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") " pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.294029 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.294007    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:09:53.420459 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:53.420435    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"]
Jul 05 20:09:53.422816 ip-10-0-138-140 kubenswrapper[2583]: W0705 20:09:53.422792    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05ae0921_0d55_4b24_9adf_2ff95f0ff4c5.slice/crio-a98865843323c22a5a2ec7207ef7b031f426b1d8f4555da4028487cdbfdaa9a5 WatchSource:0}: Error finding container a98865843323c22a5a2ec7207ef7b031f426b1d8f4555da4028487cdbfdaa9a5: Status 404 returned error can't find the container with id a98865843323c22a5a2ec7207ef7b031f426b1d8f4555da4028487cdbfdaa9a5
Jul 05 20:09:54.322208 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:54.322171    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp" event={"ID":"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5","Type":"ContainerStarted","Data":"cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db"}
Jul 05 20:09:54.322614 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:54.322222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp" event={"ID":"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5","Type":"ContainerStarted","Data":"a98865843323c22a5a2ec7207ef7b031f426b1d8f4555da4028487cdbfdaa9a5"}
Jul 05 20:09:54.340542 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:09:54.340497    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp" podStartSLOduration=2.340482003 podStartE2EDuration="2.340482003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 20:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:09:54.339356891 +0000 UTC m=+2243.733679573" watchObservedRunningTime="2026-07-05 20:09:54.340482003 +0000 UTC m=+2243.734804685"
Jul 05 20:10:03.294331 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:10:03.294286    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:10:03.294703 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:10:03.294353    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:10:03.306565 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:10:03.306542    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:10:03.372283 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:10:03.372250    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:11:03.006336 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:03.006290    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"]
Jul 05 20:11:18.027677 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.027635    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp" podUID="05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" containerName="main" containerID="cri-o://cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db" gracePeriod=45
Jul 05 20:11:18.266664 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.266643    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:11:18.299626 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299562    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tmp-dir\") pod \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") "
Jul 05 20:11:18.299730 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299635    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-model-cache\") pod \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") "
Jul 05 20:11:18.299730 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299661    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-home\") pod \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") "
Jul 05 20:11:18.299730 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299716    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tls-certs\") pod \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") "
Jul 05 20:11:18.299893 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299768    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-dshm\") pod \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") "
Jul 05 20:11:18.299893 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299779    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" (UID: "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:18.299893 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299824    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6v9z\" (UniqueName: \"kubernetes.io/projected/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-kube-api-access-l6v9z\") pod \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\" (UID: \"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5\") "
Jul 05 20:11:18.299893 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299857    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" (UID: "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:18.300090 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.299985    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-home" (OuterVolumeSpecName: "home") pod "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" (UID: "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:18.300142 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.300132    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-model-cache\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:11:18.300197 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.300150    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-home\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:11:18.300197 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.300166    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tmp-dir\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:11:18.301774 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.301726    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-dshm" (OuterVolumeSpecName: "dshm") pod "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" (UID: "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 20:11:18.301892 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.301807    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" (UID: "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 20:11:18.302191 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.302170    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-kube-api-access-l6v9z" (OuterVolumeSpecName: "kube-api-access-l6v9z") pod "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" (UID: "05ae0921-0d55-4b24-9adf-2ff95f0ff4c5"). InnerVolumeSpecName "kube-api-access-l6v9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 20:11:18.400937 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.400915    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-tls-certs\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:11:18.400937 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.400935    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-dshm\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:11:18.401085 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.400945    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6v9z\" (UniqueName: \"kubernetes.io/projected/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5-kube-api-access-l6v9z\") on node \"ip-10-0-138-140.ec2.internal\" DevicePath \"\""
Jul 05 20:11:18.698882 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.698855    2583 generic.go:356] "Generic (PLEG): container finished" podID="05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" containerID="cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db" exitCode=0
Jul 05 20:11:18.699002 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.698900    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"
Jul 05 20:11:18.699002 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.698937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp" event={"ID":"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5","Type":"ContainerDied","Data":"cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db"}
Jul 05 20:11:18.699002 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.698982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp" event={"ID":"05ae0921-0d55-4b24-9adf-2ff95f0ff4c5","Type":"ContainerDied","Data":"a98865843323c22a5a2ec7207ef7b031f426b1d8f4555da4028487cdbfdaa9a5"}
Jul 05 20:11:18.699002 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.699001    2583 scope.go:117] "RemoveContainer" containerID="cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db"
Jul 05 20:11:18.709874 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.709853    2583 scope.go:117] "RemoveContainer" containerID="cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db"
Jul 05 20:11:18.710134 ip-10-0-138-140 kubenswrapper[2583]: E0705 20:11:18.710110    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db\": container with ID starting with cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db not found: ID does not exist" containerID="cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db"
Jul 05 20:11:18.710186 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.710144    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db"} err="failed to get container status \"cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db\": rpc error: code = NotFound desc = could not find container \"cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db\": container with ID starting with cb2d513c75401908327343f2aa6d23b6f1dddbad548320d2de2beaa45204a8db not found: ID does not exist"
Jul 05 20:11:18.722528 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.722503    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"]
Jul 05 20:11:18.726634 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:18.726614    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d9296f/sub-test-model-d9296f-kserve-6b8bbddfc9-fgdnp"]
Jul 05 20:11:19.123255 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:11:19.123227    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" path="/var/lib/kubelet/pods/05ae0921-0d55-4b24-9adf-2ff95f0ff4c5/volumes"
Jul 05 20:13:28.152708 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:28.152679    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-dd54x_bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20/copy-manifests/0.log"
Jul 05 20:13:28.158681 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:28.158660    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-dd54x_bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20/manager/0.log"
Jul 05 20:13:29.789514 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:29.789473    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-65zp9_5c112e41-0261-4ace-9a95-da329b9ba624/manager/0.log"
Jul 05 20:13:30.015756 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:30.015732    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-f6q4x_fad6ca5a-fc5b-4711-957c-b819fa8454fd/kuadrant-console-plugin/0.log"
Jul 05 20:13:31.168544 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:31.168516    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-rwhnk_efa07977-e2ef-4e3b-b6f7-f7b25320c947/kube-auth-proxy/0.log"
Jul 05 20:13:32.080163 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:32.080135    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5hx2z_112ea727-a1d1-43e3-8b85-f0955899bbcb/main/0.log"
Jul 05 20:13:32.303128 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:32.303102    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbtkhrh_1e268a75-c864-4c24-ae13-88eb68f3ced1/main/0.log"
Jul 05 20:13:32.418342 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:32.418318    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lt5jp_61de2171-0416-43dd-8315-701fd9111498/main/0.log"
Jul 05 20:13:32.530056 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:32.530033    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-jp6s8_14dddbdb-ebc6-441f-8e7b-3857ec9b83df/main/0.log"
Jul 05 20:13:39.427765 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:39.427738    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8grkm_f11b3971-c796-40a6-9551-d1dc85239212/global-pull-secret-syncer/0.log"
Jul 05 20:13:39.616447 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:39.616421    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8nwbv_87abb88d-ad37-4c45-9e0a-ad9c6d9d040e/konnectivity-agent/0.log"
Jul 05 20:13:39.685079 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:39.685014    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-140.ec2.internal_d2701aaf6f08c9babce33f409be88b73/haproxy/0.log"
Jul 05 20:13:44.934784 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:44.934756    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-65zp9_5c112e41-0261-4ace-9a95-da329b9ba624/manager/0.log"
Jul 05 20:13:44.987281 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:44.987253    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-f6q4x_fad6ca5a-fc5b-4711-957c-b819fa8454fd/kuadrant-console-plugin/0.log"
Jul 05 20:13:47.023466 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.023441    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b59b9477-854b-4eb8-a84e-ee37d61e9b72/alertmanager/0.log"
Jul 05 20:13:47.044503 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.044483    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b59b9477-854b-4eb8-a84e-ee37d61e9b72/config-reloader/0.log"
Jul 05 20:13:47.066895 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.066874    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b59b9477-854b-4eb8-a84e-ee37d61e9b72/kube-rbac-proxy-web/0.log"
Jul 05 20:13:47.095979 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.095956    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b59b9477-854b-4eb8-a84e-ee37d61e9b72/kube-rbac-proxy/0.log"
Jul 05 20:13:47.117099 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.117078    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b59b9477-854b-4eb8-a84e-ee37d61e9b72/kube-rbac-proxy-metric/0.log"
Jul 05 20:13:47.139337 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.139317    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b59b9477-854b-4eb8-a84e-ee37d61e9b72/prom-label-proxy/0.log"
Jul 05 20:13:47.158450 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.158424    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b59b9477-854b-4eb8-a84e-ee37d61e9b72/init-config-reloader/0.log"
Jul 05 20:13:47.222301 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.222212    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-755k4_81ecb63b-9600-48cd-b48a-f495c05d0306/kube-state-metrics/0.log"
Jul 05 20:13:47.241399 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.241349    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-755k4_81ecb63b-9600-48cd-b48a-f495c05d0306/kube-rbac-proxy-main/0.log"
Jul 05 20:13:47.261439 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.261419    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-755k4_81ecb63b-9600-48cd-b48a-f495c05d0306/kube-rbac-proxy-self/0.log"
Jul 05 20:13:47.284646 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.284628    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5ccd476c58-48qqh_641c3511-6cef-49f5-9545-59fbb0b7b6d9/metrics-server/0.log"
Jul 05 20:13:47.311471 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.311452    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-rphsd_36c30296-cbc4-4ef6-a70d-3a6bebe93dc8/monitoring-plugin/0.log"
Jul 05 20:13:47.410884 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.410865    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g6m8j_93f37666-78e9-48ad-bf0c-17dfc8ecde1a/node-exporter/0.log"
Jul 05 20:13:47.429651 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.429631    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g6m8j_93f37666-78e9-48ad-bf0c-17dfc8ecde1a/kube-rbac-proxy/0.log"
Jul 05 20:13:47.451932 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.451917    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g6m8j_93f37666-78e9-48ad-bf0c-17dfc8ecde1a/init-textfile/0.log"
Jul 05 20:13:47.626214 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.626185    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6/prometheus/0.log"
Jul 05 20:13:47.648084 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.648065    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6/config-reloader/0.log"
Jul 05 20:13:47.685844 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.685828    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6/thanos-sidecar/0.log"
Jul 05 20:13:47.716790 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.716772    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6/kube-rbac-proxy-web/0.log"
Jul 05 20:13:47.743327 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.743307    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6/kube-rbac-proxy/0.log"
Jul 05 20:13:47.768383 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.768364    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6/kube-rbac-proxy-thanos/0.log"
Jul 05 20:13:47.795490 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.795475    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a23a0b79-eb1c-4c8d-a7f5-74ac162d05d6/init-config-reloader/0.log"
Jul 05 20:13:47.841299 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.841263    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-2bnv7_e790ae71-1bba-46cf-afd4-bbc0f54ea7ef/prometheus-operator/0.log"
Jul 05 20:13:47.864555 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.864536    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-2bnv7_e790ae71-1bba-46cf-afd4-bbc0f54ea7ef/kube-rbac-proxy/0.log"
Jul 05 20:13:47.904662 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:47.904610    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-tjqt5_c4261d94-2c64-4bc0-bc87-4910d5b98f2f/prometheus-operator-admission-webhook/0.log"
Jul 05 20:13:49.033145 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.033114    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"]
Jul 05 20:13:49.033545 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.033461    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" containerName="main"
Jul 05 20:13:49.033545 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.033472    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" containerName="main"
Jul 05 20:13:49.033630 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.033571    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ae0921-0d55-4b24-9adf-2ff95f0ff4c5" containerName="main"
Jul 05 20:13:49.036669 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.036649    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.039375 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.039356    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb8xk\"/\"kube-root-ca.crt\""
Jul 05 20:13:49.040602 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.040583    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hb8xk\"/\"default-dockercfg-9prf5\""
Jul 05 20:13:49.040702 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.040640    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb8xk\"/\"openshift-service-ca.crt\""
Jul 05 20:13:49.044573 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.044552    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"]
Jul 05 20:13:49.101885 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.101863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-sys\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.101996 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.101900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-lib-modules\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.101996 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.101926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-proc\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.101996 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.101943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wmgv\" (UniqueName: \"kubernetes.io/projected/db49ddeb-1c6e-41a8-9380-96ac47428fae-kube-api-access-5wmgv\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.102098 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.102073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-podres\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202664 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-podres\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202794 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-sys\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202794 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-lib-modules\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202794 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-proc\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202794 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wmgv\" (UniqueName: \"kubernetes.io/projected/db49ddeb-1c6e-41a8-9380-96ac47428fae-kube-api-access-5wmgv\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202794 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202772    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-sys\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202994 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202822    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-podres\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202994 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202829    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-proc\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.202994 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.202864    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db49ddeb-1c6e-41a8-9380-96ac47428fae-lib-modules\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.210522 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.210500    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wmgv\" (UniqueName: \"kubernetes.io/projected/db49ddeb-1c6e-41a8-9380-96ac47428fae-kube-api-access-5wmgv\") pod \"perf-node-gather-daemonset-wzpnf\" (UID: \"db49ddeb-1c6e-41a8-9380-96ac47428fae\") " pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.347105 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.347040    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:49.478518 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:49.478479    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"]
Jul 05 20:13:49.480324 ip-10-0-138-140 kubenswrapper[2583]: W0705 20:13:49.480299    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb49ddeb_1c6e_41a8_9380_96ac47428fae.slice/crio-b2bc31710657613b073e0a13dd7049f7b446324b0caa0ec80dbf2686504cf894 WatchSource:0}: Error finding container b2bc31710657613b073e0a13dd7049f7b446324b0caa0ec80dbf2686504cf894: Status 404 returned error can't find the container with id b2bc31710657613b073e0a13dd7049f7b446324b0caa0ec80dbf2686504cf894
Jul 05 20:13:50.385974 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:50.385937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf" event={"ID":"db49ddeb-1c6e-41a8-9380-96ac47428fae","Type":"ContainerStarted","Data":"817cfb2408d4cace7724433a27c20c0f1a1d22ace9fb9b342f791b2aac7e9283"}
Jul 05 20:13:50.386413 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:50.385988    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf" event={"ID":"db49ddeb-1c6e-41a8-9380-96ac47428fae","Type":"ContainerStarted","Data":"b2bc31710657613b073e0a13dd7049f7b446324b0caa0ec80dbf2686504cf894"}
Jul 05 20:13:50.386413 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:50.386054    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:50.401934 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:50.401886    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf" podStartSLOduration=1.401870782 podStartE2EDuration="1.401870782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 20:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 20:13:50.400801601 +0000 UTC m=+2479.795124282" watchObservedRunningTime="2026-07-05 20:13:50.401870782 +0000 UTC m=+2479.796193465"
Jul 05 20:13:50.487618 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:50.487580    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-m5fr6_5edd1742-a691-4994-b925-e5b5deadb370/download-server/0.log"
Jul 05 20:13:51.968669 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:51.968618    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rs6n_a358f46c-c182-4cdf-9ae1-5c268b271ceb/dns/0.log"
Jul 05 20:13:51.988411 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:51.988366    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2rs6n_a358f46c-c182-4cdf-9ae1-5c268b271ceb/kube-rbac-proxy/0.log"
Jul 05 20:13:52.091702 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:52.091675    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6pbfm_91a3b5eb-2b30-460a-807a-9b22b68845f6/dns-node-resolver/0.log"
Jul 05 20:13:52.677787 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:52.677758    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jc8f9_918e0ee9-d8ef-4a2a-8d1b-8486d1d308ac/node-ca/0.log"
Jul 05 20:13:53.705959 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:53.705925    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-rwhnk_efa07977-e2ef-4e3b-b6f7-f7b25320c947/kube-auth-proxy/0.log"
Jul 05 20:13:54.528611 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:54.528579    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bdzgz_ef0a5fca-63b0-4081-9f0f-0f76a9960f93/serve-healthcheck-canary/0.log"
Jul 05 20:13:55.130680 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:55.130652    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwrll_9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe/kube-rbac-proxy/0.log"
Jul 05 20:13:55.148291 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:55.148236    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwrll_9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe/exporter/0.log"
Jul 05 20:13:55.165752 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:55.165735    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vwrll_9bcd0991-7349-4811-bf1a-a1e2aa4eb7fe/extractor/0.log"
Jul 05 20:13:56.400313 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:56.400263    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hb8xk/perf-node-gather-daemonset-wzpnf"
Jul 05 20:13:57.676831 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:57.676791    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-dd54x_bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20/manager/0.log"
Jul 05 20:13:57.698326 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:57.698305    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547755b757-dd54x_bf1a12c1-125b-40f9-8f0a-c9f66b3c2c20/copy-manifests/0.log"
Jul 05 20:13:59.298390 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:59.298314    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-644c79ff99-lt5p9_e9b1f7fc-c5f8-48a3-bc42-cd2e93583e20/manager/0.log"
Jul 05 20:13:59.576718 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:13:59.576637    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-rwhnk_efa07977-e2ef-4e3b-b6f7-f7b25320c947/kube-auth-proxy/0.log"
Jul 05 20:14:00.994613 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:00.994583    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6b494dcc-rwhnk_efa07977-e2ef-4e3b-b6f7-f7b25320c947/kube-auth-proxy/0.log"
Jul 05 20:14:05.685638 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.685607    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xk59r_844bf420-3791-474e-9869-dd1d52bbafac/kube-multus-additional-cni-plugins/0.log"
Jul 05 20:14:05.704060 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.704037    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xk59r_844bf420-3791-474e-9869-dd1d52bbafac/egress-router-binary-copy/0.log"
Jul 05 20:14:05.723136 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.723116    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xk59r_844bf420-3791-474e-9869-dd1d52bbafac/cni-plugins/0.log"
Jul 05 20:14:05.742015 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.741996    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xk59r_844bf420-3791-474e-9869-dd1d52bbafac/bond-cni-plugin/0.log"
Jul 05 20:14:05.760449 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.760430    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xk59r_844bf420-3791-474e-9869-dd1d52bbafac/routeoverride-cni/0.log"
Jul 05 20:14:05.778883 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.778860    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xk59r_844bf420-3791-474e-9869-dd1d52bbafac/whereabouts-cni-bincopy/0.log"
Jul 05 20:14:05.800506 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.800485    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xk59r_844bf420-3791-474e-9869-dd1d52bbafac/whereabouts-cni/0.log"
Jul 05 20:14:05.860588 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.860573    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ts9q8_be27ad17-aded-4c10-bf36-ce4deae2c195/kube-multus/0.log"
Jul 05 20:14:05.879616 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.879596    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2jb8c_d6b0a84d-d3e5-4362-827b-8f15f3e69016/network-metrics-daemon/0.log"
Jul 05 20:14:05.899239 ip-10-0-138-140 kubenswrapper[2583]: I0705 20:14:05.899218    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2jb8c_d6b0a84d-d3e5-4362-827b-8f15f3e69016/kube-rbac-proxy/0.log"