Jul 07 13:59:26.289844 ip-10-0-128-208 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 13:59:27.999222 ip-10-0-128-208 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 13:59:27.999222 ip-10-0-128-208 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 13:59:27.999222 ip-10-0-128-208 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 13:59:27.999222 ip-10-0-128-208 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 13:59:27.999222 ip-10-0-128-208 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 13:59:27.999927 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:27.999278    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 13:59:28.002931 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002911    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:59:28.002931 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002930    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:59:28.002931 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002933    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002938    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002941    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002943    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002946    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002949    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002951    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002954    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002957    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002960    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002962    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002965    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002973    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002976    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002979    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002981    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002985    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002989    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002992    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002995    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:59:28.003024 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.002998    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003000    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003002    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003005    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003008    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003010    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003013    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003015    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003018    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003020    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003023    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003025    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003030    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003033    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003036    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003038    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003041    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003043    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003046    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003049    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:59:28.003483 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003052    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003054    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003058    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003063    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003065    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003068    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003071    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003074    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003076    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003079    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003082    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003084    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003088    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003091    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003094    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003096    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003099    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003101    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003104    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003106    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:59:28.003994 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003109    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003111    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003114    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003117    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003119    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003122    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003124    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003128    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003132    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003136    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003139    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003141    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003144    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003146    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003149    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003151    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003154    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003156    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003158    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:59:28.004474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003161    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003165    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003167    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003170    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003173    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003175    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003178    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003180    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003183    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003186    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003188    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003191    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003193    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003196    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003198    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003201    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003203    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003205    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003963    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003971    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:59:28.004944 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003974    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003977    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003980    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003984    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003987    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003989    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003992    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003995    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.003998    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004000    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004003    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004006    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004008    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004011    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004014    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004019    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004024    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004028    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004031    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004034    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:59:28.005419 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004037    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004040    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004044    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004048    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004051    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004055    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004058    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004061    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004063    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004066    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004069    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004072    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004074    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004077    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004080    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004082    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004086    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004089    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004093    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:59:28.005955 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004095    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004098    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004100    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004102    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004105    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004108    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004110    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004113    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004116    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004119    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004122    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004125    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004128    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004130    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004133    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004135    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004138    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004140    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004143    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004145    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:59:28.006424 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004148    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004150    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004153    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004155    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004158    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004160    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004163    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004166    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004168    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004171    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004174    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004176    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004179    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004181    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004184    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004186    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004189    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004191    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004195    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004197    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:59:28.006915 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004201    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004204    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004206    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004209    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004211    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004214    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004216    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004219    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004221    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004224    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004226    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004228    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004231    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004234    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004236    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004239    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004241    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004244    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004639    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004644    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:59:28.007392 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004647    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004649    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004653    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004656    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004659    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004662    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004664    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004667    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004670    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004672    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004675    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004677    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004680    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004683    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004702    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004705    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004707    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004710    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004712    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004715    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:59:28.007895 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004717    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004720    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004722    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004725    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004728    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004730    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004733    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004735    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004738    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004740    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004746    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004748    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004751    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004753    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004756    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004765    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004768    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004771    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004773    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004776    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:59:28.008368 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004778    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004782    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004784    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004787    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004790    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004792    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004795    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004797    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004800    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004802    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004805    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004807    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004810    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004812    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004815    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004817    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004819    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004822    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004824    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004827    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:59:28.008874 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004829    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004832    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004836    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004838    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004841    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004843    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004846    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004850    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004860    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004864    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004866    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004869    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004872    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004875    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004878    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004881    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004884    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004887    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004891    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:59:28.009358 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004894    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004897    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004900    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004903    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004906    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004908    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004911    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004913    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004916    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004918    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004921    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004923    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004926    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004929    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004931    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004935    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004937    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.004940    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005017    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005024    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005033    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 13:59:28.009828 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005039    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005057    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005063    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005072    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005076    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005079    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005082    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005086    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005092    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005096    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005099    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005102    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005105    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005108    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005110    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005115    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005118    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005121    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005124    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005128    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005131    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005135    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005138    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 13:59:28.010325 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005141    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005144    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005147    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005151    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005154    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005157    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005161    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005164    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005167    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005170    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005173    2577 flags.go:64] FLAG: --enable-server="true"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005177    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005182    2577 flags.go:64] FLAG: --event-burst="100"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005185    2577 flags.go:64] FLAG: --event-qps="50"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005188    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005192    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005195    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005200    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005203    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005206    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005209    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005212    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005215    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005218    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005221    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 13:59:28.010921 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005224    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005227    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005230    2577 flags.go:64] FLAG: --feature-gates=""
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005233    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005236    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005239    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005242    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005245    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005248    2577 flags.go:64] FLAG: --help="false"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005251    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005256    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005259    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005262    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005265    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005269    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005271    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005274    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005277    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005280    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005283    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005286    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005289    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005292    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005294    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 13:59:28.011754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005299    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005301    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005304    2577 flags.go:64] FLAG: --lock-file=""
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005307    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005310    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005313    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005319    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005321    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005324    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005327    2577 flags.go:64] FLAG: --logging-format="text"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005330    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005333    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005336    2577 flags.go:64] FLAG: --manifest-url=""
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005339    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005343    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005346    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005350    2577 flags.go:64] FLAG: --max-pods="110"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005353    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005357    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005360    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005363    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005366    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005369    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005372    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005379    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 13:59:28.012786 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005382    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005385    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005388    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005392    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005397    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005400    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005403    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005406    2577 flags.go:64] FLAG: --port="10250"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005411    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005413    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0302fb1633a7f649c"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005417    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005420    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005423    2577 flags.go:64] FLAG: --register-node="true"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005426    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005430    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005433    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005435    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005438    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005441    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005444    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005447    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005450    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005453    2577 flags.go:64] FLAG: --runonce="false"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005456    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005459    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 13:59:28.013900 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005463    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005465    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005468    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005471    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005474    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005478    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005481    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005483    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005486    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005489    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005492    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005499    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005502    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005507    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005510    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005514    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005518    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005522    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005524    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005527    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005530    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005533    2577 flags.go:64] FLAG: --v="2"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005537    2577 flags.go:64] FLAG: --version="false"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005542    2577 flags.go:64] FLAG: --vmodule=""
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005545    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 13:59:28.015003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.005548    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005715    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005720    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005723    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005726    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005729    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005732    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005735    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005738    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005741    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005744    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005747    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005750    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005753    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005755    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005758    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005761    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005763    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005766    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:59:28.015811 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005771    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005775    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005778    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005783    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005786    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005789    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005791    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005794    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005797    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005801    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005803    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005806    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005809    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005812    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005815    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005818    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005821    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005824    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005827    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005829    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:59:28.016638 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005832    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005835    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005837    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005840    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005843    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005845    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005848    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005851    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005853    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005856    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005859    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005861    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005864    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005867    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005870    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005874    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005876    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005879    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005882    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005885    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:59:28.017425 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005887    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005890    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005892    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005895    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005900    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005903    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005906    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005909    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005912    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005914    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005917    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005920    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005922    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005925    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005928    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005931    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005933    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005936    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005938    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:59:28.017987 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005942    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005946    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005949    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005951    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005954    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005956    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005959    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005962    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005968    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005971    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005975    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005978    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005981    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005983    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005986    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005989    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005991    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005994    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005997    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.005999    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:59:28.018528 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.006002    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.006004    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.006009    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.013756    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.013776    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.013807    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.013815    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013901    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013911    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013916    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013920    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013925    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013929    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013934    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013938    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:59:28.019061 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013942    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013947    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013951    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013956    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013961    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013965    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013969    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013973    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013979    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013983    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013988    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013992    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.013996    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014001    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014005    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014009    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014014    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014018    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014022    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014027    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:59:28.019474 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014031    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014036    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014042    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014048    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014053    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014058    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014062    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014067    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014072    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014077    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014081    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014086    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014090    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014094    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014099    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014103    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014107    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014113    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014117    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:59:28.020000 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014123    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014129    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014133    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014138    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014142    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014146    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014150    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014154    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014159    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014163    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014168    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014172    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014176    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014181    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014186    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014190    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014194    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014198    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014202    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:59:28.020506 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014206    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014213    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014219    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014223    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014228    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014233    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014238    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014242    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014246    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014251    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014255    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014260    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014264    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014269    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014273    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014277    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014281    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014285    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014290    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014294    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:59:28.021103 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014298    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014302    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014306    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014311    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014315    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014319    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014324    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014328    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014332    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014336    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014341    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014345    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014349    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.014358    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014572    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:59:28.021728 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014580    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014585    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014590    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014594    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014599    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014603    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014610    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014616    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014621    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014626    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014631    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014636    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014640    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014645    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014649    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014653    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014658    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014662    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014666    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:59:28.022119 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014671    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014675    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014679    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014701    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014707    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014712    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014716    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014721    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014724    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014729    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014733    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014738    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014741    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014746    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014750    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014754    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014759    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014763    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014767    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014772    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:59:28.022743 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014776    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014781    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014785    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014789    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014794    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014799    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014803    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014808    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014812    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014816    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014820    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014825    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014829    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014833    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014838    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014843    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014848    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014852    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014856    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014860    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:59:28.023488 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014864    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014868    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014872    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014876    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014881    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014885    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014889    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014893    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014898    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014902    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014906    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014910    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014915    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014919    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014923    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014927    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014932    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014939    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014944    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:59:28.024300 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014949    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014954    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014958    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014964    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014971    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014976    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014981    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014985    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014990    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014995    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.014999    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015004    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015008    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015012    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015016    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015020    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015024    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015028    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015032    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:59:28.024900 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:28.015036    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:59:28.025372 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.015043    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 13:59:28.025372 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.015205    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 13:59:28.025372 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.017955    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 13:59:28.025372 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.019338    2577 server.go:1019] "Starting client certificate rotation"
Jul 07 13:59:28.025372 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.019448    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 13:59:28.025372 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.019514    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 13:59:28.025372 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.021871    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 13:59:28.027363 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.027339    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 13:59:28.036232 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.036212    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 07 13:59:28.038576 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.038562    2577 log.go:25] "Validated CRI v1 image API"
Jul 07 13:59:28.039446 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.039433    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 13:59:28.043102 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.043082    2577 fs.go:135] Filesystem UUIDs: map[6c01f974-c35f-41e3-89d3-7862789fb982:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d5bed66d-bc3c-4c32-ad02-2cf0160eb778:/dev/nvme0n1p3]
Jul 07 13:59:28.043146 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.043103    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 13:59:28.048223 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.048104    2577 manager.go:216] Machine: {Timestamp:2026-07-07 13:59:28.04686303 +0000 UTC m=+0.351550689 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099809 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c1b6e131a11b190faad4b377bee94 SystemUUID:ec2c1b6e-131a-11b1-90fa-ad4b377bee94 BootID:9bcc310d-33f4-4483-9a32-66067237e481 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:58:d8:d9:7b:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:58:d8:d9:7b:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:84:3c:57:88:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 13:59:28.048223 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.048214    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 13:59:28.048350 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.048325    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 13:59:28.049743 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.049682    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 13:59:28.049818 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.049733    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 13:59:28.049897 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.049751    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-208.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 13:59:28.050513 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.050504    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 13:59:28.050541 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.050516    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 13:59:28.050541 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.050523    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 13:59:28.051288 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.051278    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 13:59:28.052678 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.052668    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 13:59:28.056027 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056017    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 13:59:28.056308 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056298    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 13:59:28.056336 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056328    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 13:59:28.056368 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056338    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 13:59:28.056368 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056353    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 13:59:28.056368 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056364    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 07 13:59:28.056447 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056374    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 13:59:28.056746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056733    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 13:59:28.056816 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.056751    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 13:59:28.058828 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.058814    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 13:59:28.061066 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.061053    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 13:59:28.061116 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.061083    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 13:59:28.062830 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062818    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062834    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062840    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062845    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062854    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062859    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062868    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062873    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 13:59:28.062878 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062880    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 13:59:28.063090 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062900    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 13:59:28.063090 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062919    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 13:59:28.063090 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.062924    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 13:59:28.064727 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.064714    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 13:59:28.064766 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.064728    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 13:59:28.067876 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.067859    2577 server.go:1268] "Started kubelet"
Jul 07 13:59:28.068023 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.067927    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 13:59:28.068023 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.067953    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 13:59:28.068120 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.068047    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 13:59:28.073123 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.072972    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 13:59:28.073286 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.073090    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 13:59:28.073376 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.073294    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-208.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 13:59:28.073376 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.073329    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 13:59:28.073966 ip-10-0-128-208 systemd[1]: Started Kubernetes Kubelet.
Jul 07 13:59:28.075011 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.074780    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qwc7"
Jul 07 13:59:28.076056 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.076039    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 13:59:28.077042 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.077003    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 13:59:28.078634 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.077662    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-208.ec2.internal.18c006a74d799143  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-208.ec2.internal,UID:ip-10-0-128-208.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-208.ec2.internal,},FirstTimestamp:2026-07-07 13:59:28.067834179 +0000 UTC m=+0.372521838,LastTimestamp:2026-07-07 13:59:28.067834179 +0000 UTC m=+0.372521838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-208.ec2.internal,}"
Jul 07 13:59:28.082083 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.082066    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qwc7"
Jul 07 13:59:28.082707 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.082681    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 13:59:28.082816 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.082803    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.082881 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.082681    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 13:59:28.083308 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083257    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 13:59:28.083308 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083262    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 13:59:28.083308 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083287    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 13:59:28.083476 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083435    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 13:59:28.083476 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083443    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 13:59:28.083892 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083875    2577 factory.go:153] Registering CRI-O factory
Jul 07 13:59:28.083982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083896    2577 factory.go:223] Registration of the crio container factory successfully
Jul 07 13:59:28.084023 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083986    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 13:59:28.084023 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.083995    2577 factory.go:55] Registering systemd factory
Jul 07 13:59:28.084023 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.084001    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 07 13:59:28.084023 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.084017    2577 factory.go:103] Registering Raw factory
Jul 07 13:59:28.084155 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.084026    2577 manager.go:1196] Started watching for new ooms in manager
Jul 07 13:59:28.084433 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.084420    2577 manager.go:349] Starting recovery of all containers
Jul 07 13:59:28.093300 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.093270    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 13:59:28.093437 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.093313    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-208.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 13:59:28.095098 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.095085    2577 manager.go:354] Recovery completed
Jul 07 13:59:28.099038 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.099023    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:59:28.101339 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.101324    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:59:28.101385 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.101353    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:59:28.101385 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.101364    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:59:28.102046 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.102032    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 13:59:28.102096 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.102046    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 13:59:28.102096 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.102063    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 13:59:28.102096 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.102036    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:59:28.102932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.102914    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:59:28.103017 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.102946    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:59:28.103017 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.102956    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:59:28.103224 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.103213    2577 policy_none.go:49] "None policy: Start"
Jul 07 13:59:28.103253 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.103230    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 13:59:28.103253 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.103242    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 13:59:28.104284 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.104274    2577 policy_none.go:47] "Start"
Jul 07 13:59:28.141316 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.141295    2577 manager.go:337] "Starting Device Plugin manager"
Jul 07 13:59:28.141436 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.141402    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 13:59:28.141436 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.141418    2577 server.go:87] "Starting device plugin registration server"
Jul 07 13:59:28.141742 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.141729    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 13:59:28.141790 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.141745    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 13:59:28.142006 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.141859    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 13:59:28.142006 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.141940    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 13:59:28.142006 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.141949    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 13:59:28.142501 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.142484    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 13:59:28.142586 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.142526    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.242293 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.242210    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:59:28.243432 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.243411    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:59:28.243503 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.243440    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:59:28.243503 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.243455    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:59:28.243503 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.243487    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.252131 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.252110    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.252210 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.252138    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-208.ec2.internal\": node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.257398 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.257374    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 13:59:28.258598 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.258582    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 13:59:28.258662 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.258632    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 13:59:28.258662 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.258655    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 13:59:28.258773 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.258712    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 13:59:28.260767 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.260744    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:59:28.267772 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.267752    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.359320 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.359289    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal"]
Jul 07 13:59:28.359435 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.359375    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:59:28.360625 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.360590    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:59:28.360758 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.360637    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:59:28.360758 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.360647    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:59:28.362081 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362067    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:59:28.362207 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.362245 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362230    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:59:28.362870 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362853    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:59:28.362977 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362889    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:59:28.362977 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362903    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:59:28.362977 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362859    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:59:28.362977 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362953    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:59:28.362977 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.362963    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:59:28.364283 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.364269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.364355 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.364293    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:59:28.364996 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.364979    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:59:28.365073 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.365002    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:59:28.365073 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.365013    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:59:28.368345 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.368329    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.380281 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.380261    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-208.ec2.internal\" not found" node="ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.384590 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.384571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5084433fb06b56ae5e9e216af2933f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal\" (UID: \"5084433fb06b56ae5e9e216af2933f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.384663 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.384596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5084433fb06b56ae5e9e216af2933f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal\" (UID: \"5084433fb06b56ae5e9e216af2933f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.384663 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.384613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d9495d3c832a204d3734ce071daf0a8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-208.ec2.internal\" (UID: \"3d9495d3c832a204d3734ce071daf0a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.384663 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.384614    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-208.ec2.internal\" not found" node="ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.468824 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.468797    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.485456 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.485430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5084433fb06b56ae5e9e216af2933f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal\" (UID: \"5084433fb06b56ae5e9e216af2933f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.485512 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.485461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5084433fb06b56ae5e9e216af2933f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal\" (UID: \"5084433fb06b56ae5e9e216af2933f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.485512 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.485476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d9495d3c832a204d3734ce071daf0a8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-208.ec2.internal\" (UID: \"3d9495d3c832a204d3734ce071daf0a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.485612 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.485531    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d9495d3c832a204d3734ce071daf0a8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-208.ec2.internal\" (UID: \"3d9495d3c832a204d3734ce071daf0a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.485612 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.485534    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5084433fb06b56ae5e9e216af2933f26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal\" (UID: \"5084433fb06b56ae5e9e216af2933f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.485612 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.485536    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5084433fb06b56ae5e9e216af2933f26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal\" (UID: \"5084433fb06b56ae5e9e216af2933f26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.569790 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.569708    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.670233 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.670205    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.683364 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.683341    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.687795 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:28.687587    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:28.771051 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.771010    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.871703 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.871590    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:28.972147 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:28.972119    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:29.018722 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.018651    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 13:59:29.019284 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.018838    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 13:59:29.073218 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:29.073186    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-208.ec2.internal\" not found"
Jul 07 13:59:29.091717 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.091661    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 13:54:28 +0000 UTC" deadline="2028-03-12 07:16:48.749891662 +0000 UTC"
Jul 07 13:59:29.091717 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.091709    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14729h17m19.658186732s"
Jul 07 13:59:29.156184 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.156160    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:59:29.183035 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.183005    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:29.196889 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.196862    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 13:59:29.198563 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.198545    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal"
Jul 07 13:59:29.209877 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.209852    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 13:59:29.251628 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.251584    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:59:29.293420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.293389    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:59:29.317996 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:29.317213    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9495d3c832a204d3734ce071daf0a8.slice/crio-8c74a572e1964de7befc8e65f1cf0cc0579b4eca3911b3b2546bac60ba771fa0 WatchSource:0}: Error finding container 8c74a572e1964de7befc8e65f1cf0cc0579b4eca3911b3b2546bac60ba771fa0: Status 404 returned error can't find the container with id 8c74a572e1964de7befc8e65f1cf0cc0579b4eca3911b3b2546bac60ba771fa0
Jul 07 13:59:29.319058 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:29.319033    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5084433fb06b56ae5e9e216af2933f26.slice/crio-9f6f6de6ba450d167b0e58cdf3c3680335496758c1c226f30d8957d31f9c922d WatchSource:0}: Error finding container 9f6f6de6ba450d167b0e58cdf3c3680335496758c1c226f30d8957d31f9c922d: Status 404 returned error can't find the container with id 9f6f6de6ba450d167b0e58cdf3c3680335496758c1c226f30d8957d31f9c922d
Jul 07 13:59:29.323025 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:29.323010    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 13:59:30.057884 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.057853    2577 apiserver.go:52] "Watching apiserver"
Jul 07 13:59:30.065442 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.065413    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 13:59:30.066593 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.066566    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-rnd4k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc","openshift-cluster-node-tuning-operator/tuned-5ng86","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal","openshift-multus/multus-additional-cni-plugins-s4w7j","openshift-multus/network-metrics-daemon-j8brk","openshift-network-operator/iptables-alerter-hjl4d","kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal","openshift-dns/node-resolver-9q4hg","openshift-image-registry/node-ca-qpmwx","openshift-multus/multus-z67zg","openshift-network-diagnostics/network-check-target-zvrjb","openshift-ovn-kubernetes/ovnkube-node-ppnwz","kube-system/global-pull-secret-syncer-b49hp"]
Jul 07 13:59:30.068277 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.068251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.070701 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.069919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.071087 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.070904    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 13:59:30.071087 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.070936    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l9rsc\""
Jul 07 13:59:30.071087 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.071011    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 13:59:30.071272 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.071211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 13:59:30.072218 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.072194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073006    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073100    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073386    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073404    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073429    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.073642    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073670    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5gqrv\""
Jul 07 13:59:30.073788 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.073751    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 13:59:30.074258 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.074217    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 13:59:30.074375 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.074358    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:30.074485 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.074467    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2qhx\""
Jul 07 13:59:30.074988 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.074799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.076796 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.076775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:30.076889 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.076854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:30.076889 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.076879    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 13:59:30.077075 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.076778    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 13:59:30.077075 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.077074    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 13:59:30.077075 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.077088    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 13:59:30.077435 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.077034    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-llr8z\""
Jul 07 13:59:30.077486 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.077472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 13:59:30.078543 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.078252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.080425 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.080101    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.082352 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.081403    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 13:59:30.082352 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.081532    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 13:59:30.082352 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.082036    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sb6mq\""
Jul 07 13:59:30.082352 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.082198    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:30.082352 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.082240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.082830 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.082612    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 13:59:30.082830 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.082804    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mwltc\""
Jul 07 13:59:30.082969 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.082891    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 13:59:30.083264 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.083247    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.083875 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.083856    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 13:59:30.086793 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.086460    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 13:59:30.086793 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.086561    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nbrvp\""
Jul 07 13:59:30.087669 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.086999    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 13:59:30.087669 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.087364    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 13:59:30.087669 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.087477    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-252w8\""
Jul 07 13:59:30.087669 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.087367    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 13:59:30.087669 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.087654    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 13:59:30.089583 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.088486    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.091347 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.091301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:30.091439 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.091403    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:30.092053 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.091816    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 13:59:30.092053 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.092021    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ggsck\""
Jul 07 13:59:30.094425 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-cni-bin\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.094520 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f7e88bd-9992-475a-8303-f9fad419ca42-host-slash\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.094520 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-kubelet\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094520 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-slash\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094520 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-var-lib-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094726 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-ovn\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094726 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m77fq\" (UniqueName: \"kubernetes.io/projected/5e79d75f-5c28-40c9-ac5e-0b3a33813105-kube-api-access-m77fq\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.094726 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-cnibin\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.094726 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-k8s-cni-cncf-io\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.094726 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-ovnkube-config\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094726 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm282\" (UniqueName: \"kubernetes.io/projected/8ff2ea68-480c-461d-8646-7dee09673d14-kube-api-access-vm282\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-os-release\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqhxx\" (UniqueName: \"kubernetes.io/projected/8441f7e4-1f97-4993-b8c5-4a5685740595-kube-api-access-jqhxx\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll874\" (UniqueName: \"kubernetes.io/projected/93966aa1-900e-4580-a35f-ba347c4de480-kube-api-access-ll874\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-run-netns\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-etc-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-cni-bin\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ff2ea68-480c-461d-8646-7dee09673d14-tmp\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-hostroot\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e79d75f-5c28-40c9-ac5e-0b3a33813105-tmp-dir\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.094982 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-serviceca\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.094991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-cni-netd\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6hrk\" (UniqueName: \"kubernetes.io/projected/fac14bab-e89f-4be8-af35-25a67357ca5c-kube-api-access-h6hrk\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-registration-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-cni-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5x5\" (UniqueName: \"kubernetes.io/projected/4692241a-3f4e-440b-8999-253c0ed6a76e-kube-api-access-hq5x5\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e79d75f-5c28-40c9-ac5e-0b3a33813105-hosts-file\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-var-lib-kubelet\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-cni-multus\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-os-release\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-daemon-config\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.095420 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysctl-conf\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-kubelet\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4692241a-3f4e-440b-8999-253c0ed6a76e-cni-binary-copy\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-multus-certs\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095550    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5513fbde-d669-45b1-965c-a250ed46ae4f-kubelet-config\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f7e88bd-9992-475a-8303-f9fad419ca42-iptables-alerter-script\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd65ef2c-b6f5-46dc-940e-a196b2b5ae75-agent-certs\") pod \"konnectivity-agent-rnd4k\" (UID: \"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75\") " pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-node-log\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-kubernetes\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-host\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-device-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-socket-dir-parent\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-conf-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-etc-kubernetes\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq664\" (UniqueName: \"kubernetes.io/projected/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-kube-api-access-pq664\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-system-cni-dir\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.096149 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-socket-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysconfig\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-systemd\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ff2ea68-480c-461d-8646-7dee09673d14-etc-tuned\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.095980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-netns\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4a16edc-a263-4b99-932a-e038bea29c5b-ovn-node-metrics-cert\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5513fbde-d669-45b1-965c-a250ed46ae4f-dbus\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-systemd-units\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096087    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-systemd\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-log-socket\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-ovnkube-script-lib\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysctl-d\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-cnibin\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.096932 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rqpp\" (UniqueName: \"kubernetes.io/projected/7f7e88bd-9992-475a-8303-f9fad419ca42-kube-api-access-7rqpp\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd65ef2c-b6f5-46dc-940e-a196b2b5ae75-konnectivity-ca\") pod \"konnectivity-agent-rnd4k\" (UID: \"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75\") " pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-env-overrides\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-run\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-lib-modules\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-sys-fs\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-system-cni-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-host\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-modprobe-d\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096605    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-sys\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.097936 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.096676    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th2wx\" (UniqueName: \"kubernetes.io/projected/b4a16edc-a263-4b99-932a-e038bea29c5b-kube-api-access-th2wx\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.129009 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.128981    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-87r8h"
Jul 07 13:59:30.142843 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.142791    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-87r8h"
Jul 07 13:59:30.184778 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.184749    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 13:59:30.197065 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-os-release\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197065 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197128    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-daemon-config\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197144    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-os-release\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysctl-conf\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-kubelet\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4692241a-3f4e-440b-8999-253c0ed6a76e-cni-binary-copy\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-multus-certs\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197278    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysctl-conf\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197300    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.197326 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5513fbde-d669-45b1-965c-a250ed46ae4f-kubelet-config\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-kubelet\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f7e88bd-9992-475a-8303-f9fad419ca42-iptables-alerter-script\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197307    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-multus-certs\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd65ef2c-b6f5-46dc-940e-a196b2b5ae75-agent-certs\") pod \"konnectivity-agent-rnd4k\" (UID: \"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75\") " pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-node-log\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197416    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-kubernetes\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197462    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5513fbde-d669-45b1-965c-a250ed46ae4f-kubelet-config\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-host\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-device-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-socket-dir-parent\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-conf-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-etc-kubernetes\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq664\" (UniqueName: \"kubernetes.io/projected/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-kube-api-access-pq664\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-system-cni-dir\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-socket-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.197864 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysconfig\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197747    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-device-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-systemd\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ff2ea68-480c-461d-8646-7dee09673d14-etc-tuned\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197822    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-systemd\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197506    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-node-log\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-netns\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197856    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197882    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-netns\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197882    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-socket-dir-parent\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197881    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-kubernetes\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197934    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-daemon-config\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4a16edc-a263-4b99-932a-e038bea29c5b-ovn-node-metrics-cert\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197961    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-system-cni-dir\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5513fbde-d669-45b1-965c-a250ed46ae4f-dbus\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197934    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f7e88bd-9992-475a-8303-f9fad419ca42-iptables-alerter-script\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.198746 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.197983    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-conf-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-systemd-units\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198256    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5513fbde-d669-45b1-965c-a250ed46ae4f-dbus\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198042    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysconfig\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198126    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-socket-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.198286    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198302    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-systemd\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198022    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-etc-kubernetes\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198334    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-systemd-units\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.198393    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs podName:93966aa1-900e-4580-a35f-ba347c4de480 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:30.698368759 +0000 UTC m=+3.003056432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs") pod "network-metrics-daemon-j8brk" (UID: "93966aa1-900e-4580-a35f-ba347c4de480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-systemd\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-log-socket\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-ovnkube-script-lib\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198565    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198578    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-log-socket\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.199627 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysctl-d\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-cnibin\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rqpp\" (UniqueName: \"kubernetes.io/projected/7f7e88bd-9992-475a-8303-f9fad419ca42-kube-api-access-7rqpp\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd65ef2c-b6f5-46dc-940e-a196b2b5ae75-konnectivity-ca\") pod \"konnectivity-agent-rnd4k\" (UID: \"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75\") " pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-env-overrides\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-run\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198759    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-host\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-lib-modules\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-sys-fs\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-system-cni-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198854    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-lib-modules\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-host\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-modprobe-d\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-sys\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th2wx\" (UniqueName: \"kubernetes.io/projected/b4a16edc-a263-4b99-932a-e038bea29c5b-kube-api-access-th2wx\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.200499 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-cni-bin\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f7e88bd-9992-475a-8303-f9fad419ca42-host-slash\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-kubelet\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199159    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-ovnkube-script-lib\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-slash\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-var-lib-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199224    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-slash\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-ovn\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m77fq\" (UniqueName: \"kubernetes.io/projected/5e79d75f-5c28-40c9-ac5e-0b3a33813105-kube-api-access-m77fq\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-cnibin\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-k8s-cni-cncf-io\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199303    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-sys-fs\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-ovnkube-config\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm282\" (UniqueName: \"kubernetes.io/projected/8ff2ea68-480c-461d-8646-7dee09673d14-kube-api-access-vm282\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-os-release\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhxx\" (UniqueName: \"kubernetes.io/projected/8441f7e4-1f97-4993-b8c5-4a5685740595-kube-api-access-jqhxx\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199395    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-host\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.201361 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll874\" (UniqueName: \"kubernetes.io/projected/93966aa1-900e-4580-a35f-ba347c4de480-kube-api-access-ll874\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199442    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-run-netns\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-etc-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-cni-bin\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ff2ea68-480c-461d-8646-7dee09673d14-tmp\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-hostroot\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e79d75f-5c28-40c9-ac5e-0b3a33813105-tmp-dir\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-serviceca\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-cni-netd\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199719    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-var-lib-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6hrk\" (UniqueName: \"kubernetes.io/projected/fac14bab-e89f-4be8-af35-25a67357ca5c-kube-api-access-h6hrk\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-registration-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-cni-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.202190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5x5\" (UniqueName: \"kubernetes.io/projected/4692241a-3f4e-440b-8999-253c0ed6a76e-kube-api-access-hq5x5\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e79d75f-5c28-40c9-ac5e-0b3a33813105-hosts-file\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-var-lib-kubelet\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-cni-multus\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200049    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200073    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-cni-multus\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200106    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-run-ovn\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200144    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200157    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-sysctl-d\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200205    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-cnibin\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200227    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-etc-modprobe-d\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200265    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-cni-bin\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200278    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-sys\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200301    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-etc-openvswitch\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200329    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200341    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-run-k8s-cni-cncf-io\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203003 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200371    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-cnibin\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200386    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f7e88bd-9992-475a-8303-f9fad419ca42-host-slash\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200420    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-host-var-lib-cni-bin\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200459    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-kubelet\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200493    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-run-netns\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200547    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8441f7e4-1f97-4993-b8c5-4a5685740595-registration-dir\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200806    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-ovnkube-config\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200832    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fac14bab-e89f-4be8-af35-25a67357ca5c-os-release\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.200891    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-multus-cni-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.199366    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-system-cni-dir\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201056    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e79d75f-5c28-40c9-ac5e-0b3a33813105-hosts-file\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201107    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-var-lib-kubelet\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.201143    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201157    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd65ef2c-b6f5-46dc-940e-a196b2b5ae75-konnectivity-ca\") pod \"konnectivity-agent-rnd4k\" (UID: \"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75\") " pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.201196    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret podName:5513fbde-d669-45b1-965c-a250ed46ae4f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:30.70118004 +0000 UTC m=+3.005867686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret") pod "global-pull-secret-syncer-b49hp" (UID: "5513fbde-d669-45b1-965c-a250ed46ae4f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201277    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ff2ea68-480c-461d-8646-7dee09673d14-etc-tuned\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201361    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-run-ovn-kubernetes\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.203847 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201383    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4a16edc-a263-4b99-932a-e038bea29c5b-ovn-node-metrics-cert\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201408    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4692241a-3f4e-440b-8999-253c0ed6a76e-hostroot\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201526    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4a16edc-a263-4b99-932a-e038bea29c5b-env-overrides\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201587    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd65ef2c-b6f5-46dc-940e-a196b2b5ae75-agent-certs\") pod \"konnectivity-agent-rnd4k\" (UID: \"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75\") " pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201593    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4a16edc-a263-4b99-932a-e038bea29c5b-host-cni-netd\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.198524    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4692241a-3f4e-440b-8999-253c0ed6a76e-cni-binary-copy\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201608    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ff2ea68-480c-461d-8646-7dee09673d14-run\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201594    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fac14bab-e89f-4be8-af35-25a67357ca5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201712    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e79d75f-5c28-40c9-ac5e-0b3a33813105-tmp-dir\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.201840    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-serviceca\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.204600 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.203466    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ff2ea68-480c-461d-8646-7dee09673d14-tmp\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.211470 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.211369    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqhxx\" (UniqueName: \"kubernetes.io/projected/8441f7e4-1f97-4993-b8c5-4a5685740595-kube-api-access-jqhxx\") pod \"aws-ebs-csi-driver-node-nrcqc\" (UID: \"8441f7e4-1f97-4993-b8c5-4a5685740595\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.211470 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.211389    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq664\" (UniqueName: \"kubernetes.io/projected/9d69e339-c88f-4eeb-91d9-6ed08cac7d20-kube-api-access-pq664\") pod \"node-ca-qpmwx\" (UID: \"9d69e339-c88f-4eeb-91d9-6ed08cac7d20\") " pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.212083 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.211996    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll874\" (UniqueName: \"kubernetes.io/projected/93966aa1-900e-4580-a35f-ba347c4de480-kube-api-access-ll874\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:30.212180 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.212077    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rqpp\" (UniqueName: \"kubernetes.io/projected/7f7e88bd-9992-475a-8303-f9fad419ca42-kube-api-access-7rqpp\") pod \"iptables-alerter-hjl4d\" (UID: \"7f7e88bd-9992-475a-8303-f9fad419ca42\") " pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.213917 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.213814    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5x5\" (UniqueName: \"kubernetes.io/projected/4692241a-3f4e-440b-8999-253c0ed6a76e-kube-api-access-hq5x5\") pod \"multus-z67zg\" (UID: \"4692241a-3f4e-440b-8999-253c0ed6a76e\") " pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.218282 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.218119    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm282\" (UniqueName: \"kubernetes.io/projected/8ff2ea68-480c-461d-8646-7dee09673d14-kube-api-access-vm282\") pod \"tuned-5ng86\" (UID: \"8ff2ea68-480c-461d-8646-7dee09673d14\") " pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.218282 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.218225    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m77fq\" (UniqueName: \"kubernetes.io/projected/5e79d75f-5c28-40c9-ac5e-0b3a33813105-kube-api-access-m77fq\") pod \"node-resolver-9q4hg\" (UID: \"5e79d75f-5c28-40c9-ac5e-0b3a33813105\") " pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.219005 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.218357    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th2wx\" (UniqueName: \"kubernetes.io/projected/b4a16edc-a263-4b99-932a-e038bea29c5b-kube-api-access-th2wx\") pod \"ovnkube-node-ppnwz\" (UID: \"b4a16edc-a263-4b99-932a-e038bea29c5b\") " pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.219283 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.219095    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6hrk\" (UniqueName: \"kubernetes.io/projected/fac14bab-e89f-4be8-af35-25a67357ca5c-kube-api-access-h6hrk\") pod \"multus-additional-cni-plugins-s4w7j\" (UID: \"fac14bab-e89f-4be8-af35-25a67357ca5c\") " pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.263797 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.263715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal" event={"ID":"5084433fb06b56ae5e9e216af2933f26","Type":"ContainerStarted","Data":"9f6f6de6ba450d167b0e58cdf3c3680335496758c1c226f30d8957d31f9c922d"}
Jul 07 13:59:30.265130 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.265103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal" event={"ID":"3d9495d3c832a204d3734ce071daf0a8","Type":"ContainerStarted","Data":"8c74a572e1964de7befc8e65f1cf0cc0579b4eca3911b3b2546bac60ba771fa0"}
Jul 07 13:59:30.301233 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.301193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:30.312816 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.312740    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:30.312816 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.312766    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:30.312816 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.312778    2577 projected.go:196] Error preparing data for projected volume kube-api-access-dzg8m for pod openshift-network-diagnostics/network-check-target-zvrjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:30.313057 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.312844    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m podName:88e372e3-a702-47aa-a562-b68fd43c3943 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:30.81282209 +0000 UTC m=+3.117509752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dzg8m" (UniqueName: "kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m") pod "network-check-target-zvrjb" (UID: "88e372e3-a702-47aa-a562-b68fd43c3943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:30.381348 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.381309    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qpmwx"
Jul 07 13:59:30.391789 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.391757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:30.402651 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.402623    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc"
Jul 07 13:59:30.408675 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.408645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5ng86"
Jul 07 13:59:30.414580 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.414554    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4w7j"
Jul 07 13:59:30.424371 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.424342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9q4hg"
Jul 07 13:59:30.431549 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.431527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hjl4d"
Jul 07 13:59:30.444608 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.444571    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:30.447666 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.447643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z67zg"
Jul 07 13:59:30.560355 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.560322    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:59:30.703249 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.703214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:30.703411 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.703274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:30.703411 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.703362    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:30.703531 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.703421    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs podName:93966aa1-900e-4580-a35f-ba347c4de480 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.703405672 +0000 UTC m=+4.008093318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs") pod "network-metrics-daemon-j8brk" (UID: "93966aa1-900e-4580-a35f-ba347c4de480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:30.703531 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.703365    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:30.703531 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.703515    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret podName:5513fbde-d669-45b1-965c-a250ed46ae4f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.703497676 +0000 UTC m=+4.008185340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret") pod "global-pull-secret-syncer-b49hp" (UID: "5513fbde-d669-45b1-965c-a250ed46ae4f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:30.905033 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:30.905005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:30.905216 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.905162    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:30.905216 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.905184    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:30.905216 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.905195    2577 projected.go:196] Error preparing data for projected volume kube-api-access-dzg8m for pod openshift-network-diagnostics/network-check-target-zvrjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:30.905370 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:30.905251    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m podName:88e372e3-a702-47aa-a562-b68fd43c3943 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.905237282 +0000 UTC m=+4.209924937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzg8m" (UniqueName: "kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m") pod "network-check-target-zvrjb" (UID: "88e372e3-a702-47aa-a562-b68fd43c3943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:31.145294 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.145237    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:54:30 +0000 UTC" deadline="2028-02-23 18:16:11.710134497 +0000 UTC"
Jul 07 13:59:31.145294 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.145286    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14308h16m40.564852838s"
Jul 07 13:59:31.242867 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.242839    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff2ea68_480c_461d_8646_7dee09673d14.slice/crio-ef1d93e9336c0073f434725b1d919d6e9765c91e75f92053ea70465e3f6fb02c WatchSource:0}: Error finding container ef1d93e9336c0073f434725b1d919d6e9765c91e75f92053ea70465e3f6fb02c: Status 404 returned error can't find the container with id ef1d93e9336c0073f434725b1d919d6e9765c91e75f92053ea70465e3f6fb02c
Jul 07 13:59:31.243922 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.243900    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a16edc_a263_4b99_932a_e038bea29c5b.slice/crio-ec2fc2ea028245b2e8833dfe4c8a5dcbe02b5679045b60251b4cce387723a61a WatchSource:0}: Error finding container ec2fc2ea028245b2e8833dfe4c8a5dcbe02b5679045b60251b4cce387723a61a: Status 404 returned error can't find the container with id ec2fc2ea028245b2e8833dfe4c8a5dcbe02b5679045b60251b4cce387723a61a
Jul 07 13:59:31.244901 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.244879    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7e88bd_9992_475a_8303_f9fad419ca42.slice/crio-95fb561ea17fbd9db5714503b1c050be56a38092d1dedfe23835c1b636db5a3e WatchSource:0}: Error finding container 95fb561ea17fbd9db5714503b1c050be56a38092d1dedfe23835c1b636db5a3e: Status 404 returned error can't find the container with id 95fb561ea17fbd9db5714503b1c050be56a38092d1dedfe23835c1b636db5a3e
Jul 07 13:59:31.248318 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.248293    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4692241a_3f4e_440b_8999_253c0ed6a76e.slice/crio-bfb356f9294c09676374a17e95018063bf84b75a5f9a0857b2901726e7d704be WatchSource:0}: Error finding container bfb356f9294c09676374a17e95018063bf84b75a5f9a0857b2901726e7d704be: Status 404 returned error can't find the container with id bfb356f9294c09676374a17e95018063bf84b75a5f9a0857b2901726e7d704be
Jul 07 13:59:31.249853 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.249834    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e79d75f_5c28_40c9_ac5e_0b3a33813105.slice/crio-f12fb4ca7a4e39423f72b1121203d00a4db55a5c2e81292ab7d6b90d3f9fef34 WatchSource:0}: Error finding container f12fb4ca7a4e39423f72b1121203d00a4db55a5c2e81292ab7d6b90d3f9fef34: Status 404 returned error can't find the container with id f12fb4ca7a4e39423f72b1121203d00a4db55a5c2e81292ab7d6b90d3f9fef34
Jul 07 13:59:31.250255 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.250162    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8441f7e4_1f97_4993_b8c5_4a5685740595.slice/crio-b0c6de857ad33ec0393d385dc2456f3a1fcf55e8af99372fbf5d58ef4124ba0b WatchSource:0}: Error finding container b0c6de857ad33ec0393d385dc2456f3a1fcf55e8af99372fbf5d58ef4124ba0b: Status 404 returned error can't find the container with id b0c6de857ad33ec0393d385dc2456f3a1fcf55e8af99372fbf5d58ef4124ba0b
Jul 07 13:59:31.251670 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.251647    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd65ef2c_b6f5_46dc_940e_a196b2b5ae75.slice/crio-c513fb6d530bd097762d6454383ea79f145ea918cc4b04ad5723e3184169109e WatchSource:0}: Error finding container c513fb6d530bd097762d6454383ea79f145ea918cc4b04ad5723e3184169109e: Status 404 returned error can't find the container with id c513fb6d530bd097762d6454383ea79f145ea918cc4b04ad5723e3184169109e
Jul 07 13:59:31.252653 ip-10-0-128-208 kubenswrapper[2577]: W0707 13:59:31.252614    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d69e339_c88f_4eeb_91d9_6ed08cac7d20.slice/crio-e029080b27836be8e7e55e96b625b03b6e8ae1de7bf818a83738c3fee8f033b7 WatchSource:0}: Error finding container e029080b27836be8e7e55e96b625b03b6e8ae1de7bf818a83738c3fee8f033b7: Status 404 returned error can't find the container with id e029080b27836be8e7e55e96b625b03b6e8ae1de7bf818a83738c3fee8f033b7
Jul 07 13:59:31.268531 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.268492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc" event={"ID":"8441f7e4-1f97-4993-b8c5-4a5685740595","Type":"ContainerStarted","Data":"b0c6de857ad33ec0393d385dc2456f3a1fcf55e8af99372fbf5d58ef4124ba0b"}
Jul 07 13:59:31.269749 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.269675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z67zg" event={"ID":"4692241a-3f4e-440b-8999-253c0ed6a76e","Type":"ContainerStarted","Data":"bfb356f9294c09676374a17e95018063bf84b75a5f9a0857b2901726e7d704be"}
Jul 07 13:59:31.271056 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.271032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"ec2fc2ea028245b2e8833dfe4c8a5dcbe02b5679045b60251b4cce387723a61a"}
Jul 07 13:59:31.272279 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.272255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5ng86" event={"ID":"8ff2ea68-480c-461d-8646-7dee09673d14","Type":"ContainerStarted","Data":"ef1d93e9336c0073f434725b1d919d6e9765c91e75f92053ea70465e3f6fb02c"}
Jul 07 13:59:31.273739 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.273715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerStarted","Data":"478efd66eef2fe8c067131e6649669d3f54f64a6f178437894773b1c14eebbde"}
Jul 07 13:59:31.275104 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.275082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qpmwx" event={"ID":"9d69e339-c88f-4eeb-91d9-6ed08cac7d20","Type":"ContainerStarted","Data":"e029080b27836be8e7e55e96b625b03b6e8ae1de7bf818a83738c3fee8f033b7"}
Jul 07 13:59:31.276172 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.276143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rnd4k" event={"ID":"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75","Type":"ContainerStarted","Data":"c513fb6d530bd097762d6454383ea79f145ea918cc4b04ad5723e3184169109e"}
Jul 07 13:59:31.277219 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.277196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9q4hg" event={"ID":"5e79d75f-5c28-40c9-ac5e-0b3a33813105","Type":"ContainerStarted","Data":"f12fb4ca7a4e39423f72b1121203d00a4db55a5c2e81292ab7d6b90d3f9fef34"}
Jul 07 13:59:31.278158 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.278140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hjl4d" event={"ID":"7f7e88bd-9992-475a-8303-f9fad419ca42","Type":"ContainerStarted","Data":"95fb561ea17fbd9db5714503b1c050be56a38092d1dedfe23835c1b636db5a3e"}
Jul 07 13:59:31.710178 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.710134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:31.710352 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.710301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:31.710352 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.710318    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:31.710482 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.710398    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs podName:93966aa1-900e-4580-a35f-ba347c4de480 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:33.710376906 +0000 UTC m=+6.015064559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs") pod "network-metrics-daemon-j8brk" (UID: "93966aa1-900e-4580-a35f-ba347c4de480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:31.710482 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.710434    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:31.710581 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.710487    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret podName:5513fbde-d669-45b1-965c-a250ed46ae4f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:33.710470429 +0000 UTC m=+6.015158084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret") pod "global-pull-secret-syncer-b49hp" (UID: "5513fbde-d669-45b1-965c-a250ed46ae4f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:31.912063 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:31.912023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:31.912263 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.912247    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:31.912330 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.912272    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:31.912330 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.912285    2577 projected.go:196] Error preparing data for projected volume kube-api-access-dzg8m for pod openshift-network-diagnostics/network-check-target-zvrjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:31.912425 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:31.912349    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m podName:88e372e3-a702-47aa-a562-b68fd43c3943 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:33.91232744 +0000 UTC m=+6.217015091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzg8m" (UniqueName: "kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m") pod "network-check-target-zvrjb" (UID: "88e372e3-a702-47aa-a562-b68fd43c3943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:32.145614 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.145522    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:54:30 +0000 UTC" deadline="2027-12-30 05:27:12.551978885 +0000 UTC"
Jul 07 13:59:32.145614 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.145581    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12975h27m40.406402314s"
Jul 07 13:59:32.262215 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.262181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:32.262452 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:32.262308    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:32.262452 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.262392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:32.262608 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:32.262463    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:32.262608 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.262524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:32.262763 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:32.262605    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:32.292712 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.292356    2577 generic.go:356] "Generic (PLEG): container finished" podID="5084433fb06b56ae5e9e216af2933f26" containerID="b49d83b475ce5b76a65e8abd5d97b3a7b006e4879ba2b5d367d2e995a98139f1" exitCode=0
Jul 07 13:59:32.292712 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.292544    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal" event={"ID":"5084433fb06b56ae5e9e216af2933f26","Type":"ContainerDied","Data":"b49d83b475ce5b76a65e8abd5d97b3a7b006e4879ba2b5d367d2e995a98139f1"}
Jul 07 13:59:32.310200 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.310168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal" event={"ID":"3d9495d3c832a204d3734ce071daf0a8","Type":"ContainerStarted","Data":"0c253920972e910001403f427d79abce32326309b5976bb94a985655277a56ac"}
Jul 07 13:59:32.324832 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:32.324755    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-208.ec2.internal" podStartSLOduration=3.324725375 podStartE2EDuration="3.324725375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:32.324265142 +0000 UTC m=+4.628952811" watchObservedRunningTime="2026-07-07 13:59:32.324725375 +0000 UTC m=+4.629413044"
Jul 07 13:59:33.337266 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:33.337195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal" event={"ID":"5084433fb06b56ae5e9e216af2933f26","Type":"ContainerStarted","Data":"fa29cd1b69faab766dc057725acb2a15399fe17b4690a9a41978eb7abcf8b805"}
Jul 07 13:59:33.725736 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:33.725696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:33.725940 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:33.725773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:33.725940 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.725910    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:33.726055 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.725973    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret podName:5513fbde-d669-45b1-965c-a250ed46ae4f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:37.725954105 +0000 UTC m=+10.030641758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret") pod "global-pull-secret-syncer-b49hp" (UID: "5513fbde-d669-45b1-965c-a250ed46ae4f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:33.726055 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.726036    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:33.726158 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.726071    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs podName:93966aa1-900e-4580-a35f-ba347c4de480 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:37.726057673 +0000 UTC m=+10.030745334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs") pod "network-metrics-daemon-j8brk" (UID: "93966aa1-900e-4580-a35f-ba347c4de480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:33.928464 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:33.928414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:33.928638 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.928608    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:33.928638 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.928632    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:33.928786 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.928644    2577 projected.go:196] Error preparing data for projected volume kube-api-access-dzg8m for pod openshift-network-diagnostics/network-check-target-zvrjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:33.928786 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:33.928727    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m podName:88e372e3-a702-47aa-a562-b68fd43c3943 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:37.928705847 +0000 UTC m=+10.233393517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzg8m" (UniqueName: "kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m") pod "network-check-target-zvrjb" (UID: "88e372e3-a702-47aa-a562-b68fd43c3943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:34.261380 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:34.261344    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:34.261558 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:34.261520    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:34.261931 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:34.261909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:34.262050 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:34.261997    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:34.262050 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:34.262048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:34.262250 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:34.262110    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:36.259039 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:36.258916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:36.259474 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:36.258918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:36.259474 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:36.259069    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:36.259474 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:36.258916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:36.259474 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:36.259181    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:36.259474 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:36.259291    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:37.759996 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:37.759956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:37.760468 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:37.760040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:37.760468 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.760124    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:37.760468 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.760144    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:37.760468 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.760210    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret podName:5513fbde-d669-45b1-965c-a250ed46ae4f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:45.760187082 +0000 UTC m=+18.064874735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret") pod "global-pull-secret-syncer-b49hp" (UID: "5513fbde-d669-45b1-965c-a250ed46ae4f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:37.760468 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.760231    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs podName:93966aa1-900e-4580-a35f-ba347c4de480 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:45.760220387 +0000 UTC m=+18.064908038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs") pod "network-metrics-daemon-j8brk" (UID: "93966aa1-900e-4580-a35f-ba347c4de480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:37.962011 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:37.961970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:37.962190 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.962124    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:37.962190 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.962154    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:37.962190 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.962168    2577 projected.go:196] Error preparing data for projected volume kube-api-access-dzg8m for pod openshift-network-diagnostics/network-check-target-zvrjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:37.962359 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:37.962227    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m podName:88e372e3-a702-47aa-a562-b68fd43c3943 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:45.962208904 +0000 UTC m=+18.266896568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzg8m" (UniqueName: "kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m") pod "network-check-target-zvrjb" (UID: "88e372e3-a702-47aa-a562-b68fd43c3943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:38.261000 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:38.260393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:38.261000 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:38.260476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:38.261000 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:38.260718    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:38.261000 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:38.260826    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:38.261000 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:38.260523    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:38.261000 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:38.260940    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:40.259247 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:40.259212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:40.259754 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:40.259351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:40.259754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:40.259397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:40.259754 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:40.259529    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:40.259754 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:40.259582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:40.259754 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:40.259641    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:42.259416 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:42.259386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:42.259908 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:42.259381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:42.259908 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:42.259509    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:42.259908 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:42.259610    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:42.259908 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:42.259381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:42.259908 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:42.259728    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:44.259666 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:44.259632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:44.260159 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:44.259632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:44.260159 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:44.259639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:44.260159 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:44.259788    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:44.260159 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:44.259871    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:44.260159 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:44.259969    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:45.820531 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:45.820483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:45.821065 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:45.820573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:45.821065 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:45.820640    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:45.821065 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:45.820659    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:45.821065 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:45.820726    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret podName:5513fbde-d669-45b1-965c-a250ed46ae4f nodeName:}" failed. No retries permitted until 2026-07-07 14:00:01.820705151 +0000 UTC m=+34.125392812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret") pod "global-pull-secret-syncer-b49hp" (UID: "5513fbde-d669-45b1-965c-a250ed46ae4f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:45.821065 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:45.820745    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs podName:93966aa1-900e-4580-a35f-ba347c4de480 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:01.820735427 +0000 UTC m=+34.125423080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs") pod "network-metrics-daemon-j8brk" (UID: "93966aa1-900e-4580-a35f-ba347c4de480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:46.021750 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:46.021716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:46.021945 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:46.021909    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:46.021945 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:46.021936    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:46.021945 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:46.021947    2577 projected.go:196] Error preparing data for projected volume kube-api-access-dzg8m for pod openshift-network-diagnostics/network-check-target-zvrjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:46.022091 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:46.022005    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m podName:88e372e3-a702-47aa-a562-b68fd43c3943 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:02.02199047 +0000 UTC m=+34.326678132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzg8m" (UniqueName: "kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m") pod "network-check-target-zvrjb" (UID: "88e372e3-a702-47aa-a562-b68fd43c3943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:46.259269 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:46.259230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:46.259465 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:46.259231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:46.259465 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:46.259364    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:46.259465 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:46.259378    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:46.259600 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:46.259492    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:46.259600 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:46.259567    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:48.260564 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:48.260527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:48.261086 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:48.260633    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:48.261086 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:48.260733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:48.261086 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:48.260843    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:48.261086 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:48.260898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:48.261086 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:48.260978    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:50.259072 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.258907    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:50.259757 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.258905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:50.259757 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:50.259148    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:50.259757 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:50.259232    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:50.259757 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.258917    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:50.259757 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:50.259334    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:50.373033 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.373000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qpmwx" event={"ID":"9d69e339-c88f-4eeb-91d9-6ed08cac7d20","Type":"ContainerStarted","Data":"2d6963c8152b68446e72b267b2502bce297748d7e92ada9d8570163626e2b9c0"}
Jul 07 13:59:50.375187 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.374939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rnd4k" event={"ID":"dd65ef2c-b6f5-46dc-940e-a196b2b5ae75","Type":"ContainerStarted","Data":"bdbc59a192c13d2d675ee6a66705a41dc647304e5f98d835eff2c5be236f3cfc"}
Jul 07 13:59:50.379448 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.379417    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9q4hg" event={"ID":"5e79d75f-5c28-40c9-ac5e-0b3a33813105","Type":"ContainerStarted","Data":"2eacccb21e808715a1852240b99932e8ff5ed652b5d6de684fcdeb8ed56f2025"}
Jul 07 13:59:50.381043 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.381022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc" event={"ID":"8441f7e4-1f97-4993-b8c5-4a5685740595","Type":"ContainerStarted","Data":"a1515864162346cbdbb32995bb0079875de137e725f565cfb7d22b22d680e796"}
Jul 07 13:59:50.382492 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.382473    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z67zg" event={"ID":"4692241a-3f4e-440b-8999-253c0ed6a76e","Type":"ContainerStarted","Data":"da9a8477506012e28f559b075be50825c36874beca3486bb090670329a3647f4"}
Jul 07 13:59:50.385047 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.385025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"5e9b38be39c91e4bfbcd7f1d15ef28dcff24665b896ab02df21e9f90ca13bfcd"}
Jul 07 13:59:50.385134 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.385097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"92d4cc7dc4b63098ee213e2483976a15d1a53caba4c55fb859d186c0b68ba996"}
Jul 07 13:59:50.385184 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.385148    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"29e2677723f4ee862289154af00a8c002d80d9ec66c86be42252b024abb6aa90"}
Jul 07 13:59:50.385226 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.385197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"e4dd3608de479e9b7ca70f963edee57905909650c0c30256cb384a8c95ae409a"}
Jul 07 13:59:50.386491 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.386469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5ng86" event={"ID":"8ff2ea68-480c-461d-8646-7dee09673d14","Type":"ContainerStarted","Data":"10fbb6eee30f781b0801f1a391f9bf2fe596edff0be3bb99fd12c17b2604fc0d"}
Jul 07 13:59:50.387899 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.387879    2577 generic.go:356] "Generic (PLEG): container finished" podID="fac14bab-e89f-4be8-af35-25a67357ca5c" containerID="af86f0a46fd4e5a3a42e8a1bdfdaac38869300a09e4661ab4aa2bd949370a89f" exitCode=0
Jul 07 13:59:50.387970 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.387906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerDied","Data":"af86f0a46fd4e5a3a42e8a1bdfdaac38869300a09e4661ab4aa2bd949370a89f"}
Jul 07 13:59:50.389957 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.389920    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-208.ec2.internal" podStartSLOduration=21.389906944 podStartE2EDuration="21.389906944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:33.368167949 +0000 UTC m=+5.672855620" watchObservedRunningTime="2026-07-07 13:59:50.389906944 +0000 UTC m=+22.694594611"
Jul 07 13:59:50.407947 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.407903    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qpmwx" podStartSLOduration=3.828166036 podStartE2EDuration="22.407887903s" totalImagesPullingTime="18.579721867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:50.389460357 +0000 UTC m=+22.694148026" watchObservedRunningTime="2026-07-07 13:59:50.407887903 +0000 UTC m=+22.712575577"
Jul 07 13:59:50.408074 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.407973    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z67zg" podStartSLOduration=3.760888794 podStartE2EDuration="22.40797039s" totalImagesPullingTime="18.647081596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:50.407054574 +0000 UTC m=+22.711742242" watchObservedRunningTime="2026-07-07 13:59:50.40797039 +0000 UTC m=+22.712658085"
Jul 07 13:59:50.439016 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.438967    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rnd4k" podStartSLOduration=11.803306649 podStartE2EDuration="22.438940781s" totalImagesPullingTime="10.635634132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:50.438933642 +0000 UTC m=+22.743621310" watchObservedRunningTime="2026-07-07 13:59:50.438940781 +0000 UTC m=+22.743628452"
Jul 07 13:59:50.439625 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.439590    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9q4hg" podStartSLOduration=3.854422783 podStartE2EDuration="22.439574919s" totalImagesPullingTime="18.585152136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:50.422872608 +0000 UTC m=+22.727560279" watchObservedRunningTime="2026-07-07 13:59:50.439574919 +0000 UTC m=+22.744262590"
Jul 07 13:59:50.456300 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:50.456260    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5ng86" podStartSLOduration=3.844721828 podStartE2EDuration="22.456245554s" totalImagesPullingTime="18.611523726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:50.456035775 +0000 UTC m=+22.760723443" watchObservedRunningTime="2026-07-07 13:59:50.456245554 +0000 UTC m=+22.760933221"
Jul 07 13:59:51.392227 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:51.392146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hjl4d" event={"ID":"7f7e88bd-9992-475a-8303-f9fad419ca42","Type":"ContainerStarted","Data":"3b6f967577c127e0cc8bf90a0bcff4c6f4ce0ff9c86bfd8290540301dbadcfbc"}
Jul 07 13:59:51.395759 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:51.395722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"f83930fdba140ae51e3434cd052ec7abe2b0b58c42346cff96bbd3dcdc7e13ce"}
Jul 07 13:59:51.395893 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:51.395812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"c50316a25ae6625fa906c6a3270638f8dc06aa5c4f6ca918cd1e4cb4aadbee36"}
Jul 07 13:59:51.414642 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:51.414319    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hjl4d" podStartSLOduration=4.826443816 podStartE2EDuration="23.414297155s" totalImagesPullingTime="18.587853339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:51.413892066 +0000 UTC m=+23.718579734" watchObservedRunningTime="2026-07-07 13:59:51.414297155 +0000 UTC m=+23.718984825"
Jul 07 13:59:51.518540 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:51.518513    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 13:59:52.156355 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:52.156246    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T13:59:51.518531649Z","UUID":"0b6ac0b1-4dad-471f-980e-562c9e4d874c","Handler":null,"Name":"","Endpoint":""}
Jul 07 13:59:52.157812 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:52.157784    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 13:59:52.157942 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:52.157829    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 13:59:52.260077 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:52.260006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:52.260278 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:52.260006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:52.260278 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:52.260143    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:52.260278 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:52.260138    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:52.260278 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:52.260246    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:52.260488 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:52.260320    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:52.399538 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:52.399496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc" event={"ID":"8441f7e4-1f97-4993-b8c5-4a5685740595","Type":"ContainerStarted","Data":"5d995b809c3199e616d4ed0e3d36419d6ba615ac56fbca3fabe315cd0432eab4"}
Jul 07 13:59:53.403824 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:53.403784    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc" event={"ID":"8441f7e4-1f97-4993-b8c5-4a5685740595","Type":"ContainerStarted","Data":"61cc6f717d23142713b60f4d001801b32e66518bcfd749b7cbd0c25b8f64f68a"}
Jul 07 13:59:53.407833 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:53.407796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"14f9f911837ba37b7ccb4037fceac178d9dc5dea639d6ada7a64dbc13a22e6ac"}
Jul 07 13:59:53.423122 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:53.423066    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrcqc" podStartSLOduration=4.479906135 podStartE2EDuration="25.423045071s" totalImagesPullingTime="20.943138936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:53.422895484 +0000 UTC m=+25.727583151" watchObservedRunningTime="2026-07-07 13:59:53.423045071 +0000 UTC m=+25.727732739"
Jul 07 13:59:53.782141 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:53.782056    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:53.782853 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:53.782830    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:54.259271 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:54.259234    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:54.259467 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:54.259235    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:54.259467 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:54.259372    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:54.259467 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:54.259385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:54.259633 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:54.259468    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:54.259633 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:54.259548    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:55.415305 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:55.415098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" event={"ID":"b4a16edc-a263-4b99-932a-e038bea29c5b","Type":"ContainerStarted","Data":"b42dede0d4ff23f3dd3a3e3923e9dc3b72fc2126705285018247dab620d90adc"}
Jul 07 13:59:55.416072 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:55.415389    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:55.417080 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:55.417051    2577 generic.go:356] "Generic (PLEG): container finished" podID="fac14bab-e89f-4be8-af35-25a67357ca5c" containerID="9927ca600cba6a5098dc3c594491253bc559505d1c6c019fc7a46a7e19ec74ed" exitCode=0
Jul 07 13:59:55.417196 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:55.417095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerDied","Data":"9927ca600cba6a5098dc3c594491253bc559505d1c6c019fc7a46a7e19ec74ed"}
Jul 07 13:59:55.432354 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:55.432330    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:55.445190 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:55.445146    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz" podStartSLOduration=8.7881334 podStartE2EDuration="27.445131009s" totalImagesPullingTime="18.656997609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:55.444148966 +0000 UTC m=+27.748836636" watchObservedRunningTime="2026-07-07 13:59:55.445131009 +0000 UTC m=+27.749818677"
Jul 07 13:59:56.259665 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:56.259629    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:56.259665 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:56.259649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:56.259961 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:56.259634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:56.259961 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:56.259768    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:56.259961 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:56.259852    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:56.259961 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:56.259943    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:56.422601 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:56.421810    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:56.422601 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:56.421947    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:56.437831 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:56.437804    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 13:59:57.423852 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:57.423669    2577 generic.go:356] "Generic (PLEG): container finished" podID="fac14bab-e89f-4be8-af35-25a67357ca5c" containerID="22bd4421524457376d8c3d1520aaf9654b1c38cacb4ac02b49b494f84cab46f7" exitCode=0
Jul 07 13:59:57.423852 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:57.423758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerDied","Data":"22bd4421524457376d8c3d1520aaf9654b1c38cacb4ac02b49b494f84cab46f7"}
Jul 07 13:59:58.260162 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:58.260128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 13:59:58.260334 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:58.260168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 13:59:58.260334 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:58.260252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 13:59:58.260334 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:58.260254    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 13:59:58.260453 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:58.260347    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 13:59:58.260453 ip-10-0-128-208 kubenswrapper[2577]: E0707 13:59:58.260434    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 13:59:58.859251 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:58.859216    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:58.859681 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:58.859370    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 13:59:58.859992 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:58.859971    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rnd4k"
Jul 07 13:59:59.430181 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:59.430147    2577 generic.go:356] "Generic (PLEG): container finished" podID="fac14bab-e89f-4be8-af35-25a67357ca5c" containerID="aab725ea357c378c432e2aabfa7d278665765f447e7efc3ef7ea398768ebce57" exitCode=0
Jul 07 13:59:59.430360 ip-10-0-128-208 kubenswrapper[2577]: I0707 13:59:59.430228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerDied","Data":"aab725ea357c378c432e2aabfa7d278665765f447e7efc3ef7ea398768ebce57"}
Jul 07 14:00:00.259226 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:00.259193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:00.259226 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:00.259226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:00.259861 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:00.259191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:00.259861 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:00.259339    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:00.259861 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:00.259431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:00.259861 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:00.259515    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:01.845403 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:01.845363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:01.845889 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:01.845438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:01.845889 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:01.845522    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:00:01.845889 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:01.845574    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs podName:93966aa1-900e-4580-a35f-ba347c4de480 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:33.845559288 +0000 UTC m=+66.150246934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs") pod "network-metrics-daemon-j8brk" (UID: "93966aa1-900e-4580-a35f-ba347c4de480") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:00:01.845889 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:01.845522    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:00:01.845889 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:01.845639    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret podName:5513fbde-d669-45b1-965c-a250ed46ae4f nodeName:}" failed. No retries permitted until 2026-07-07 14:00:33.845628125 +0000 UTC m=+66.150315785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret") pod "global-pull-secret-syncer-b49hp" (UID: "5513fbde-d669-45b1-965c-a250ed46ae4f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:00:02.046771 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:02.046729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:02.046951 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:02.046908    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:00:02.046951 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:02.046938    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:00:02.046951 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:02.046951    2577 projected.go:196] Error preparing data for projected volume kube-api-access-dzg8m for pod openshift-network-diagnostics/network-check-target-zvrjb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:00:02.047104 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:02.047010    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m podName:88e372e3-a702-47aa-a562-b68fd43c3943 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:34.046993634 +0000 UTC m=+66.351681282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzg8m" (UniqueName: "kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m") pod "network-check-target-zvrjb" (UID: "88e372e3-a702-47aa-a562-b68fd43c3943") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:00:02.259442 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:02.259402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:02.259646 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:02.259403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:02.259646 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:02.259535    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:02.259646 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:02.259530    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:02.259646 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:02.259610    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:02.259876 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:02.259684    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:04.259345 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:04.259304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:04.259946 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:04.259303    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:04.259946 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:04.259450    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:04.259946 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:04.259507    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:04.259946 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:04.259307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:04.259946 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:04.259598    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:04.449215 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:04.449184    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerStarted","Data":"52963ef7f0268bd04fc3a510197bb3030c9532022895058704fa60f7b98d7efa"}
Jul 07 14:00:05.454405 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:05.454366    2577 generic.go:356] "Generic (PLEG): container finished" podID="fac14bab-e89f-4be8-af35-25a67357ca5c" containerID="52963ef7f0268bd04fc3a510197bb3030c9532022895058704fa60f7b98d7efa" exitCode=0
Jul 07 14:00:05.455021 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:05.454411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerDied","Data":"52963ef7f0268bd04fc3a510197bb3030c9532022895058704fa60f7b98d7efa"}
Jul 07 14:00:06.259914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:06.259871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:06.260108 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:06.259871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:06.260108 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:06.259982    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:06.260108 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:06.259997    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:06.260108 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:06.260059    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:06.260260 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:06.260147    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:06.460074 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:06.460042    2577 generic.go:356] "Generic (PLEG): container finished" podID="fac14bab-e89f-4be8-af35-25a67357ca5c" containerID="bd8e9fad1f5ab4dba6db2c56049c6b9c9f17462e6000bfc3f4fc67d2f707fe30" exitCode=0
Jul 07 14:00:06.460457 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:06.460113    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerDied","Data":"bd8e9fad1f5ab4dba6db2c56049c6b9c9f17462e6000bfc3f4fc67d2f707fe30"}
Jul 07 14:00:07.467048 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:07.467009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" event={"ID":"fac14bab-e89f-4be8-af35-25a67357ca5c","Type":"ContainerStarted","Data":"e69fda1d7c2e18c838c1949c3d5e968d0638e5f6c031c1579e26cc56cce4d0d1"}
Jul 07 14:00:07.516893 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:07.516839    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s4w7j" podStartSLOduration=9.109176666 podStartE2EDuration="39.516824611s" totalImagesPullingTime="30.407647945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:07.515616965 +0000 UTC m=+39.820304632" watchObservedRunningTime="2026-07-07 14:00:07.516824611 +0000 UTC m=+39.821512276"
Jul 07 14:00:08.260446 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:08.260406    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:08.260645 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:08.260487    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:08.260645 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:08.260498    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:08.260645 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:08.260586    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:08.260645 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:08.260629    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:08.260884 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:08.260674    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:09.085975 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:09.085771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvrjb"]
Jul 07 14:00:09.086430 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:09.086061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:09.086430 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:09.086152    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:09.088460 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:09.088432    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j8brk"]
Jul 07 14:00:09.088595 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:09.088545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:09.088682 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:09.088659    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:09.101649 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:09.101617    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b49hp"]
Jul 07 14:00:09.101804 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:09.101733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:09.101867 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:09.101815    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:10.259373 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:10.259333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:10.259799 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:10.259443    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:11.259799 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:11.259760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:11.260190 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:11.259764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:11.260190 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:11.259876    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:11.260190 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:11.259942    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:12.259829 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:12.259795    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:12.260193 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:12.259908    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b49hp" podUID="5513fbde-d669-45b1-965c-a250ed46ae4f"
Jul 07 14:00:13.259165 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.259134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:13.259475 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.259182    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:13.259475 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:13.259269    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8brk" podUID="93966aa1-900e-4580-a35f-ba347c4de480"
Jul 07 14:00:13.259475 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:13.259451    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zvrjb" podUID="88e372e3-a702-47aa-a562-b68fd43c3943"
Jul 07 14:00:13.417521 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.417493    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-208.ec2.internal" event="NodeReady"
Jul 07 14:00:13.417946 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.417632    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 14:00:13.461509 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.461474    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvmnz"]
Jul 07 14:00:13.474880 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.474850    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4cphg"]
Jul 07 14:00:13.475062 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.474989    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.477503 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.477479    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 14:00:13.477503 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.477483    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m8lp\""
Jul 07 14:00:13.477787 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.477517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 14:00:13.485892 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.485860    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvmnz"]
Jul 07 14:00:13.486040 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.485970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.486040 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.485992    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cphg"]
Jul 07 14:00:13.486752 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.486732    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mdv2b"]
Jul 07 14:00:13.488456 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.488438    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 14:00:13.488548 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.488506    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 14:00:13.488617 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.488601    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5hr8l\""
Jul 07 14:00:13.488763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.488743    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 14:00:13.488763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.488762    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 14:00:13.502013 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.501983    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mdv2b"]
Jul 07 14:00:13.502198 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.502111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:13.504417 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.504392    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 14:00:13.504666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.504649    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 14:00:13.504759 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.504659    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 14:00:13.505058 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.505044    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cgt9h\""
Jul 07 14:00:13.629412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5714e4c-867c-4a5a-b791-aaa1baeffb78-crio-socket\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.629412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cfe292-b441-45fa-84a9-df8130b27d32-config-volume\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.629412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0897d57f-e7b9-4346-8ded-d4f1fd68ca99-cert\") pod \"ingress-canary-mdv2b\" (UID: \"0897d57f-e7b9-4346-8ded-d4f1fd68ca99\") " pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:13.629639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br7st\" (UniqueName: \"kubernetes.io/projected/d5714e4c-867c-4a5a-b791-aaa1baeffb78-kube-api-access-br7st\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.629639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cfe292-b441-45fa-84a9-df8130b27d32-tmp-dir\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.629639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57z52\" (UniqueName: \"kubernetes.io/projected/0897d57f-e7b9-4346-8ded-d4f1fd68ca99-kube-api-access-57z52\") pod \"ingress-canary-mdv2b\" (UID: \"0897d57f-e7b9-4346-8ded-d4f1fd68ca99\") " pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:13.629639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv2r4\" (UniqueName: \"kubernetes.io/projected/11cfe292-b441-45fa-84a9-df8130b27d32-kube-api-access-gv2r4\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.629639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5714e4c-867c-4a5a-b791-aaa1baeffb78-data-volume\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.629639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5714e4c-867c-4a5a-b791-aaa1baeffb78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.629858 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5714e4c-867c-4a5a-b791-aaa1baeffb78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.629858 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.629724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cfe292-b441-45fa-84a9-df8130b27d32-metrics-tls\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.730744 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cfe292-b441-45fa-84a9-df8130b27d32-config-volume\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.730744 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0897d57f-e7b9-4346-8ded-d4f1fd68ca99-cert\") pod \"ingress-canary-mdv2b\" (UID: \"0897d57f-e7b9-4346-8ded-d4f1fd68ca99\") " pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br7st\" (UniqueName: \"kubernetes.io/projected/d5714e4c-867c-4a5a-b791-aaa1baeffb78-kube-api-access-br7st\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cfe292-b441-45fa-84a9-df8130b27d32-tmp-dir\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57z52\" (UniqueName: \"kubernetes.io/projected/0897d57f-e7b9-4346-8ded-d4f1fd68ca99-kube-api-access-57z52\") pod \"ingress-canary-mdv2b\" (UID: \"0897d57f-e7b9-4346-8ded-d4f1fd68ca99\") " pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv2r4\" (UniqueName: \"kubernetes.io/projected/11cfe292-b441-45fa-84a9-df8130b27d32-kube-api-access-gv2r4\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5714e4c-867c-4a5a-b791-aaa1baeffb78-data-volume\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5714e4c-867c-4a5a-b791-aaa1baeffb78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5714e4c-867c-4a5a-b791-aaa1baeffb78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.730999 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.730998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cfe292-b441-45fa-84a9-df8130b27d32-metrics-tls\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.731381 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.731031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5714e4c-867c-4a5a-b791-aaa1baeffb78-crio-socket\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.731381 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.731221    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cfe292-b441-45fa-84a9-df8130b27d32-tmp-dir\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.731381 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.731281    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5714e4c-867c-4a5a-b791-aaa1baeffb78-crio-socket\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.731576 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.731544    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11cfe292-b441-45fa-84a9-df8130b27d32-config-volume\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.731722 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.731572    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5714e4c-867c-4a5a-b791-aaa1baeffb78-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.731777 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.731748    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5714e4c-867c-4a5a-b791-aaa1baeffb78-data-volume\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.735005 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.734976    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11cfe292-b441-45fa-84a9-df8130b27d32-metrics-tls\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.735134 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.735011    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0897d57f-e7b9-4346-8ded-d4f1fd68ca99-cert\") pod \"ingress-canary-mdv2b\" (UID: \"0897d57f-e7b9-4346-8ded-d4f1fd68ca99\") " pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:13.735134 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.735026    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5714e4c-867c-4a5a-b791-aaa1baeffb78-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.738782 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.738750    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57z52\" (UniqueName: \"kubernetes.io/projected/0897d57f-e7b9-4346-8ded-d4f1fd68ca99-kube-api-access-57z52\") pod \"ingress-canary-mdv2b\" (UID: \"0897d57f-e7b9-4346-8ded-d4f1fd68ca99\") " pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:13.739470 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.739443    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br7st\" (UniqueName: \"kubernetes.io/projected/d5714e4c-867c-4a5a-b791-aaa1baeffb78-kube-api-access-br7st\") pod \"insights-runtime-extractor-4cphg\" (UID: \"d5714e4c-867c-4a5a-b791-aaa1baeffb78\") " pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.739569 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.739467    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv2r4\" (UniqueName: \"kubernetes.io/projected/11cfe292-b441-45fa-84a9-df8130b27d32-kube-api-access-gv2r4\") pod \"dns-default-gvmnz\" (UID: \"11cfe292-b441-45fa-84a9-df8130b27d32\") " pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.785763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.785729    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:13.794883 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.794857    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4cphg"
Jul 07 14:00:13.811044 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:13.811016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mdv2b"
Jul 07 14:00:14.005343 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.005168    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvmnz"]
Jul 07 14:00:14.008426 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:14.008386    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cfe292_b441_45fa_84a9_df8130b27d32.slice/crio-68d6c7797340348e0aa65ad13815211014144224bffb6b07610ebc72f05f5cac WatchSource:0}: Error finding container 68d6c7797340348e0aa65ad13815211014144224bffb6b07610ebc72f05f5cac: Status 404 returned error can't find the container with id 68d6c7797340348e0aa65ad13815211014144224bffb6b07610ebc72f05f5cac
Jul 07 14:00:14.013865 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.013840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4cphg"]
Jul 07 14:00:14.018913 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:14.018888    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5714e4c_867c_4a5a_b791_aaa1baeffb78.slice/crio-ac18f83db87406bdf3058b91c67f55b2fd8e240a71a86b8d5bfc314738d100d4 WatchSource:0}: Error finding container ac18f83db87406bdf3058b91c67f55b2fd8e240a71a86b8d5bfc314738d100d4: Status 404 returned error can't find the container with id ac18f83db87406bdf3058b91c67f55b2fd8e240a71a86b8d5bfc314738d100d4
Jul 07 14:00:14.019267 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.019247    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mdv2b"]
Jul 07 14:00:14.022355 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:14.022334    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0897d57f_e7b9_4346_8ded_d4f1fd68ca99.slice/crio-a118382a09c0c2b4319001bc00a4b87a46f2bb51abb49ac8e4940a862b1784d7 WatchSource:0}: Error finding container a118382a09c0c2b4319001bc00a4b87a46f2bb51abb49ac8e4940a862b1784d7: Status 404 returned error can't find the container with id a118382a09c0c2b4319001bc00a4b87a46f2bb51abb49ac8e4940a862b1784d7
Jul 07 14:00:14.259955 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.259875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:14.262297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.262271    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:00:14.484669 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.484631    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mdv2b" event={"ID":"0897d57f-e7b9-4346-8ded-d4f1fd68ca99","Type":"ContainerStarted","Data":"a118382a09c0c2b4319001bc00a4b87a46f2bb51abb49ac8e4940a862b1784d7"}
Jul 07 14:00:14.485710 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.485670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cphg" event={"ID":"d5714e4c-867c-4a5a-b791-aaa1baeffb78","Type":"ContainerStarted","Data":"ac18f83db87406bdf3058b91c67f55b2fd8e240a71a86b8d5bfc314738d100d4"}
Jul 07 14:00:14.486610 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:14.486592    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvmnz" event={"ID":"11cfe292-b441-45fa-84a9-df8130b27d32","Type":"ContainerStarted","Data":"68d6c7797340348e0aa65ad13815211014144224bffb6b07610ebc72f05f5cac"}
Jul 07 14:00:15.259951 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.259878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:15.259951 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.259897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:15.265416 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.264257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rw24\""
Jul 07 14:00:15.265416 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.264519    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:00:15.265416 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.264812    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:00:15.265416 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.265017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zznv\""
Jul 07 14:00:15.272247 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.270607    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:00:15.331408 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.330267    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55b5b8c4f9-5tt9z"]
Jul 07 14:00:15.361834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.361771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b5b8c4f9-5tt9z"]
Jul 07 14:00:15.361834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.361853    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.369711 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.369473    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6f7x2\""
Jul 07 14:00:15.370420 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.370191    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 14:00:15.374436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.370711    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 14:00:15.374436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.371027    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 14:00:15.374436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.371305    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 14:00:15.374436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.371579    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 14:00:15.374436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.372104    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 14:00:15.374436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.372349    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 14:00:15.548372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.548280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-console-config\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.548372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.548343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-oauth-config\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.548372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.548369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-oauth-serving-cert\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.548946 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.548397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4lc6\" (UniqueName: \"kubernetes.io/projected/6ece219e-6ccf-4b98-95a3-54c172160d35-kube-api-access-j4lc6\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.548946 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.548434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-service-ca\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.548946 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.548474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-serving-cert\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.649109 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.649071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-console-config\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.649303 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.649152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-oauth-config\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.649303 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.649177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-oauth-serving-cert\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.649303 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.649223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4lc6\" (UniqueName: \"kubernetes.io/projected/6ece219e-6ccf-4b98-95a3-54c172160d35-kube-api-access-j4lc6\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.649303 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.649261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-service-ca\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.649303 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.649294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-serving-cert\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.650007 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.649980    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-console-config\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.650500 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.650479    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-oauth-serving-cert\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.650802 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.650755    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-service-ca\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.657232 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.657190    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-serving-cert\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.659161 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.659113    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-oauth-config\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.670732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.670647    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4lc6\" (UniqueName: \"kubernetes.io/projected/6ece219e-6ccf-4b98-95a3-54c172160d35-kube-api-access-j4lc6\") pod \"console-55b5b8c4f9-5tt9z\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") " pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.676585 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.676266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:15.854550 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:15.854457    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b5b8c4f9-5tt9z"]
Jul 07 14:00:15.858409 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:15.858372    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ece219e_6ccf_4b98_95a3_54c172160d35.slice/crio-5f029211d027815419bfa93778c3b68c87cb5eb58e41efa02ad3440b8180a97b WatchSource:0}: Error finding container 5f029211d027815419bfa93778c3b68c87cb5eb58e41efa02ad3440b8180a97b: Status 404 returned error can't find the container with id 5f029211d027815419bfa93778c3b68c87cb5eb58e41efa02ad3440b8180a97b
Jul 07 14:00:16.494719 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.494669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b5b8c4f9-5tt9z" event={"ID":"6ece219e-6ccf-4b98-95a3-54c172160d35","Type":"ContainerStarted","Data":"5f029211d027815419bfa93778c3b68c87cb5eb58e41efa02ad3440b8180a97b"}
Jul 07 14:00:16.711505 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.711468    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"]
Jul 07 14:00:16.743934 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.743897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"]
Jul 07 14:00:16.744126 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.744022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.746945 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.746865    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 14:00:16.747072 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.746990    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 14:00:16.747122 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.747084    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 14:00:16.747122 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.747090    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 14:00:16.747658 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.747632    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 14:00:16.747834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.747674    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-frdwf\""
Jul 07 14:00:16.860763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.860719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdr2\" (UniqueName: \"kubernetes.io/projected/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-kube-api-access-qtdr2\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.860941 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.860786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.860941 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.860850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.861037 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.860965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.962223 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.962190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.962399 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.962271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdr2\" (UniqueName: \"kubernetes.io/projected/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-kube-api-access-qtdr2\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.962399 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.962326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.962399 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.962386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.962582 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:16.962505    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 14:00:16.962582 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:00:16.962567    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-tls podName:cf347f3b-e0e7-44ce-9065-f9e4b64b2529 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:17.462547769 +0000 UTC m=+49.767235418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-5ckmd" (UID: "cf347f3b-e0e7-44ce-9065-f9e4b64b2529") : secret "prometheus-operator-tls" not found
Jul 07 14:00:16.962956 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.962913    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.965314 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.965286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:16.971338 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:16.971315    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdr2\" (UniqueName: \"kubernetes.io/projected/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-kube-api-access-qtdr2\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:17.465966 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:17.465931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:17.468769 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:17.468736    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf347f3b-e0e7-44ce-9065-f9e4b64b2529-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-5ckmd\" (UID: \"cf347f3b-e0e7-44ce-9065-f9e4b64b2529\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:17.656012 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:17.655972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"
Jul 07 14:00:20.389488 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:20.389262    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd"]
Jul 07 14:00:20.392627 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:20.392593    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf347f3b_e0e7_44ce_9065_f9e4b64b2529.slice/crio-982a71ad1df1517bd4200993cbea0d0801809cb6fd49bc8204e8f41ca50f857e WatchSource:0}: Error finding container 982a71ad1df1517bd4200993cbea0d0801809cb6fd49bc8204e8f41ca50f857e: Status 404 returned error can't find the container with id 982a71ad1df1517bd4200993cbea0d0801809cb6fd49bc8204e8f41ca50f857e
Jul 07 14:00:20.509529 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:20.509397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mdv2b" event={"ID":"0897d57f-e7b9-4346-8ded-d4f1fd68ca99","Type":"ContainerStarted","Data":"2b9f695f34e21ff17e0b7875726c35d3389abd349828441cb926680c11d42af3"}
Jul 07 14:00:20.511497 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:20.511466    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvmnz" event={"ID":"11cfe292-b441-45fa-84a9-df8130b27d32","Type":"ContainerStarted","Data":"39f291d92d2750e9d388be8262a10b63394e938de93d519b6686fb1d99f74f97"}
Jul 07 14:00:20.513095 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:20.513073    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd" event={"ID":"cf347f3b-e0e7-44ce-9065-f9e4b64b2529","Type":"ContainerStarted","Data":"982a71ad1df1517bd4200993cbea0d0801809cb6fd49bc8204e8f41ca50f857e"}
Jul 07 14:00:20.529728 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:20.529627    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mdv2b" podStartSLOduration=1.303033101 podStartE2EDuration="7.529607015s" totalImagesPullingTime="6.226573914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:20.528016311 +0000 UTC m=+52.832703980" watchObservedRunningTime="2026-07-07 14:00:20.529607015 +0000 UTC m=+52.834294681"
Jul 07 14:00:21.517848 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:21.517807    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cphg" event={"ID":"d5714e4c-867c-4a5a-b791-aaa1baeffb78","Type":"ContainerStarted","Data":"d394097b7638afc2aedc948c15cf3cd436f394da5d4eec1a233659c701f54b29"}
Jul 07 14:00:21.519877 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:21.519848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvmnz" event={"ID":"11cfe292-b441-45fa-84a9-df8130b27d32","Type":"ContainerStarted","Data":"23a356ec89e6b254caf72b7c35fb5a29896a7f8d6348747dbd0a7651bb3cbbdc"}
Jul 07 14:00:21.538262 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:21.538198    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gvmnz" podStartSLOduration=2.308480688 podStartE2EDuration="8.538179004s" totalImagesPullingTime="6.229698316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:21.536727731 +0000 UTC m=+53.841415399" watchObservedRunningTime="2026-07-07 14:00:21.538179004 +0000 UTC m=+53.842866650"
Jul 07 14:00:22.525543 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:22.525269    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b5b8c4f9-5tt9z" event={"ID":"6ece219e-6ccf-4b98-95a3-54c172160d35","Type":"ContainerStarted","Data":"5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139"}
Jul 07 14:00:22.527403 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:22.527371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cphg" event={"ID":"d5714e4c-867c-4a5a-b791-aaa1baeffb78","Type":"ContainerStarted","Data":"dda2fe71e73e3ec77183a7810190b3d6f0b31d726b8aaa6730179e5c08afd586"}
Jul 07 14:00:22.527635 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:22.527603    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:22.543436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:22.543387    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55b5b8c4f9-5tt9z" podStartSLOduration=1.5331081979999999 podStartE2EDuration="7.543370337s" totalImagesPullingTime="6.010262139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:22.542419643 +0000 UTC m=+54.847107311" watchObservedRunningTime="2026-07-07 14:00:22.543370337 +0000 UTC m=+54.848058001"
Jul 07 14:00:23.532548 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:23.532511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd" event={"ID":"cf347f3b-e0e7-44ce-9065-f9e4b64b2529","Type":"ContainerStarted","Data":"853105ef23dadc8187a198f372d80c46b068ca7c37f459c9046f2bd84e99e2ee"}
Jul 07 14:00:23.533099 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:23.532602    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd" event={"ID":"cf347f3b-e0e7-44ce-9065-f9e4b64b2529","Type":"ContainerStarted","Data":"5cfd716458bc850362088f9e50230cf1fa84872fa9bc830e9f6eaaf0866315f5"}
Jul 07 14:00:23.552794 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:23.552696    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-5ckmd" podStartSLOduration=4.906343816 podStartE2EDuration="7.552664839s" totalImagesPullingTime="2.646321023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:23.551138381 +0000 UTC m=+55.855826049" watchObservedRunningTime="2026-07-07 14:00:23.552664839 +0000 UTC m=+55.857352513"
Jul 07 14:00:25.044172 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.044125    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"]
Jul 07 14:00:25.136339 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.136304    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"]
Jul 07 14:00:25.136511 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.136366    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bmpqs"]
Jul 07 14:00:25.136571 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.136548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.139089 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.139057    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 14:00:25.139089 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.139069    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-n5w5w\""
Jul 07 14:00:25.139089 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.139059    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 14:00:25.168470 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.168445    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.170873 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.170843    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 14:00:25.171014 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.170900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4zbsd\""
Jul 07 14:00:25.171014 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.170902    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 14:00:25.171014 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.170843    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 14:00:25.233738 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.233702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/436b4492-2e27-4317-889e-7fabc84c4584-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.233927 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.233748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-wtmp\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.233927 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.233778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436b4492-2e27-4317-889e-7fabc84c4584-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.233927 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.233814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-textfile\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.233927 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.233844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-sys\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.234207 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.233955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/436b4492-2e27-4317-889e-7fabc84c4584-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.234207 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.233994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.234207 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.234092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-root\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.234207 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.234176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9b95\" (UniqueName: \"kubernetes.io/projected/436b4492-2e27-4317-889e-7fabc84c4584-kube-api-access-h9b95\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.234429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.234214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcqvs\" (UniqueName: \"kubernetes.io/projected/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-kube-api-access-bcqvs\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.234429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.234256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.234429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.234287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-metrics-client-ca\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.234429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.234312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-tls\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335443 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9b95\" (UniqueName: \"kubernetes.io/projected/436b4492-2e27-4317-889e-7fabc84c4584-kube-api-access-h9b95\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.335443 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcqvs\" (UniqueName: \"kubernetes.io/projected/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-kube-api-access-bcqvs\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335626 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335626 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-metrics-client-ca\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335715 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-tls\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335758 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/436b4492-2e27-4317-889e-7fabc84c4584-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.335758 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-wtmp\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335825 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436b4492-2e27-4317-889e-7fabc84c4584-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.335875 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-textfile\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335911 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335877    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-wtmp\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335911 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-sys\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.335980 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/436b4492-2e27-4317-889e-7fabc84c4584-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.336021 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.335986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.336021 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.336017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-root\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.336120 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.336105    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-root\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.336186 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.336147    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.336239 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.336221    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-metrics-client-ca\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.336297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.336283    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-sys\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.336379 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.336362    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-textfile\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.336535 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.336500    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436b4492-2e27-4317-889e-7fabc84c4584-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.339877 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.339855    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/436b4492-2e27-4317-889e-7fabc84c4584-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.339997 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.339887    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.339997 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.339912    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-node-exporter-tls\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.340071 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.340020    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/436b4492-2e27-4317-889e-7fabc84c4584-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.350383 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.350352    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcqvs\" (UniqueName: \"kubernetes.io/projected/c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64-kube-api-access-bcqvs\") pod \"node-exporter-bmpqs\" (UID: \"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64\") " pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.350501 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.350471    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9b95\" (UniqueName: \"kubernetes.io/projected/436b4492-2e27-4317-889e-7fabc84c4584-kube-api-access-h9b95\") pod \"openshift-state-metrics-54cf96dfcf-ddlhg\" (UID: \"436b4492-2e27-4317-889e-7fabc84c4584\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.447655 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.447622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"
Jul 07 14:00:25.478418 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.478389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmpqs"
Jul 07 14:00:25.503939 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:25.503898    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f76a5f_0f3b_4621_82fd_ae0fda8b5e64.slice/crio-3534c02399f57c7930e2ecfcc87668ddf7850e8e35d62a40b75965a0af98f4d0 WatchSource:0}: Error finding container 3534c02399f57c7930e2ecfcc87668ddf7850e8e35d62a40b75965a0af98f4d0: Status 404 returned error can't find the container with id 3534c02399f57c7930e2ecfcc87668ddf7850e8e35d62a40b75965a0af98f4d0
Jul 07 14:00:25.545311 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.545276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmpqs" event={"ID":"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64","Type":"ContainerStarted","Data":"3534c02399f57c7930e2ecfcc87668ddf7850e8e35d62a40b75965a0af98f4d0"}
Jul 07 14:00:25.598608 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.598524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg"]
Jul 07 14:00:25.602032 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:25.602003    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436b4492_2e27_4317_889e_7fabc84c4584.slice/crio-06497626c53b768f6b9732a06ea65e1c87751eafb5968be51fdf50f94d3f9a21 WatchSource:0}: Error finding container 06497626c53b768f6b9732a06ea65e1c87751eafb5968be51fdf50f94d3f9a21: Status 404 returned error can't find the container with id 06497626c53b768f6b9732a06ea65e1c87751eafb5968be51fdf50f94d3f9a21
Jul 07 14:00:25.677443 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.677405    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:25.677606 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.677462    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:25.682475 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:25.682451    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:26.552235 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:26.551982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4cphg" event={"ID":"d5714e4c-867c-4a5a-b791-aaa1baeffb78","Type":"ContainerStarted","Data":"7b2a6b2be0a5f5ea03b9b8c1a902341cc29a604d42416b84bdfa957b7e21774f"}
Jul 07 14:00:26.554564 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:26.554535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg" event={"ID":"436b4492-2e27-4317-889e-7fabc84c4584","Type":"ContainerStarted","Data":"31e14f9a9c47ac5f192d0e2b1c00ff7381174c744a90d48f1713a7cb8b994a32"}
Jul 07 14:00:26.554746 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:26.554599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg" event={"ID":"436b4492-2e27-4317-889e-7fabc84c4584","Type":"ContainerStarted","Data":"094571e8ce7bc6844014bc0dadfda1e6b878e8874e4a683a788c05d8928f3b9c"}
Jul 07 14:00:26.554746 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:26.554626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg" event={"ID":"436b4492-2e27-4317-889e-7fabc84c4584","Type":"ContainerStarted","Data":"06497626c53b768f6b9732a06ea65e1c87751eafb5968be51fdf50f94d3f9a21"}
Jul 07 14:00:26.559395 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:26.559367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:00:26.575604 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:26.575543    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4cphg" podStartSLOduration=1.971585629 podStartE2EDuration="13.57552033s" totalImagesPullingTime="11.603934701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:00:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:26.574714844 +0000 UTC m=+58.879402514" watchObservedRunningTime="2026-07-07 14:00:26.57552033 +0000 UTC m=+58.880208000"
Jul 07 14:00:27.559186 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:27.559092    2577 generic.go:356] "Generic (PLEG): container finished" podID="c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64" containerID="f7b5830e2bc29eb5d22674c00ca64caa400734817729022101c4d43a78f2da66" exitCode=0
Jul 07 14:00:27.559186 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:27.559177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmpqs" event={"ID":"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64","Type":"ContainerDied","Data":"f7b5830e2bc29eb5d22674c00ca64caa400734817729022101c4d43a78f2da66"}
Jul 07 14:00:27.561286 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:27.561259    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg" event={"ID":"436b4492-2e27-4317-889e-7fabc84c4584","Type":"ContainerStarted","Data":"6c34b4da5962958440b85d18cf330d6925496a4d70456e95cafbfb010c966ad5"}
Jul 07 14:00:27.597887 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:27.597841    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ddlhg" podStartSLOduration=1.3730765329999999 podStartE2EDuration="2.597826388s" totalImagesPullingTime="1.224749855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:27.596886682 +0000 UTC m=+59.901574363" watchObservedRunningTime="2026-07-07 14:00:27.597826388 +0000 UTC m=+59.902514057"
Jul 07 14:00:28.139770 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.139733    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"]
Jul 07 14:00:28.144208 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.144185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.146812 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.146781    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8npc2\""
Jul 07 14:00:28.146930 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.146837    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-18vj4ce5j5mc0\""
Jul 07 14:00:28.146990 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.146933    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 14:00:28.147102 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.147087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 14:00:28.147311 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.147296    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 14:00:28.147507 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.147493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 14:00:28.147550 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.147523    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 14:00:28.156623 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.156600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"]
Jul 07 14:00:28.263982 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.263946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-metrics-client-ca\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.264179 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.264036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.264179 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.264076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.264179 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.264136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-tls\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.264323 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.264275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-grpc-tls\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.264383 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.264353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cht2\" (UniqueName: \"kubernetes.io/projected/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-kube-api-access-7cht2\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.264556 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.264537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.264724 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.264708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.365988 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.365947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-tls\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.366191 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.365997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-grpc-tls\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.366191 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.366053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cht2\" (UniqueName: \"kubernetes.io/projected/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-kube-api-access-7cht2\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.366191 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.366114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.366191 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.366142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.366191 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.366168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-metrics-client-ca\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.366456 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.366218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.366456 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.366245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.367091 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.367024    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-metrics-client-ca\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.368947 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.368913    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.368947 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.368939    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-grpc-tls\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.369132 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.369030    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-tls\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.369205 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.369185    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.369257 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.369200    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.369293 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.369265    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.373846 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.373825    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cht2\" (UniqueName: \"kubernetes.io/projected/a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2-kube-api-access-7cht2\") pod \"thanos-querier-66d55d44fb-ptwdc\" (UID: \"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2\") " pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.437190 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.437119    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ppnwz"
Jul 07 14:00:28.454884 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.454857    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:28.567103 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.567067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmpqs" event={"ID":"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64","Type":"ContainerStarted","Data":"6e34a6c93045ba3ef7948716c4e7b8d983e12ca6fb3b117aeb24d432f611f149"}
Jul 07 14:00:28.567552 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.567130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmpqs" event={"ID":"c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64","Type":"ContainerStarted","Data":"82cbad756e69b19bb36ec4fcd636971b483610a75af076d2c128f8b502788688"}
Jul 07 14:00:28.586059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.586030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"]
Jul 07 14:00:28.586449 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:28.586405    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bmpqs" podStartSLOduration=2.3632512500000002 podStartE2EDuration="3.586391545s" totalImagesPullingTime="1.159285855s" totalInitContainerRuntime="63.85444ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:28.585592312 +0000 UTC m=+60.890279980" watchObservedRunningTime="2026-07-07 14:00:28.586391545 +0000 UTC m=+60.891079211"
Jul 07 14:00:28.591192 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:28.591166    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9501b1c_ed1e_4551_8d0b_8921bb3bf8b2.slice/crio-488385118fdf14add1436daeaa8aabde6e7cae770b0078628bb5af25e2493104 WatchSource:0}: Error finding container 488385118fdf14add1436daeaa8aabde6e7cae770b0078628bb5af25e2493104: Status 404 returned error can't find the container with id 488385118fdf14add1436daeaa8aabde6e7cae770b0078628bb5af25e2493104
Jul 07 14:00:29.572392 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.572357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" event={"ID":"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2","Type":"ContainerStarted","Data":"488385118fdf14add1436daeaa8aabde6e7cae770b0078628bb5af25e2493104"}
Jul 07 14:00:29.839056 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.838958    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"]
Jul 07 14:00:29.841206 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.841179    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:29.843534 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.843508    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sc468\""
Jul 07 14:00:29.843667 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.843591    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 14:00:29.855476 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.855454    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"]
Jul 07 14:00:29.879575 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.879544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jktsq\" (UniqueName: \"kubernetes.io/projected/1153ec1c-d841-417a-b084-debde898d01d-kube-api-access-jktsq\") pod \"monitoring-plugin-d5dcff7cf-7dvs6\" (UID: \"1153ec1c-d841-417a-b084-debde898d01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:29.879781 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.879597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1153ec1c-d841-417a-b084-debde898d01d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7dvs6\" (UID: \"1153ec1c-d841-417a-b084-debde898d01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:29.980965 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.980921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jktsq\" (UniqueName: \"kubernetes.io/projected/1153ec1c-d841-417a-b084-debde898d01d-kube-api-access-jktsq\") pod \"monitoring-plugin-d5dcff7cf-7dvs6\" (UID: \"1153ec1c-d841-417a-b084-debde898d01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:29.980965 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.980973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1153ec1c-d841-417a-b084-debde898d01d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7dvs6\" (UID: \"1153ec1c-d841-417a-b084-debde898d01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:29.983464 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.983433    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1153ec1c-d841-417a-b084-debde898d01d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7dvs6\" (UID: \"1153ec1c-d841-417a-b084-debde898d01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:29.989277 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:29.989244    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jktsq\" (UniqueName: \"kubernetes.io/projected/1153ec1c-d841-417a-b084-debde898d01d-kube-api-access-jktsq\") pod \"monitoring-plugin-d5dcff7cf-7dvs6\" (UID: \"1153ec1c-d841-417a-b084-debde898d01d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:30.152766 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.152724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:30.570166 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.570089    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f745cdb9d-xvwsb"]
Jul 07 14:00:30.572487 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.572467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.580760 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.580733    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 14:00:30.583375 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.583343    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f745cdb9d-xvwsb"]
Jul 07 14:00:30.692517 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.692469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-service-ca\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.692647 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.692528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hstpw\" (UniqueName: \"kubernetes.io/projected/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-kube-api-access-hstpw\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.692647 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.692582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-config\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.692647 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.692604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-oauth-config\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.692829 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.692713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-trusted-ca-bundle\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.692829 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.692785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-serving-cert\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.692934 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.692877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-oauth-serving-cert\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.782148 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.782117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"]
Jul 07 14:00:30.785526 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:30.785496    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1153ec1c_d841_417a_b084_debde898d01d.slice/crio-6e62a4e19ccc90488595d830476fdf576775c352a9ad5a4a6e3fc71bed7251c3 WatchSource:0}: Error finding container 6e62a4e19ccc90488595d830476fdf576775c352a9ad5a4a6e3fc71bed7251c3: Status 404 returned error can't find the container with id 6e62a4e19ccc90488595d830476fdf576775c352a9ad5a4a6e3fc71bed7251c3
Jul 07 14:00:30.793374 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.793344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-serving-cert\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.793505 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.793446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-oauth-serving-cert\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.793505 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.793501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-service-ca\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.793615 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.793525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hstpw\" (UniqueName: \"kubernetes.io/projected/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-kube-api-access-hstpw\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.793615 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.793557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-config\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.793853 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.793825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-oauth-config\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.793966 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.793897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-trusted-ca-bundle\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.794311 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.794271    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-service-ca\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.794311 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.794293    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-config\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.794897 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.794872    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-oauth-serving-cert\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.795080 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.795063    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-trusted-ca-bundle\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.796102 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.796071    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-serving-cert\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.796371 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.796348    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-oauth-config\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.801322 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.801185    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hstpw\" (UniqueName: \"kubernetes.io/projected/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-kube-api-access-hstpw\") pod \"console-7f745cdb9d-xvwsb\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") " pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:30.885089 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:30.885067    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:31.013437 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.013403    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f745cdb9d-xvwsb"]
Jul 07 14:00:31.016631 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:31.016577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a9f647_1b29_413b_95c6_5d9a7be87dd4.slice/crio-fa61007ffddd64ecf1f5df00fb8eb77910bd435f30b344c06fdacdbbb68513e0 WatchSource:0}: Error finding container fa61007ffddd64ecf1f5df00fb8eb77910bd435f30b344c06fdacdbbb68513e0: Status 404 returned error can't find the container with id fa61007ffddd64ecf1f5df00fb8eb77910bd435f30b344c06fdacdbbb68513e0
Jul 07 14:00:31.267665 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.267398    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:00:31.270478 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.270457    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.274445 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.274413    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 14:00:31.274751 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.274715    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 14:00:31.275733 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.275712    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 14:00:31.275919 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.275730    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 14:00:31.276001 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.275730    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 14:00:31.276001 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.275743    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 14:00:31.276080 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.275837    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 14:00:31.276080 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.275911    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aios1qs77mvbl\""
Jul 07 14:00:31.276161 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.275915    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pjlkw\""
Jul 07 14:00:31.276239 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.276221    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 14:00:31.276301 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.276267    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 14:00:31.276350 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.276223    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 14:00:31.280325 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.280309    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 14:00:31.280424 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.280405    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 14:00:31.280833 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.280816    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 14:00:31.282014 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.281997    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 14:00:31.283781 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.283759    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 14:00:31.299506 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.299463    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:00:31.399757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.399757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.399757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.399757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.399991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfl59\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-kube-api-access-bfl59\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-config\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.400522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.400299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfl59\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-kube-api-access-bfl59\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-config\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.501977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.502001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.502631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.502030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.503611 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.502064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.503611 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.502086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.503611 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.502126    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.508854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.503720    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.508854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.504170    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.508854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.504930    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.508854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.505271    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.508854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.505577    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.508854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.506091    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.508854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.506412    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.509794 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.509751    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.511311 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.511286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-config\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.512742 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.512668    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.514407 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.514374    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.514503 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.514407    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.515158 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.514671    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.515158 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.514812    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.515158 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.515118    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.515158 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.515146    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.515385 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.515183    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.515385 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.515191    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.516510 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.516488    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.520977 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.520910    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfl59\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-kube-api-access-bfl59\") pod \"prometheus-k8s-0\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.582396 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.582172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:31.585789 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.585458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" event={"ID":"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2","Type":"ContainerStarted","Data":"689922c1a2665be488ccadb9272ebc6735b84f28de4701d151195403ec6c2c5d"}
Jul 07 14:00:31.585789 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.585568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" event={"ID":"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2","Type":"ContainerStarted","Data":"dc56a70111d595d8d50d45729bcde22d921c260b28c4006fec6ee3411c45f208"}
Jul 07 14:00:31.585789 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.585615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" event={"ID":"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2","Type":"ContainerStarted","Data":"0b1ddc47efdc73d355130820e5465c24377a7de2c9da449a978ee7472a6a9eca"}
Jul 07 14:00:31.587389 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.587343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6" event={"ID":"1153ec1c-d841-417a-b084-debde898d01d","Type":"ContainerStarted","Data":"6e62a4e19ccc90488595d830476fdf576775c352a9ad5a4a6e3fc71bed7251c3"}
Jul 07 14:00:31.591423 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.591394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f745cdb9d-xvwsb" event={"ID":"a8a9f647-1b29-413b-95c6-5d9a7be87dd4","Type":"ContainerStarted","Data":"d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49"}
Jul 07 14:00:31.591564 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.591442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f745cdb9d-xvwsb" event={"ID":"a8a9f647-1b29-413b-95c6-5d9a7be87dd4","Type":"ContainerStarted","Data":"fa61007ffddd64ecf1f5df00fb8eb77910bd435f30b344c06fdacdbbb68513e0"}
Jul 07 14:00:31.612222 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.612163    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f745cdb9d-xvwsb" podStartSLOduration=1.612141844 podStartE2EDuration="1.612141844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:31.611665807 +0000 UTC m=+63.916353480" watchObservedRunningTime="2026-07-07 14:00:31.612141844 +0000 UTC m=+63.916829508"
Jul 07 14:00:31.880393 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:31.880370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:00:31.882531 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:31.882506    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f5050e_0915_491d_9aac_094845f72889.slice/crio-4ee262cf74f9e4685cadf7619413d816dfcf242a81ec2f247b291f26d309bc18 WatchSource:0}: Error finding container 4ee262cf74f9e4685cadf7619413d816dfcf242a81ec2f247b291f26d309bc18: Status 404 returned error can't find the container with id 4ee262cf74f9e4685cadf7619413d816dfcf242a81ec2f247b291f26d309bc18
Jul 07 14:00:32.534880 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.534798    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvmnz"
Jul 07 14:00:32.599120 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.599087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerStarted","Data":"4ee262cf74f9e4685cadf7619413d816dfcf242a81ec2f247b291f26d309bc18"}
Jul 07 14:00:32.602887 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.602855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" event={"ID":"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2","Type":"ContainerStarted","Data":"cbb2a9210bd9637f7e447ce91317ade70d8bfc66eca126158d2c136c27f02d10"}
Jul 07 14:00:32.603052 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.602931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" event={"ID":"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2","Type":"ContainerStarted","Data":"fd4212102bf507694315875997ac9c401f065d62f569925e0ff983bd92a0ef9f"}
Jul 07 14:00:32.603052 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.602978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" event={"ID":"a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2","Type":"ContainerStarted","Data":"f6495694c3db51679903eb09f812dd893bb9e1e20ceb8250f32e0e05bac1451c"}
Jul 07 14:00:32.603271 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.603250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:32.607003 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.606972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6" event={"ID":"1153ec1c-d841-417a-b084-debde898d01d","Type":"ContainerStarted","Data":"6e47cab2f2b5dde9193c73fc12fc60e62902f9471940972e7483f68d59a46894"}
Jul 07 14:00:32.607142 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.607028    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:32.612344 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.612319    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6"
Jul 07 14:00:32.645459 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.645246    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc" podStartSLOduration=1.698435855 podStartE2EDuration="4.645224637s" totalImagesPullingTime="2.946788782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:32.627481082 +0000 UTC m=+64.932168756" watchObservedRunningTime="2026-07-07 14:00:32.645224637 +0000 UTC m=+64.949912306"
Jul 07 14:00:32.645732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:32.645680    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7dvs6" podStartSLOduration=2.163101674 podStartE2EDuration="3.645669411s" totalImagesPullingTime="1.482567737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:32.644180383 +0000 UTC m=+64.948868053" watchObservedRunningTime="2026-07-07 14:00:32.645669411 +0000 UTC m=+64.950357082"
Jul 07 14:00:33.614382 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.614344    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1f5050e-0915-491d-9aac-094845f72889" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323" exitCode=0
Jul 07 14:00:33.614822 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.614425    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"}
Jul 07 14:00:33.924741 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.924707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:33.924899 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.924765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:33.927224 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.927206    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:00:33.927313 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.927295    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:00:33.937378 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.937344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93966aa1-900e-4580-a35f-ba347c4de480-metrics-certs\") pod \"network-metrics-daemon-j8brk\" (UID: \"93966aa1-900e-4580-a35f-ba347c4de480\") " pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:33.937483 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:33.937345    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5513fbde-d669-45b1-965c-a250ed46ae4f-original-pull-secret\") pod \"global-pull-secret-syncer-b49hp\" (UID: \"5513fbde-d669-45b1-965c-a250ed46ae4f\") " pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:34.069111 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.069070    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b49hp"
Jul 07 14:00:34.127472 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.127444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:34.130218 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.130195    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:00:34.141305 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.141278    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:00:34.151840 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.151809    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzg8m\" (UniqueName: \"kubernetes.io/projected/88e372e3-a702-47aa-a562-b68fd43c3943-kube-api-access-dzg8m\") pod \"network-check-target-zvrjb\" (UID: \"88e372e3-a702-47aa-a562-b68fd43c3943\") " pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:34.180330 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.180258    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rw24\""
Jul 07 14:00:34.188452 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.188428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:34.188736 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.188717    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zznv\""
Jul 07 14:00:34.197384 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.197359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8brk"
Jul 07 14:00:34.205438 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.205408    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b49hp"]
Jul 07 14:00:34.209864 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:34.209834    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5513fbde_d669_45b1_965c_a250ed46ae4f.slice/crio-98eacfb8cb452983dce2940fc1ce57c7447aad977e46b900c3aab25710b76ce4 WatchSource:0}: Error finding container 98eacfb8cb452983dce2940fc1ce57c7447aad977e46b900c3aab25710b76ce4: Status 404 returned error can't find the container with id 98eacfb8cb452983dce2940fc1ce57c7447aad977e46b900c3aab25710b76ce4
Jul 07 14:00:34.350812 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.350769    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zvrjb"]
Jul 07 14:00:34.353631 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:34.353604    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e372e3_a702_47aa_a562_b68fd43c3943.slice/crio-e71495e9fde05c9df87bc0bf21ffa3d4b3d8b4ca5f1cc27cedcf208f8001c72a WatchSource:0}: Error finding container e71495e9fde05c9df87bc0bf21ffa3d4b3d8b4ca5f1cc27cedcf208f8001c72a: Status 404 returned error can't find the container with id e71495e9fde05c9df87bc0bf21ffa3d4b3d8b4ca5f1cc27cedcf208f8001c72a
Jul 07 14:00:34.368642 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.368547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j8brk"]
Jul 07 14:00:34.371592 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:00:34.371568    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93966aa1_900e_4580_a35f_ba347c4de480.slice/crio-98658979f3f22e9338727672b408fe2d5642a9fb413c4abbcd7350ae65276f67 WatchSource:0}: Error finding container 98658979f3f22e9338727672b408fe2d5642a9fb413c4abbcd7350ae65276f67: Status 404 returned error can't find the container with id 98658979f3f22e9338727672b408fe2d5642a9fb413c4abbcd7350ae65276f67
Jul 07 14:00:34.619816 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.619720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j8brk" event={"ID":"93966aa1-900e-4580-a35f-ba347c4de480","Type":"ContainerStarted","Data":"98658979f3f22e9338727672b408fe2d5642a9fb413c4abbcd7350ae65276f67"}
Jul 07 14:00:34.620971 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.620937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b49hp" event={"ID":"5513fbde-d669-45b1-965c-a250ed46ae4f","Type":"ContainerStarted","Data":"98eacfb8cb452983dce2940fc1ce57c7447aad977e46b900c3aab25710b76ce4"}
Jul 07 14:00:34.622094 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.622069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvrjb" event={"ID":"88e372e3-a702-47aa-a562-b68fd43c3943","Type":"ContainerStarted","Data":"e71495e9fde05c9df87bc0bf21ffa3d4b3d8b4ca5f1cc27cedcf208f8001c72a"}
Jul 07 14:00:34.744928 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:34.744896    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f745cdb9d-xvwsb"]
Jul 07 14:00:36.635198 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:36.635153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j8brk" event={"ID":"93966aa1-900e-4580-a35f-ba347c4de480","Type":"ContainerStarted","Data":"d1cc002dc928cce56192c940bcae25c0e85723f0f0f9bfa60cbc8294c59cca31"}
Jul 07 14:00:36.635678 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:36.635257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j8brk" event={"ID":"93966aa1-900e-4580-a35f-ba347c4de480","Type":"ContainerStarted","Data":"7901ea48d85f8e69d1d208eb5752dd69aea34e7deda57f2ed14569ad8ec5841a"}
Jul 07 14:00:36.656992 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:36.656478    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j8brk" podStartSLOduration=67.319973892 podStartE2EDuration="1m8.656454113s" totalImagesPullingTime="1.336480221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:36.654424294 +0000 UTC m=+68.959111963" watchObservedRunningTime="2026-07-07 14:00:36.656454113 +0000 UTC m=+68.961141783"
Jul 07 14:00:38.621208 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:38.621181    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66d55d44fb-ptwdc"
Jul 07 14:00:40.885888 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:40.885845    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:00:41.660852 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.660620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zvrjb" event={"ID":"88e372e3-a702-47aa-a562-b68fd43c3943","Type":"ContainerStarted","Data":"1f3b6bde549ceadcaa6e841b8c6dfb6c9d471c9242803853e75504e19518d68c"}
Jul 07 14:00:41.660852 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.660706    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:00:41.664100 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.664072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerStarted","Data":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"}
Jul 07 14:00:41.664247 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.664144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerStarted","Data":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"}
Jul 07 14:00:41.664247 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.664190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerStarted","Data":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"}
Jul 07 14:00:41.664247 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.664222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerStarted","Data":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"}
Jul 07 14:00:41.664387 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.664273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerStarted","Data":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"}
Jul 07 14:00:41.664387 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.664313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerStarted","Data":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"}
Jul 07 14:00:41.665514 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.665493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b49hp" event={"ID":"5513fbde-d669-45b1-965c-a250ed46ae4f","Type":"ContainerStarted","Data":"58ac0405ebf0290a99af80b09f69bde3481bf10e7b1b7be23880d305b6f4d2e3"}
Jul 07 14:00:41.677419 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.677371    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zvrjb" podStartSLOduration=67.041490229 podStartE2EDuration="1m13.677355039s" totalImagesPullingTime="6.63586481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:41.676464851 +0000 UTC m=+73.981152520" watchObservedRunningTime="2026-07-07 14:00:41.677355039 +0000 UTC m=+73.982042706"
Jul 07 14:00:41.711104 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.711047    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.17775638 podStartE2EDuration="10.711028409s" totalImagesPullingTime="8.511279312s" totalInitContainerRuntime="21.992717ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:41.708951563 +0000 UTC m=+74.013639231" watchObservedRunningTime="2026-07-07 14:00:41.711028409 +0000 UTC m=+74.015716099"
Jul 07 14:00:41.727183 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:41.727118    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b49hp" podStartSLOduration=66.934295992 podStartE2EDuration="1m13.727092086s" totalImagesPullingTime="6.792796094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:41.726648169 +0000 UTC m=+74.031335850" watchObservedRunningTime="2026-07-07 14:00:41.727092086 +0000 UTC m=+74.031779751"
Jul 07 14:00:45.866072 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:45.866035    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55b5b8c4f9-5tt9z"]
Jul 07 14:00:46.582671 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:46.582638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:00:59.769940 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:00:59.769789    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f745cdb9d-xvwsb" podUID="a8a9f647-1b29-413b-95c6-5d9a7be87dd4" containerName="console" containerID="cri-o://d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49" gracePeriod=15
Jul 07 14:01:00.004164 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.004140    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:01:00.058765 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.058660    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-serving-cert\") pod \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") "
Jul 07 14:01:00.058765 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.058724    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hstpw\" (UniqueName: \"kubernetes.io/projected/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-kube-api-access-hstpw\") pod \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") "
Jul 07 14:01:00.058765 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.058755    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-oauth-serving-cert\") pod \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") "
Jul 07 14:01:00.059031 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.058803    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-trusted-ca-bundle\") pod \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") "
Jul 07 14:01:00.059031 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.058829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-oauth-config\") pod \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") "
Jul 07 14:01:00.059031 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.058855    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-config\") pod \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") "
Jul 07 14:01:00.059198 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059102    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-service-ca\") pod \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\" (UID: \"a8a9f647-1b29-413b-95c6-5d9a7be87dd4\") "
Jul 07 14:01:00.059260 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059217    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8a9f647-1b29-413b-95c6-5d9a7be87dd4" (UID: "a8a9f647-1b29-413b-95c6-5d9a7be87dd4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:00.059260 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059245    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-config" (OuterVolumeSpecName: "console-config") pod "a8a9f647-1b29-413b-95c6-5d9a7be87dd4" (UID: "a8a9f647-1b29-413b-95c6-5d9a7be87dd4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:00.059405 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059269    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8a9f647-1b29-413b-95c6-5d9a7be87dd4" (UID: "a8a9f647-1b29-413b-95c6-5d9a7be87dd4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:00.059506 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059475    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-oauth-serving-cert\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:00.059506 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059495    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-trusted-ca-bundle\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:00.059573 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059509    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-config\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:00.059573 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.059522    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8a9f647-1b29-413b-95c6-5d9a7be87dd4" (UID: "a8a9f647-1b29-413b-95c6-5d9a7be87dd4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:00.061242 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.061219    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-kube-api-access-hstpw" (OuterVolumeSpecName: "kube-api-access-hstpw") pod "a8a9f647-1b29-413b-95c6-5d9a7be87dd4" (UID: "a8a9f647-1b29-413b-95c6-5d9a7be87dd4"). InnerVolumeSpecName "kube-api-access-hstpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:01:00.061474 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.061447    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8a9f647-1b29-413b-95c6-5d9a7be87dd4" (UID: "a8a9f647-1b29-413b-95c6-5d9a7be87dd4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:00.061549 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.061527    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8a9f647-1b29-413b-95c6-5d9a7be87dd4" (UID: "a8a9f647-1b29-413b-95c6-5d9a7be87dd4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:00.159967 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.159925    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-oauth-config\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:00.159967 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.159957    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-service-ca\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:00.159967 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.159965    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-console-serving-cert\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:00.159967 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.159974    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hstpw\" (UniqueName: \"kubernetes.io/projected/a8a9f647-1b29-413b-95c6-5d9a7be87dd4-kube-api-access-hstpw\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:00.757558 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.757526    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8a9f647-1b29-413b-95c6-5d9a7be87dd4" containerID="d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49" exitCode=0
Jul 07 14:01:00.757763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.757572    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f745cdb9d-xvwsb"
Jul 07 14:01:00.757763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.757616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f745cdb9d-xvwsb" event={"ID":"a8a9f647-1b29-413b-95c6-5d9a7be87dd4","Type":"ContainerDied","Data":"d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49"}
Jul 07 14:01:00.757763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.757669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f745cdb9d-xvwsb" event={"ID":"a8a9f647-1b29-413b-95c6-5d9a7be87dd4","Type":"ContainerDied","Data":"fa61007ffddd64ecf1f5df00fb8eb77910bd435f30b344c06fdacdbbb68513e0"}
Jul 07 14:01:00.757763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.757709    2577 scope.go:117] "RemoveContainer" containerID="d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49"
Jul 07 14:01:00.766255 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.766236    2577 scope.go:117] "RemoveContainer" containerID="d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49"
Jul 07 14:01:00.766537 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:00.766518    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49\": container with ID starting with d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49 not found: ID does not exist" containerID="d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49"
Jul 07 14:01:00.766614 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.766546    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49"} err="failed to get container status \"d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49\": rpc error: code = NotFound desc = could not find container \"d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49\": container with ID starting with d618d175c55af5f1bc0955ec0601d5491436716413e149b3487232c5bd633d49 not found: ID does not exist"
Jul 07 14:01:00.773776 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.773745    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f745cdb9d-xvwsb"]
Jul 07 14:01:00.783023 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:00.782999    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f745cdb9d-xvwsb"]
Jul 07 14:01:02.263922 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:02.263882    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a9f647-1b29-413b-95c6-5d9a7be87dd4" path="/var/lib/kubelet/pods/a8a9f647-1b29-413b-95c6-5d9a7be87dd4/volumes"
Jul 07 14:01:10.886209 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:10.886139    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55b5b8c4f9-5tt9z" podUID="6ece219e-6ccf-4b98-95a3-54c172160d35" containerName="console" containerID="cri-o://5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139" gracePeriod=15
Jul 07 14:01:11.164119 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.164087    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:01:11.250912 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.250877    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-oauth-config\") pod \"6ece219e-6ccf-4b98-95a3-54c172160d35\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") "
Jul 07 14:01:11.250912 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.250915    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-console-config\") pod \"6ece219e-6ccf-4b98-95a3-54c172160d35\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") "
Jul 07 14:01:11.251161 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.250975    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-oauth-serving-cert\") pod \"6ece219e-6ccf-4b98-95a3-54c172160d35\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") "
Jul 07 14:01:11.251161 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.250994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-service-ca\") pod \"6ece219e-6ccf-4b98-95a3-54c172160d35\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") "
Jul 07 14:01:11.251161 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.251126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-serving-cert\") pod \"6ece219e-6ccf-4b98-95a3-54c172160d35\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") "
Jul 07 14:01:11.251310 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.251234    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4lc6\" (UniqueName: \"kubernetes.io/projected/6ece219e-6ccf-4b98-95a3-54c172160d35-kube-api-access-j4lc6\") pod \"6ece219e-6ccf-4b98-95a3-54c172160d35\" (UID: \"6ece219e-6ccf-4b98-95a3-54c172160d35\") "
Jul 07 14:01:11.251472 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.251442    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-service-ca" (OuterVolumeSpecName: "service-ca") pod "6ece219e-6ccf-4b98-95a3-54c172160d35" (UID: "6ece219e-6ccf-4b98-95a3-54c172160d35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:11.251472 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.251447    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-console-config" (OuterVolumeSpecName: "console-config") pod "6ece219e-6ccf-4b98-95a3-54c172160d35" (UID: "6ece219e-6ccf-4b98-95a3-54c172160d35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:11.251627 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.251437    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6ece219e-6ccf-4b98-95a3-54c172160d35" (UID: "6ece219e-6ccf-4b98-95a3-54c172160d35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:11.253377 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.253345    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6ece219e-6ccf-4b98-95a3-54c172160d35" (UID: "6ece219e-6ccf-4b98-95a3-54c172160d35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:11.253377 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.253366    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ece219e-6ccf-4b98-95a3-54c172160d35-kube-api-access-j4lc6" (OuterVolumeSpecName: "kube-api-access-j4lc6") pod "6ece219e-6ccf-4b98-95a3-54c172160d35" (UID: "6ece219e-6ccf-4b98-95a3-54c172160d35"). InnerVolumeSpecName "kube-api-access-j4lc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:01:11.253512 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.253414    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6ece219e-6ccf-4b98-95a3-54c172160d35" (UID: "6ece219e-6ccf-4b98-95a3-54c172160d35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:11.352372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.352330    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4lc6\" (UniqueName: \"kubernetes.io/projected/6ece219e-6ccf-4b98-95a3-54c172160d35-kube-api-access-j4lc6\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:11.352372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.352364    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-oauth-config\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:11.352372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.352377    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-console-config\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:11.352619 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.352389    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-oauth-serving-cert\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:11.352619 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.352401    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6ece219e-6ccf-4b98-95a3-54c172160d35-service-ca\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:11.352619 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.352487    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6ece219e-6ccf-4b98-95a3-54c172160d35-console-serving-cert\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:11.801172 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.801138    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ece219e-6ccf-4b98-95a3-54c172160d35" containerID="5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139" exitCode=0
Jul 07 14:01:11.801364 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.801180    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b5b8c4f9-5tt9z"
Jul 07 14:01:11.801364 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.801231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b5b8c4f9-5tt9z" event={"ID":"6ece219e-6ccf-4b98-95a3-54c172160d35","Type":"ContainerDied","Data":"5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139"}
Jul 07 14:01:11.801364 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.801281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b5b8c4f9-5tt9z" event={"ID":"6ece219e-6ccf-4b98-95a3-54c172160d35","Type":"ContainerDied","Data":"5f029211d027815419bfa93778c3b68c87cb5eb58e41efa02ad3440b8180a97b"}
Jul 07 14:01:11.801364 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.801300    2577 scope.go:117] "RemoveContainer" containerID="5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139"
Jul 07 14:01:11.809888 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.809867    2577 scope.go:117] "RemoveContainer" containerID="5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139"
Jul 07 14:01:11.810163 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:11.810144    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139\": container with ID starting with 5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139 not found: ID does not exist" containerID="5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139"
Jul 07 14:01:11.810204 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.810174    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139"} err="failed to get container status \"5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139\": rpc error: code = NotFound desc = could not find container \"5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139\": container with ID starting with 5375f2aa4c13694dcd956612b67f315d0af1d9c39d59609f9b514c4c20596139 not found: ID does not exist"
Jul 07 14:01:11.821218 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.821189    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55b5b8c4f9-5tt9z"]
Jul 07 14:01:11.824401 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:11.824378    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55b5b8c4f9-5tt9z"]
Jul 07 14:01:12.263957 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:12.263916    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ece219e-6ccf-4b98-95a3-54c172160d35" path="/var/lib/kubelet/pods/6ece219e-6ccf-4b98-95a3-54c172160d35/volumes"
Jul 07 14:01:12.672758 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:12.672728    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zvrjb"
Jul 07 14:01:31.583290 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:31.583252    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:31.602808 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:31.602781    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:31.890599 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:31.890575    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:49.646006 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.645962    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:01:49.646440 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.646352    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="prometheus" containerID="cri-o://1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f" gracePeriod=600
Jul 07 14:01:49.646440 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.646407    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-thanos" containerID="cri-o://702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646" gracePeriod=600
Jul 07 14:01:49.646556 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.646416    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-web" containerID="cri-o://92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1" gracePeriod=600
Jul 07 14:01:49.646556 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.646442    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="config-reloader" containerID="cri-o://b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202" gracePeriod=600
Jul 07 14:01:49.646556 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.646377    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="thanos-sidecar" containerID="cri-o://a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3" gracePeriod=600
Jul 07 14:01:49.646732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.646589    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy" containerID="cri-o://57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea" gracePeriod=600
Jul 07 14:01:49.909321 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.909290    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:49.942757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942725    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1f5050e-0915-491d-9aac-094845f72889" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646" exitCode=0
Jul 07 14:01:49.942757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942752    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1f5050e-0915-491d-9aac-094845f72889" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea" exitCode=0
Jul 07 14:01:49.942757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942760    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1f5050e-0915-491d-9aac-094845f72889" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1" exitCode=0
Jul 07 14:01:49.942757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942768    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1f5050e-0915-491d-9aac-094845f72889" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3" exitCode=0
Jul 07 14:01:49.943018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942776    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1f5050e-0915-491d-9aac-094845f72889" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202" exitCode=0
Jul 07 14:01:49.943018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942783    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1f5050e-0915-491d-9aac-094845f72889" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f" exitCode=0
Jul 07 14:01:49.943018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942793    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:49.943018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"}
Jul 07 14:01:49.943018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"}
Jul 07 14:01:49.943018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"}
Jul 07 14:01:49.943018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.942999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"}
Jul 07 14:01:49.943395 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.943042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"}
Jul 07 14:01:49.943395 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.943083    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"}
Jul 07 14:01:49.943395 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.943137    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1f5050e-0915-491d-9aac-094845f72889","Type":"ContainerDied","Data":"4ee262cf74f9e4685cadf7619413d816dfcf242a81ec2f247b291f26d309bc18"}
Jul 07 14:01:49.943395 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.943192    2577 scope.go:117] "RemoveContainer" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:49.956437 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.955489    2577 scope.go:117] "RemoveContainer" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:49.970282 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970261    2577 scope.go:117] "RemoveContainer" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:49.970376 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970356    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-tls-assets\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970433 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970393    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-config\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970433 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970425    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-metrics-client-ca\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970527 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970449    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfl59\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-kube-api-access-bfl59\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970527 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970478    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-grpc-tls\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970527 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970502    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-kubelet-serving-ca-bundle\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970534    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970577    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-db\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970604    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-2\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970627    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-serving-certs-ca-bundle\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970849 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970671    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-config-out\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970849 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970712    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-metrics-client-certs\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970849 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970740    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-1\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970849 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970783    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-thanos-prometheus-http-client-file\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.970849 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970830    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.971100 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970871    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-web-config\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.971100 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970896    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-tls\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.971100 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970935    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-0\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.971100 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970967    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-kube-rbac-proxy\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.971100 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.970990    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-trusted-ca-bundle\") pod \"b1f5050e-0915-491d-9aac-094845f72889\" (UID: \"b1f5050e-0915-491d-9aac-094845f72889\") "
Jul 07 14:01:49.973118 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.971567    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:49.973118 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.971854    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:49.973118 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.972009    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:49.973118 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.972184    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:49.973118 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.972486    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:49.974083 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.973145    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:01:49.974083 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.973419    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-kube-api-access-bfl59" (OuterVolumeSpecName: "kube-api-access-bfl59") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "kube-api-access-bfl59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:01:49.974083 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.973494    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:49.974083 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.973590    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:01:49.974083 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.973832    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:49.977977 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.976793    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.977977 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.977058    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.977977 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.977957    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.978480 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.978453    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-config" (OuterVolumeSpecName: "config") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.978640 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.978380    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.978773 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.978722    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.978899 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.978835    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-config-out" (OuterVolumeSpecName: "config-out") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:01:49.979846 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.979815    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.981572 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.981536    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.984074 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.984050    2577 scope.go:117] "RemoveContainer" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:49.994887 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.994843    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-web-config" (OuterVolumeSpecName: "web-config") pod "b1f5050e-0915-491d-9aac-094845f72889" (UID: "b1f5050e-0915-491d-9aac-094845f72889"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:49.996000 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:49.995973    2577 scope.go:117] "RemoveContainer" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.004398 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.004374    2577 scope.go:117] "RemoveContainer" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.012791 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.012772    2577 scope.go:117] "RemoveContainer" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.020491 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.020467    2577 scope.go:117] "RemoveContainer" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:50.020843 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:50.020825    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": container with ID starting with 702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646 not found: ID does not exist" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:50.020910 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.020854    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"} err="failed to get container status \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": rpc error: code = NotFound desc = could not find container \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": container with ID starting with 702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646 not found: ID does not exist"
Jul 07 14:01:50.020910 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.020873    2577 scope.go:117] "RemoveContainer" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:50.021138 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:50.021122    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": container with ID starting with 57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea not found: ID does not exist" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:50.021192 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021141    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"} err="failed to get container status \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": rpc error: code = NotFound desc = could not find container \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": container with ID starting with 57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea not found: ID does not exist"
Jul 07 14:01:50.021192 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021154    2577 scope.go:117] "RemoveContainer" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:50.021389 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:50.021369    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": container with ID starting with 92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1 not found: ID does not exist" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:50.021426 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021394    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"} err="failed to get container status \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": rpc error: code = NotFound desc = could not find container \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": container with ID starting with 92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1 not found: ID does not exist"
Jul 07 14:01:50.021426 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021408    2577 scope.go:117] "RemoveContainer" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:50.021609 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:50.021593    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": container with ID starting with a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3 not found: ID does not exist" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:50.021645 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021612    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"} err="failed to get container status \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": rpc error: code = NotFound desc = could not find container \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": container with ID starting with a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3 not found: ID does not exist"
Jul 07 14:01:50.021645 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021625    2577 scope.go:117] "RemoveContainer" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.021911 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:50.021893    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": container with ID starting with b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202 not found: ID does not exist" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.021974 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021914    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"} err="failed to get container status \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": rpc error: code = NotFound desc = could not find container \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": container with ID starting with b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202 not found: ID does not exist"
Jul 07 14:01:50.021974 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.021928    2577 scope.go:117] "RemoveContainer" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.022184 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:50.022169    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": container with ID starting with 1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f not found: ID does not exist" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.022225 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.022188    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"} err="failed to get container status \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": rpc error: code = NotFound desc = could not find container \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": container with ID starting with 1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f not found: ID does not exist"
Jul 07 14:01:50.022225 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.022202    2577 scope.go:117] "RemoveContainer" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.022475 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:01:50.022451    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": container with ID starting with ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323 not found: ID does not exist" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.022582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.022482    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"} err="failed to get container status \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": rpc error: code = NotFound desc = could not find container \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": container with ID starting with ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323 not found: ID does not exist"
Jul 07 14:01:50.022582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.022504    2577 scope.go:117] "RemoveContainer" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:50.022800 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.022779    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"} err="failed to get container status \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": rpc error: code = NotFound desc = could not find container \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": container with ID starting with 702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646 not found: ID does not exist"
Jul 07 14:01:50.022858 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.022800    2577 scope.go:117] "RemoveContainer" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:50.023044 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023028    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"} err="failed to get container status \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": rpc error: code = NotFound desc = could not find container \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": container with ID starting with 57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea not found: ID does not exist"
Jul 07 14:01:50.023088 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023045    2577 scope.go:117] "RemoveContainer" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:50.023251 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023233    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"} err="failed to get container status \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": rpc error: code = NotFound desc = could not find container \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": container with ID starting with 92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1 not found: ID does not exist"
Jul 07 14:01:50.023293 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023251    2577 scope.go:117] "RemoveContainer" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:50.023465 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023448    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"} err="failed to get container status \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": rpc error: code = NotFound desc = could not find container \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": container with ID starting with a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3 not found: ID does not exist"
Jul 07 14:01:50.023465 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023464    2577 scope.go:117] "RemoveContainer" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.023635 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023620    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"} err="failed to get container status \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": rpc error: code = NotFound desc = could not find container \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": container with ID starting with b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202 not found: ID does not exist"
Jul 07 14:01:50.023672 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023635    2577 scope.go:117] "RemoveContainer" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.023856 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023836    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"} err="failed to get container status \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": rpc error: code = NotFound desc = could not find container \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": container with ID starting with 1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f not found: ID does not exist"
Jul 07 14:01:50.023919 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.023856    2577 scope.go:117] "RemoveContainer" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.024075 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024056    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"} err="failed to get container status \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": rpc error: code = NotFound desc = could not find container \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": container with ID starting with ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323 not found: ID does not exist"
Jul 07 14:01:50.024121 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024076    2577 scope.go:117] "RemoveContainer" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:50.024272 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024253    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"} err="failed to get container status \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": rpc error: code = NotFound desc = could not find container \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": container with ID starting with 702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646 not found: ID does not exist"
Jul 07 14:01:50.024272 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024272    2577 scope.go:117] "RemoveContainer" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:50.024472 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024457    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"} err="failed to get container status \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": rpc error: code = NotFound desc = could not find container \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": container with ID starting with 57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea not found: ID does not exist"
Jul 07 14:01:50.024516 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024472    2577 scope.go:117] "RemoveContainer" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:50.024678 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024660    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"} err="failed to get container status \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": rpc error: code = NotFound desc = could not find container \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": container with ID starting with 92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1 not found: ID does not exist"
Jul 07 14:01:50.024760 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024678    2577 scope.go:117] "RemoveContainer" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:50.024910 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024893    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"} err="failed to get container status \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": rpc error: code = NotFound desc = could not find container \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": container with ID starting with a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3 not found: ID does not exist"
Jul 07 14:01:50.024957 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.024911    2577 scope.go:117] "RemoveContainer" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.025093 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025078    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"} err="failed to get container status \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": rpc error: code = NotFound desc = could not find container \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": container with ID starting with b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202 not found: ID does not exist"
Jul 07 14:01:50.025137 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025093    2577 scope.go:117] "RemoveContainer" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.025259 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025244    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"} err="failed to get container status \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": rpc error: code = NotFound desc = could not find container \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": container with ID starting with 1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f not found: ID does not exist"
Jul 07 14:01:50.025300 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025258    2577 scope.go:117] "RemoveContainer" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.025497 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025480    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"} err="failed to get container status \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": rpc error: code = NotFound desc = could not find container \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": container with ID starting with ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323 not found: ID does not exist"
Jul 07 14:01:50.025549 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025496    2577 scope.go:117] "RemoveContainer" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:50.025733 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025713    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"} err="failed to get container status \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": rpc error: code = NotFound desc = could not find container \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": container with ID starting with 702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646 not found: ID does not exist"
Jul 07 14:01:50.025780 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025735    2577 scope.go:117] "RemoveContainer" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:50.025983 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025964    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"} err="failed to get container status \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": rpc error: code = NotFound desc = could not find container \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": container with ID starting with 57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea not found: ID does not exist"
Jul 07 14:01:50.026072 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.025984    2577 scope.go:117] "RemoveContainer" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:50.026229 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026202    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"} err="failed to get container status \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": rpc error: code = NotFound desc = could not find container \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": container with ID starting with 92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1 not found: ID does not exist"
Jul 07 14:01:50.026276 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026229    2577 scope.go:117] "RemoveContainer" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:50.026458 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026442    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"} err="failed to get container status \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": rpc error: code = NotFound desc = could not find container \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": container with ID starting with a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3 not found: ID does not exist"
Jul 07 14:01:50.026495 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026458    2577 scope.go:117] "RemoveContainer" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.026648 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026630    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"} err="failed to get container status \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": rpc error: code = NotFound desc = could not find container \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": container with ID starting with b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202 not found: ID does not exist"
Jul 07 14:01:50.026711 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026648    2577 scope.go:117] "RemoveContainer" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.026865 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026851    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"} err="failed to get container status \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": rpc error: code = NotFound desc = could not find container \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": container with ID starting with 1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f not found: ID does not exist"
Jul 07 14:01:50.026914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.026866    2577 scope.go:117] "RemoveContainer" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.027049 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027033    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"} err="failed to get container status \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": rpc error: code = NotFound desc = could not find container \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": container with ID starting with ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323 not found: ID does not exist"
Jul 07 14:01:50.027086 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027049    2577 scope.go:117] "RemoveContainer" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:50.027228 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027213    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"} err="failed to get container status \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": rpc error: code = NotFound desc = could not find container \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": container with ID starting with 702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646 not found: ID does not exist"
Jul 07 14:01:50.027265 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027227    2577 scope.go:117] "RemoveContainer" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:50.027397 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027383    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"} err="failed to get container status \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": rpc error: code = NotFound desc = could not find container \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": container with ID starting with 57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea not found: ID does not exist"
Jul 07 14:01:50.027397 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027396    2577 scope.go:117] "RemoveContainer" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:50.027565 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027551    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"} err="failed to get container status \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": rpc error: code = NotFound desc = could not find container \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": container with ID starting with 92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1 not found: ID does not exist"
Jul 07 14:01:50.027565 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027564    2577 scope.go:117] "RemoveContainer" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:50.027769 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027752    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"} err="failed to get container status \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": rpc error: code = NotFound desc = could not find container \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": container with ID starting with a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3 not found: ID does not exist"
Jul 07 14:01:50.027769 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027769    2577 scope.go:117] "RemoveContainer" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.027968 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027949    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"} err="failed to get container status \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": rpc error: code = NotFound desc = could not find container \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": container with ID starting with b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202 not found: ID does not exist"
Jul 07 14:01:50.028010 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.027969    2577 scope.go:117] "RemoveContainer" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.028177 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.028161    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"} err="failed to get container status \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": rpc error: code = NotFound desc = could not find container \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": container with ID starting with 1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f not found: ID does not exist"
Jul 07 14:01:50.028177 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.028176    2577 scope.go:117] "RemoveContainer" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.028412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.028387    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"} err="failed to get container status \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": rpc error: code = NotFound desc = could not find container \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": container with ID starting with ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323 not found: ID does not exist"
Jul 07 14:01:50.028412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.028409    2577 scope.go:117] "RemoveContainer" containerID="702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"
Jul 07 14:01:50.028645 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.028627    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646"} err="failed to get container status \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": rpc error: code = NotFound desc = could not find container \"702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646\": container with ID starting with 702d1f0b2c6712f9271bcd65d0e7d8fd1a892e95c63cf455b760fe7f4b37e646 not found: ID does not exist"
Jul 07 14:01:50.028734 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.028647    2577 scope.go:117] "RemoveContainer" containerID="57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"
Jul 07 14:01:50.029003 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.028983    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea"} err="failed to get container status \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": rpc error: code = NotFound desc = could not find container \"57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea\": container with ID starting with 57bf902b5525f244e271e3c28ca834ef109d41f0195018ff9e7229f154da76ea not found: ID does not exist"
Jul 07 14:01:50.029068 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029004    2577 scope.go:117] "RemoveContainer" containerID="92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"
Jul 07 14:01:50.029230 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029210    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1"} err="failed to get container status \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": rpc error: code = NotFound desc = could not find container \"92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1\": container with ID starting with 92d6cbf9bbb1e835f497a37373966fe572c1e539fd39f8653e10e7ad0d75e2f1 not found: ID does not exist"
Jul 07 14:01:50.029313 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029233    2577 scope.go:117] "RemoveContainer" containerID="a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"
Jul 07 14:01:50.029450 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029433    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3"} err="failed to get container status \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": rpc error: code = NotFound desc = could not find container \"a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3\": container with ID starting with a93544b10f6b7c19a46ecf0b68a722578e70bbdd1c49ba6893756d5c936a84e3 not found: ID does not exist"
Jul 07 14:01:50.029489 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029453    2577 scope.go:117] "RemoveContainer" containerID="b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"
Jul 07 14:01:50.029652 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029637    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202"} err="failed to get container status \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": rpc error: code = NotFound desc = could not find container \"b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202\": container with ID starting with b91480aaf9ff4b2df67c6b95fec20fe3c5b42d90bd28f4123427d2865a065202 not found: ID does not exist"
Jul 07 14:01:50.029724 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029653    2577 scope.go:117] "RemoveContainer" containerID="1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"
Jul 07 14:01:50.029850 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029834    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f"} err="failed to get container status \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": rpc error: code = NotFound desc = could not find container \"1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f\": container with ID starting with 1a96514072ca95dca8680f6aca80a77ebf5ef36b4397b55022a02ee4f426af3f not found: ID does not exist"
Jul 07 14:01:50.029898 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.029849    2577 scope.go:117] "RemoveContainer" containerID="ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"
Jul 07 14:01:50.030030 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.030009    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323"} err="failed to get container status \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": rpc error: code = NotFound desc = could not find container \"ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323\": container with ID starting with ee7f028c2e395da1a5d6c62ddc4a9ccd91e2818382513f46fbc8dec923df8323 not found: ID does not exist"
Jul 07 14:01:50.072333 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072296    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-tls-assets\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072333 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072327    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-config\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072333 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072342    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-metrics-client-ca\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072356    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfl59\" (UniqueName: \"kubernetes.io/projected/b1f5050e-0915-491d-9aac-094845f72889-kube-api-access-bfl59\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072370    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-grpc-tls\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072384    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072395    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072410    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-db\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072422    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072435    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072447    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1f5050e-0915-491d-9aac-094845f72889-config-out\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072458    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-metrics-client-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072470    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072482    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072495    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072535    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-web-config\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072547    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072561    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072575    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1f5050e-0915-491d-9aac-094845f72889-secret-kube-rbac-proxy\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.072644 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.072588    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1f5050e-0915-491d-9aac-094845f72889-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:01:50.267206 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.267168    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:01:50.273150 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.273125    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:01:50.299992 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.299948    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:01:50.300290 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300273    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-thanos"
Jul 07 14:01:50.300369 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300292    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-thanos"
Jul 07 14:01:50.300369 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300315    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="thanos-sidecar"
Jul 07 14:01:50.300369 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300325    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="thanos-sidecar"
Jul 07 14:01:50.300369 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300336    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ece219e-6ccf-4b98-95a3-54c172160d35" containerName="console"
Jul 07 14:01:50.300369 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300345    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ece219e-6ccf-4b98-95a3-54c172160d35" containerName="console"
Jul 07 14:01:50.300369 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300357    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy"
Jul 07 14:01:50.300369 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300368    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300378    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="prometheus"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300386    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="prometheus"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300401    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-web"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300410    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-web"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300422    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="init-config-reloader"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300433    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="init-config-reloader"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300444    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="config-reloader"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300453    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="config-reloader"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300462    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a9f647-1b29-413b-95c6-5d9a7be87dd4" containerName="console"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300470    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a9f647-1b29-413b-95c6-5d9a7be87dd4" containerName="console"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300558    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a9f647-1b29-413b-95c6-5d9a7be87dd4" containerName="console"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300617    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="prometheus"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300631    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-thanos"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300642    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="config-reloader"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300650    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300661    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ece219e-6ccf-4b98-95a3-54c172160d35" containerName="console"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300669    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="thanos-sidecar"
Jul 07 14:01:50.300718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.300676    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f5050e-0915-491d-9aac-094845f72889" containerName="kube-rbac-proxy-web"
Jul 07 14:01:50.305659 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.305634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.309520 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.309158    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 14:01:50.309675 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.309515    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 14:01:50.309876 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.309809    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 14:01:50.309876 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.309865    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 14:01:50.310152 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.309962    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 14:01:50.310152 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.309976    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aios1qs77mvbl\""
Jul 07 14:01:50.310152 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 14:01:50.310152 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310023    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 14:01:50.310152 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310131    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 14:01:50.310410 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310305    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 14:01:50.310481 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310471    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 14:01:50.310575 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310560    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 14:01:50.310666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310582    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 14:01:50.310769 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pjlkw\""
Jul 07 14:01:50.310879 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.310855    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 14:01:50.312173 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.312151    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 14:01:50.315358 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.315338    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 14:01:50.320004 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.319982    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:01:50.375372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375372 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375578 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84h5k\" (UniqueName: \"kubernetes.io/projected/917ec750-7361-41bb-8a2e-fa2fe39680fb-kube-api-access-84h5k\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375578 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375578 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-config\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375578 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/917ec750-7361-41bb-8a2e-fa2fe39680fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/917ec750-7361-41bb-8a2e-fa2fe39680fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.375905 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.375863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.476937 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.476897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.476937 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.476934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.476952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84h5k\" (UniqueName: \"kubernetes.io/projected/917ec750-7361-41bb-8a2e-fa2fe39680fb-kube-api-access-84h5k\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.476990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-config\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/917ec750-7361-41bb-8a2e-fa2fe39680fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/917ec750-7361-41bb-8a2e-fa2fe39680fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.477532 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.478027 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477803    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.478027 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.477894    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.478368 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.478344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.479332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.478826    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.480216 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.480187    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.480319 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.480218    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.480319 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.480278    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.480436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.480349    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-config\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.480436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.480422    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.480538 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.480430    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.480949 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.480923    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.481169 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.481148    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.481404 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.481377    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.481837 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.481814    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.482335 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.482309    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.482666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.482646    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/917ec750-7361-41bb-8a2e-fa2fe39680fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.482775 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.482723    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/917ec750-7361-41bb-8a2e-fa2fe39680fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.482861 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.482841    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/917ec750-7361-41bb-8a2e-fa2fe39680fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.483232 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.483217    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/917ec750-7361-41bb-8a2e-fa2fe39680fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.485639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.485623    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84h5k\" (UniqueName: \"kubernetes.io/projected/917ec750-7361-41bb-8a2e-fa2fe39680fb-kube-api-access-84h5k\") pod \"prometheus-k8s-0\" (UID: \"917ec750-7361-41bb-8a2e-fa2fe39680fb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.619212 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.619090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:01:50.764104 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.764000    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:01:50.949200 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.949160    2577 generic.go:356] "Generic (PLEG): container finished" podID="917ec750-7361-41bb-8a2e-fa2fe39680fb" containerID="70bf52e2e7610f2895c678a6e0bffe979cf249d44b5b3090d8a6b9ec52020e5b" exitCode=0
Jul 07 14:01:50.949370 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.949215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerDied","Data":"70bf52e2e7610f2895c678a6e0bffe979cf249d44b5b3090d8a6b9ec52020e5b"}
Jul 07 14:01:50.949370 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:50.949295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerStarted","Data":"58bfbef6c2860030edba2d29f60d93121733350f97901dbc635dee2c2d89589a"}
Jul 07 14:01:51.957084 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:51.956996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerStarted","Data":"b4a4bc4504756acabe8c6d08074229012ed11ade7a432b86aef538e46dc4ec6c"}
Jul 07 14:01:51.957084 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:51.957062    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerStarted","Data":"377a7612704869f8727cc179341f69b2b53f80e1942c0d8a9d1d52a33d907a26"}
Jul 07 14:01:51.957528 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:51.957090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerStarted","Data":"28bb2745cd198444034e496dcdd54ce9859090c0ebf5303aae3f97074cb76e28"}
Jul 07 14:01:51.957528 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:51.957117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerStarted","Data":"c796e71af7533c4da8881ea849fa1e8589972cc726d09f27494333c958e6a7af"}
Jul 07 14:01:51.957528 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:51.957141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerStarted","Data":"5b13322114a5da964f019b9b36dd5d85ccab7b819e1402f88b6cd704bb600d9a"}
Jul 07 14:01:51.957528 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:51.957164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"917ec750-7361-41bb-8a2e-fa2fe39680fb","Type":"ContainerStarted","Data":"7ffdf2450307b8d6cd05ea7f0c02458f4cd2c2a2ddd09db913e1620581f9c7bc"}
Jul 07 14:01:51.986280 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:51.986218    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.96219532 podStartE2EDuration="1.986195814s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.000494ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:01:51.984449102 +0000 UTC m=+144.289136770" watchObservedRunningTime="2026-07-07 14:01:51.986195814 +0000 UTC m=+144.290883486"
Jul 07 14:01:52.264851 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:52.264772    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f5050e-0915-491d-9aac-094845f72889" path="/var/lib/kubelet/pods/b1f5050e-0915-491d-9aac-094845f72889/volumes"
Jul 07 14:01:55.620184 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:01:55.620139    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:02:50.619552 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:02:50.619502    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:02:50.635357 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:02:50.635329    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:02:51.185274 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:02:51.185247    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:04:03.141412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.141337    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zjjwg"]
Jul 07 14:04:03.144279 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.144262    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.146605 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.146583    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ttvwj\""
Jul 07 14:04:03.146605 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.146596    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 14:04:03.147478 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.147458    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 14:04:03.152978 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.152956    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zjjwg"]
Jul 07 14:04:03.314022 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.313982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3178b5-bf76-4206-ac05-b016d8199497-bound-sa-token\") pod \"cert-manager-55b4d954d5-zjjwg\" (UID: \"4d3178b5-bf76-4206-ac05-b016d8199497\") " pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.314227 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.314046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6qrx\" (UniqueName: \"kubernetes.io/projected/4d3178b5-bf76-4206-ac05-b016d8199497-kube-api-access-p6qrx\") pod \"cert-manager-55b4d954d5-zjjwg\" (UID: \"4d3178b5-bf76-4206-ac05-b016d8199497\") " pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.415429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.415344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3178b5-bf76-4206-ac05-b016d8199497-bound-sa-token\") pod \"cert-manager-55b4d954d5-zjjwg\" (UID: \"4d3178b5-bf76-4206-ac05-b016d8199497\") " pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.415429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.415392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qrx\" (UniqueName: \"kubernetes.io/projected/4d3178b5-bf76-4206-ac05-b016d8199497-kube-api-access-p6qrx\") pod \"cert-manager-55b4d954d5-zjjwg\" (UID: \"4d3178b5-bf76-4206-ac05-b016d8199497\") " pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.423998 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.423972    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d3178b5-bf76-4206-ac05-b016d8199497-bound-sa-token\") pod \"cert-manager-55b4d954d5-zjjwg\" (UID: \"4d3178b5-bf76-4206-ac05-b016d8199497\") " pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.424254 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.424232    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6qrx\" (UniqueName: \"kubernetes.io/projected/4d3178b5-bf76-4206-ac05-b016d8199497-kube-api-access-p6qrx\") pod \"cert-manager-55b4d954d5-zjjwg\" (UID: \"4d3178b5-bf76-4206-ac05-b016d8199497\") " pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.463643 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.463604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zjjwg"
Jul 07 14:04:03.594418 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:03.594381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zjjwg"]
Jul 07 14:04:03.597326 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:04:03.597286    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d3178b5_bf76_4206_ac05_b016d8199497.slice/crio-65344a441bf80a7dc4beea4e6deac02c16712302eab418ffd7020a065aa06b03 WatchSource:0}: Error finding container 65344a441bf80a7dc4beea4e6deac02c16712302eab418ffd7020a065aa06b03: Status 404 returned error can't find the container with id 65344a441bf80a7dc4beea4e6deac02c16712302eab418ffd7020a065aa06b03
Jul 07 14:04:04.427050 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:04.427008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zjjwg" event={"ID":"4d3178b5-bf76-4206-ac05-b016d8199497","Type":"ContainerStarted","Data":"65344a441bf80a7dc4beea4e6deac02c16712302eab418ffd7020a065aa06b03"}
Jul 07 14:04:07.441677 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:07.441644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zjjwg" event={"ID":"4d3178b5-bf76-4206-ac05-b016d8199497","Type":"ContainerStarted","Data":"38fd533a5be5d8b516666e835d22e5abfb850fb7a538d8676a9bbef059c3f385"}
Jul 07 14:04:23.538959 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.538902    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zjjwg" podStartSLOduration=17.631583099 podStartE2EDuration="20.538883852s" totalImagesPullingTime="2.907300753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:07.461304327 +0000 UTC m=+279.765991995" watchObservedRunningTime="2026-07-07 14:04:23.538883852 +0000 UTC m=+295.843571554"
Jul 07 14:04:23.539870 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.539841    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"]
Jul 07 14:04:23.542203 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.542176    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.544949 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.544926    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 14:04:23.545421 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.545402    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 14:04:23.545511 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.545465    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 14:04:23.545564 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.545550    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6r6n2\""
Jul 07 14:04:23.545679 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.545663    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 14:04:23.566147 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.566112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"]
Jul 07 14:04:23.582233 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.582196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f5b861-4b78-418e-8c25-a4734c1581ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.582426 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.582312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f5b861-4b78-418e-8c25-a4734c1581ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.582426 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.582362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f5b861-4b78-418e-8c25-a4734c1581ab-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.582426 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.582386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls4hv\" (UniqueName: \"kubernetes.io/projected/14f5b861-4b78-418e-8c25-a4734c1581ab-kube-api-access-ls4hv\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.582426 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.582417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f5b861-4b78-418e-8c25-a4734c1581ab-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.683717 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.683668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f5b861-4b78-418e-8c25-a4734c1581ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.683944 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.683733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f5b861-4b78-418e-8c25-a4734c1581ab-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.683944 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.683749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls4hv\" (UniqueName: \"kubernetes.io/projected/14f5b861-4b78-418e-8c25-a4734c1581ab-kube-api-access-ls4hv\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.683944 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.683769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f5b861-4b78-418e-8c25-a4734c1581ab-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.683944 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.683795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f5b861-4b78-418e-8c25-a4734c1581ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.684296 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.684272    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f5b861-4b78-418e-8c25-a4734c1581ab-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.686141 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.686110    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f5b861-4b78-418e-8c25-a4734c1581ab-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.686267 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.686246    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f5b861-4b78-418e-8c25-a4734c1581ab-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.686343 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.686328    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f5b861-4b78-418e-8c25-a4734c1581ab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.693259 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.693240    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls4hv\" (UniqueName: \"kubernetes.io/projected/14f5b861-4b78-418e-8c25-a4734c1581ab-kube-api-access-ls4hv\") pod \"opendatahub-operator-controller-manager-66d498b796-dnjpr\" (UID: \"14f5b861-4b78-418e-8c25-a4734c1581ab\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.852451 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.852336    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:23.996739 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:23.996709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"]
Jul 07 14:04:23.999835 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:04:23.999807    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f5b861_4b78_418e_8c25_a4734c1581ab.slice/crio-32ed37310d4f6b5dc364fddd9619da80763671b5972a06444b4c9e2aea87bd1a WatchSource:0}: Error finding container 32ed37310d4f6b5dc364fddd9619da80763671b5972a06444b4c9e2aea87bd1a: Status 404 returned error can't find the container with id 32ed37310d4f6b5dc364fddd9619da80763671b5972a06444b4c9e2aea87bd1a
Jul 07 14:04:24.504122 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:24.504085    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr" event={"ID":"14f5b861-4b78-418e-8c25-a4734c1581ab","Type":"ContainerStarted","Data":"32ed37310d4f6b5dc364fddd9619da80763671b5972a06444b4c9e2aea87bd1a"}
Jul 07 14:04:28.430051 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:28.430001    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 14:04:28.522092 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:28.522057    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr" event={"ID":"14f5b861-4b78-418e-8c25-a4734c1581ab","Type":"ContainerStarted","Data":"16ae781abfe8a3e9612a86eb5ae313d364d415d5b5d5cfc4ef614e6db777b8d5"}
Jul 07 14:04:30.529976 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:30.529938    2577 generic.go:356] "Generic (PLEG): container finished" podID="14f5b861-4b78-418e-8c25-a4734c1581ab" containerID="16ae781abfe8a3e9612a86eb5ae313d364d415d5b5d5cfc4ef614e6db777b8d5" exitCode=0
Jul 07 14:04:30.530360 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:30.530011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr" event={"ID":"14f5b861-4b78-418e-8c25-a4734c1581ab","Type":"ContainerDied","Data":"16ae781abfe8a3e9612a86eb5ae313d364d415d5b5d5cfc4ef614e6db777b8d5"}
Jul 07 14:04:30.530611 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:30.530598    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:04:32.539515 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:32.539480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr" event={"ID":"14f5b861-4b78-418e-8c25-a4734c1581ab","Type":"ContainerStarted","Data":"c326d75aa325b91cf006271368bc269d43594d619b9a0a369114f8712403ea45"}
Jul 07 14:04:32.539939 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:32.539772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:32.590215 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:32.590147    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr" podStartSLOduration=3.073718667 podStartE2EDuration="9.590125768s" totalImagesPullingTime="5.482977354s" totalInitContainerRuntime="1.033429747s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:32.577629551 +0000 UTC m=+304.882317219" watchObservedRunningTime="2026-07-07 14:04:32.590125768 +0000 UTC m=+304.894813439"
Jul 07 14:04:42.786255 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.786214    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"]
Jul 07 14:04:42.833553 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.833512    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"]
Jul 07 14:04:42.833746 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.833612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:42.837761 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.837730    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6nkln\""
Jul 07 14:04:42.837914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.837769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:04:42.837914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.837744    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 14:04:42.838026 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.837925    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 14:04:42.838026 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.838009    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 14:04:42.838135 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.838064    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 14:04:42.941514 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.941475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1abc93a1-5599-4093-abf7-5a23b7c4362d-cert\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:42.941746 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.941527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1abc93a1-5599-4093-abf7-5a23b7c4362d-manager-config\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:42.941746 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.941550    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djl9\" (UniqueName: \"kubernetes.io/projected/1abc93a1-5599-4093-abf7-5a23b7c4362d-kube-api-access-8djl9\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:42.941746 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:42.941603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1abc93a1-5599-4093-abf7-5a23b7c4362d-metrics-cert\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.042930 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.042834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1abc93a1-5599-4093-abf7-5a23b7c4362d-manager-config\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.042930 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.042876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djl9\" (UniqueName: \"kubernetes.io/projected/1abc93a1-5599-4093-abf7-5a23b7c4362d-kube-api-access-8djl9\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.042930 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.042896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1abc93a1-5599-4093-abf7-5a23b7c4362d-metrics-cert\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.043204 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.042949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1abc93a1-5599-4093-abf7-5a23b7c4362d-cert\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.043485 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.043449    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1abc93a1-5599-4093-abf7-5a23b7c4362d-manager-config\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.045338 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.045312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1abc93a1-5599-4093-abf7-5a23b7c4362d-metrics-cert\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.045509 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.045487    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1abc93a1-5599-4093-abf7-5a23b7c4362d-cert\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.053054 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.053035    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djl9\" (UniqueName: \"kubernetes.io/projected/1abc93a1-5599-4093-abf7-5a23b7c4362d-kube-api-access-8djl9\") pod \"lws-controller-manager-c9dfbb547-2p5vk\" (UID: \"1abc93a1-5599-4093-abf7-5a23b7c4362d\") " pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.154084 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.154040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:43.282144 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.282118    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"]
Jul 07 14:04:43.284586 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:04:43.284560    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abc93a1_5599_4093_abf7_5a23b7c4362d.slice/crio-48ce30d22dba59b409300d24169fcee420f95dce8fa87c1fb9a21bf0582c1b28 WatchSource:0}: Error finding container 48ce30d22dba59b409300d24169fcee420f95dce8fa87c1fb9a21bf0582c1b28: Status 404 returned error can't find the container with id 48ce30d22dba59b409300d24169fcee420f95dce8fa87c1fb9a21bf0582c1b28
Jul 07 14:04:43.547336 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.547308    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-dnjpr"
Jul 07 14:04:43.579517 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:43.579487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk" event={"ID":"1abc93a1-5599-4093-abf7-5a23b7c4362d","Type":"ContainerStarted","Data":"48ce30d22dba59b409300d24169fcee420f95dce8fa87c1fb9a21bf0582c1b28"}
Jul 07 14:04:46.017935 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.017902    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"]
Jul 07 14:04:46.020524 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.020502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.024541 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.024521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 14:04:46.024834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.024817    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 14:04:46.025917 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.025843    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vvhc6\""
Jul 07 14:04:46.026134 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.026118    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 14:04:46.036760 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.036737    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 14:04:46.063342 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.063309    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"]
Jul 07 14:04:46.172054 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.172021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7395196-c624-4f5d-8f1c-4a81128ba97e-tmp\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.172219 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.172062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrgs\" (UniqueName: \"kubernetes.io/projected/e7395196-c624-4f5d-8f1c-4a81128ba97e-kube-api-access-lhrgs\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.172219 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.172136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7395196-c624-4f5d-8f1c-4a81128ba97e-tls-certs\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.273368 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.273285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7395196-c624-4f5d-8f1c-4a81128ba97e-tmp\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.273368 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.273324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrgs\" (UniqueName: \"kubernetes.io/projected/e7395196-c624-4f5d-8f1c-4a81128ba97e-kube-api-access-lhrgs\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.273368 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.273363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7395196-c624-4f5d-8f1c-4a81128ba97e-tls-certs\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.275718 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.275669    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7395196-c624-4f5d-8f1c-4a81128ba97e-tmp\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.275969 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.275949    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7395196-c624-4f5d-8f1c-4a81128ba97e-tls-certs\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.291727 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.291703    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrgs\" (UniqueName: \"kubernetes.io/projected/e7395196-c624-4f5d-8f1c-4a81128ba97e-kube-api-access-lhrgs\") pod \"kube-auth-proxy-8459dd97f9-65ds2\" (UID: \"e7395196-c624-4f5d-8f1c-4a81128ba97e\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.330355 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.330317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"
Jul 07 14:04:46.474484 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.474362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2"]
Jul 07 14:04:46.477917 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:04:46.477890    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7395196_c624_4f5d_8f1c_4a81128ba97e.slice/crio-9e1fe0895074e0b5140079134ff2b2433fd8ec75ac6e3c2592d1bc5b8cdb1fdf WatchSource:0}: Error finding container 9e1fe0895074e0b5140079134ff2b2433fd8ec75ac6e3c2592d1bc5b8cdb1fdf: Status 404 returned error can't find the container with id 9e1fe0895074e0b5140079134ff2b2433fd8ec75ac6e3c2592d1bc5b8cdb1fdf
Jul 07 14:04:46.593277 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.593185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk" event={"ID":"1abc93a1-5599-4093-abf7-5a23b7c4362d","Type":"ContainerStarted","Data":"8130b5805fb5087f3189e45c157812083b70741f1761780082e45c076ae29e68"}
Jul 07 14:04:46.593277 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.593260    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:46.594327 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.594298    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2" event={"ID":"e7395196-c624-4f5d-8f1c-4a81128ba97e","Type":"ContainerStarted","Data":"9e1fe0895074e0b5140079134ff2b2433fd8ec75ac6e3c2592d1bc5b8cdb1fdf"}
Jul 07 14:04:46.614059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:46.614002    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk" podStartSLOduration=2.339966708 podStartE2EDuration="4.613984899s" totalImagesPullingTime="2.274018191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:46.613254264 +0000 UTC m=+318.917941933" watchObservedRunningTime="2026-07-07 14:04:46.613984899 +0000 UTC m=+318.918672566"
Jul 07 14:04:50.613187 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:50.613141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2" event={"ID":"e7395196-c624-4f5d-8f1c-4a81128ba97e","Type":"ContainerStarted","Data":"9e45c1ab460f507be34ea843eb4bb640173c8a25e8b38f4e00ee090a2e67a526"}
Jul 07 14:04:50.631929 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:50.631872    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-65ds2" podStartSLOduration=2.47603424 podStartE2EDuration="5.631854568s" totalImagesPullingTime="3.155820328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:50.63049073 +0000 UTC m=+322.935178397" watchObservedRunningTime="2026-07-07 14:04:50.631854568 +0000 UTC m=+322.936542282"
Jul 07 14:04:57.601740 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:57.601681    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c9dfbb547-2p5vk"
Jul 07 14:04:58.600670 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.600638    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"]
Jul 07 14:04:58.603417 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.603399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:58.605918 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.605892    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 14:04:58.606642 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.606626    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sn5vt\""
Jul 07 14:04:58.624263 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.624229    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"]
Jul 07 14:04:58.782442 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.782409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78948922-c3c2-4174-a7c6-f981e70dc209-cert\") pod \"kserve-controller-manager-d6f4b65b8-b9gkc\" (UID: \"78948922-c3c2-4174-a7c6-f981e70dc209\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:58.782442 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.782448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vljq\" (UniqueName: \"kubernetes.io/projected/78948922-c3c2-4174-a7c6-f981e70dc209-kube-api-access-8vljq\") pod \"kserve-controller-manager-d6f4b65b8-b9gkc\" (UID: \"78948922-c3c2-4174-a7c6-f981e70dc209\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:58.883727 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.883607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78948922-c3c2-4174-a7c6-f981e70dc209-cert\") pod \"kserve-controller-manager-d6f4b65b8-b9gkc\" (UID: \"78948922-c3c2-4174-a7c6-f981e70dc209\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:58.883727 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.883648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vljq\" (UniqueName: \"kubernetes.io/projected/78948922-c3c2-4174-a7c6-f981e70dc209-kube-api-access-8vljq\") pod \"kserve-controller-manager-d6f4b65b8-b9gkc\" (UID: \"78948922-c3c2-4174-a7c6-f981e70dc209\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:58.886047 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.886018    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78948922-c3c2-4174-a7c6-f981e70dc209-cert\") pod \"kserve-controller-manager-d6f4b65b8-b9gkc\" (UID: \"78948922-c3c2-4174-a7c6-f981e70dc209\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:58.905092 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.905062    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vljq\" (UniqueName: \"kubernetes.io/projected/78948922-c3c2-4174-a7c6-f981e70dc209-kube-api-access-8vljq\") pod \"kserve-controller-manager-d6f4b65b8-b9gkc\" (UID: \"78948922-c3c2-4174-a7c6-f981e70dc209\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:58.913776 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:58.913739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:04:59.063412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:59.063384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"]
Jul 07 14:04:59.065921 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:04:59.065894    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78948922_c3c2_4174_a7c6_f981e70dc209.slice/crio-43893974cdf237e91a81bdb1e895513e06b554e36c69ce89e3d45f4b9a39ec1a WatchSource:0}: Error finding container 43893974cdf237e91a81bdb1e895513e06b554e36c69ce89e3d45f4b9a39ec1a: Status 404 returned error can't find the container with id 43893974cdf237e91a81bdb1e895513e06b554e36c69ce89e3d45f4b9a39ec1a
Jul 07 14:04:59.654118 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:04:59.654088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc" event={"ID":"78948922-c3c2-4174-a7c6-f981e70dc209","Type":"ContainerStarted","Data":"43893974cdf237e91a81bdb1e895513e06b554e36c69ce89e3d45f4b9a39ec1a"}
Jul 07 14:05:02.669444 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:02.669406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc" event={"ID":"78948922-c3c2-4174-a7c6-f981e70dc209","Type":"ContainerStarted","Data":"9f1c155e99fe383209c2e8be0fa7a67dae506db8f6244da26b7638c2135b14af"}
Jul 07 14:05:02.669912 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:02.669553    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:05:02.699938 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:02.699880    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc" podStartSLOduration=1.919513671 podStartE2EDuration="4.699864782s" totalImagesPullingTime="2.780351111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:05:02.699614909 +0000 UTC m=+335.004302579" watchObservedRunningTime="2026-07-07 14:05:02.699864782 +0000 UTC m=+335.004552449"
Jul 07 14:05:33.679087 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:33.679010    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b9gkc"
Jul 07 14:05:35.949657 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.949617    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75df6bb4cb-tqfns"]
Jul 07 14:05:35.952004 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.951984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:35.954314 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.954292    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 14:05:35.955234 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.955217    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 14:05:35.955327 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.955302    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 14:05:35.955385 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.955303    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 14:05:35.955385 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.955302    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 14:05:35.955474 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.955437    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6f7x2\""
Jul 07 14:05:35.955749 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.955734    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 14:05:35.955811 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.955752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 14:05:35.962045 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.962024    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 14:05:35.964932 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:35.964910    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75df6bb4cb-tqfns"]
Jul 07 14:05:36.088070 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.088028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-console-config\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.088258 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.088077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46936b3-faa3-4686-8b1d-19d9533db780-console-oauth-config\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.088258 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.088162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46936b3-faa3-4686-8b1d-19d9533db780-console-serving-cert\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.088258 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.088225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-oauth-serving-cert\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.088258 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.088250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-service-ca\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.088436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.088268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-trusted-ca-bundle\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.088436 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.088372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbkz6\" (UniqueName: \"kubernetes.io/projected/a46936b3-faa3-4686-8b1d-19d9533db780-kube-api-access-gbkz6\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.189596 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.189564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46936b3-faa3-4686-8b1d-19d9533db780-console-oauth-config\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.189797 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.189612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46936b3-faa3-4686-8b1d-19d9533db780-console-serving-cert\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.189797 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.189658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-oauth-serving-cert\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.189797 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.189705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-service-ca\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.189964 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.189828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-trusted-ca-bundle\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.189964 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.189915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbkz6\" (UniqueName: \"kubernetes.io/projected/a46936b3-faa3-4686-8b1d-19d9533db780-kube-api-access-gbkz6\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.189964 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.189953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-console-config\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.190485 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.190459    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-oauth-serving-cert\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.190617 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.190559    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-service-ca\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.190705 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.190655    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-console-config\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.190882 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.190862    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a46936b3-faa3-4686-8b1d-19d9533db780-trusted-ca-bundle\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.192519 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.192503    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a46936b3-faa3-4686-8b1d-19d9533db780-console-serving-cert\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.192638 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.192617    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a46936b3-faa3-4686-8b1d-19d9533db780-console-oauth-config\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.198041 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.198020    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbkz6\" (UniqueName: \"kubernetes.io/projected/a46936b3-faa3-4686-8b1d-19d9533db780-kube-api-access-gbkz6\") pod \"console-75df6bb4cb-tqfns\" (UID: \"a46936b3-faa3-4686-8b1d-19d9533db780\") " pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.261945 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.261860    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:36.399992 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.399959    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75df6bb4cb-tqfns"]
Jul 07 14:05:36.403218 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:05:36.403184    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46936b3_faa3_4686_8b1d_19d9533db780.slice/crio-9dd99adba3f857bd56e2a9cacf1b512a8cce13966f09d87f4c86f33850e1c162 WatchSource:0}: Error finding container 9dd99adba3f857bd56e2a9cacf1b512a8cce13966f09d87f4c86f33850e1c162: Status 404 returned error can't find the container with id 9dd99adba3f857bd56e2a9cacf1b512a8cce13966f09d87f4c86f33850e1c162
Jul 07 14:05:36.806981 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.806939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75df6bb4cb-tqfns" event={"ID":"a46936b3-faa3-4686-8b1d-19d9533db780","Type":"ContainerStarted","Data":"6c3f13ee10866e051941e63c85f7f0a73f99d3b5c5daa12bfd4af804162d4812"}
Jul 07 14:05:36.806981 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.806988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75df6bb4cb-tqfns" event={"ID":"a46936b3-faa3-4686-8b1d-19d9533db780","Type":"ContainerStarted","Data":"9dd99adba3f857bd56e2a9cacf1b512a8cce13966f09d87f4c86f33850e1c162"}
Jul 07 14:05:36.825574 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:36.825514    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75df6bb4cb-tqfns" podStartSLOduration=1.825496898 podStartE2EDuration="1.825496898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:05:36.824000751 +0000 UTC m=+369.128688418" watchObservedRunningTime="2026-07-07 14:05:36.825496898 +0000 UTC m=+369.130184565"
Jul 07 14:05:46.264524 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:46.264495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:46.265129 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:46.264545    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:46.266826 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:46.266806    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:05:46.854979 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:05:46.854945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75df6bb4cb-tqfns"
Jul 07 14:06:29.530495 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.530458    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"]
Jul 07 14:06:29.532899 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.532873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.537751 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.535406    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 14:06:29.537751 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.535785    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzwnx\""
Jul 07 14:06:29.537751 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.536031    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:06:29.537751 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.536234    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:06:29.537751 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.536430    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 14:06:29.543218 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.542895    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"]
Jul 07 14:06:29.643304 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.643257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ncns\" (UniqueName: \"kubernetes.io/projected/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-kube-api-access-4ncns\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.643494 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.643337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.643494 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.643412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.744598 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.744564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.744813 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.744656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ncns\" (UniqueName: \"kubernetes.io/projected/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-kube-api-access-4ncns\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.744813 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.744727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.745388 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.745363    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.747180 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.747159    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.758231 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.758189    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ncns\" (UniqueName: \"kubernetes.io/projected/e5dc75c6-6618-49d2-8b55-0ad0288b2a5c-kube-api-access-4ncns\") pod \"kuadrant-console-plugin-66b5774985-7fr2p\" (UID: \"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.845598 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.845507    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"
Jul 07 14:06:29.984780 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:29.981409    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p"]
Jul 07 14:06:30.029559 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:30.029516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p" event={"ID":"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c","Type":"ContainerStarted","Data":"60cce1e406eb3dcfccea431abbc3dffd495f5b111535bb147dd04e2e488ded7a"}
Jul 07 14:06:40.296383 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.296347    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"]
Jul 07 14:06:40.299404 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.299382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"
Jul 07 14:06:40.304044 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.304020    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cs6m5\""
Jul 07 14:06:40.318826 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.318793    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"]
Jul 07 14:06:40.446616 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.446577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxzz\" (UniqueName: \"kubernetes.io/projected/67fec775-60e3-4f8e-966e-fa370187008b-kube-api-access-kbxzz\") pod \"limitador-operator-controller-manager-859d7b78bd-5vrxz\" (UID: \"67fec775-60e3-4f8e-966e-fa370187008b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"
Jul 07 14:06:40.549594 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.549491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxzz\" (UniqueName: \"kubernetes.io/projected/67fec775-60e3-4f8e-966e-fa370187008b-kube-api-access-kbxzz\") pod \"limitador-operator-controller-manager-859d7b78bd-5vrxz\" (UID: \"67fec775-60e3-4f8e-966e-fa370187008b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"
Jul 07 14:06:40.562422 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.562393    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxzz\" (UniqueName: \"kubernetes.io/projected/67fec775-60e3-4f8e-966e-fa370187008b-kube-api-access-kbxzz\") pod \"limitador-operator-controller-manager-859d7b78bd-5vrxz\" (UID: \"67fec775-60e3-4f8e-966e-fa370187008b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"
Jul 07 14:06:40.611835 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.611782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"
Jul 07 14:06:40.756488 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:40.756461    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"]
Jul 07 14:06:55.110768 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:06:55.110677    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fec775_60e3_4f8e_966e_fa370187008b.slice/crio-e0cf14fa9184cd595c257a6a08102a9e825ce39d10685ac528ea2679e84bf51e WatchSource:0}: Error finding container e0cf14fa9184cd595c257a6a08102a9e825ce39d10685ac528ea2679e84bf51e: Status 404 returned error can't find the container with id e0cf14fa9184cd595c257a6a08102a9e825ce39d10685ac528ea2679e84bf51e
Jul 07 14:06:55.166743 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:55.166705    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz" event={"ID":"67fec775-60e3-4f8e-966e-fa370187008b","Type":"ContainerStarted","Data":"e0cf14fa9184cd595c257a6a08102a9e825ce39d10685ac528ea2679e84bf51e"}
Jul 07 14:06:56.173340 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:56.173300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p" event={"ID":"e5dc75c6-6618-49d2-8b55-0ad0288b2a5c","Type":"ContainerStarted","Data":"8039a60d2900bf2f8bbd70f1e275680dc1cdb262a3317818c6ba12d56d99c991"}
Jul 07 14:06:56.190897 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:56.190842    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7fr2p" podStartSLOduration=2.00539058 podStartE2EDuration="27.190819338s" totalImagesPullingTime="25.185428758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:56.189750861 +0000 UTC m=+448.494438530" watchObservedRunningTime="2026-07-07 14:06:56.190819338 +0000 UTC m=+448.495507006"
Jul 07 14:06:58.183315 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:58.183280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz" event={"ID":"67fec775-60e3-4f8e-966e-fa370187008b","Type":"ContainerStarted","Data":"abef42145dbd10c0515a58537e37751119d150d08e2394a173470dfb4453dff0"}
Jul 07 14:06:58.183706 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:58.183438    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"
Jul 07 14:06:58.201102 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:06:58.201054    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz" podStartSLOduration=15.674526189 podStartE2EDuration="18.201036607s" totalImagesPullingTime="2.526510418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:58.199491934 +0000 UTC m=+450.504179602" watchObservedRunningTime="2026-07-07 14:06:58.201036607 +0000 UTC m=+450.505724275"
Jul 07 14:07:09.189519 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:07:09.189489    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5vrxz"
Jul 07 14:09:08.083496 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.083462    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"]
Jul 07 14:09:08.086113 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.086090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.088544 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.088523    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 14:09:08.089628 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.089606    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 14:09:08.089763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.089630    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fx6bc\""
Jul 07 14:09:08.089763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.089711    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 14:09:08.097450 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.097426    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"]
Jul 07 14:09:08.138374 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.138342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f98009c-3bcf-4735-a147-fd46e7ebfdba-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.138542 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.138381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.138542 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.138404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.138542 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.138461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.138542 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.138502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px798\" (UniqueName: \"kubernetes.io/projected/4f98009c-3bcf-4735-a147-fd46e7ebfdba-kube-api-access-px798\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.138542 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.138530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239255 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px798\" (UniqueName: \"kubernetes.io/projected/4f98009c-3bcf-4735-a147-fd46e7ebfdba-kube-api-access-px798\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239255 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239509 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f98009c-3bcf-4735-a147-fd46e7ebfdba-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239509 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239509 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239509 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239832 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239809    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239897 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239818    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.239955 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.239894    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.241732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.241710    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f98009c-3bcf-4735-a147-fd46e7ebfdba-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.241990 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.241968    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f98009c-3bcf-4735-a147-fd46e7ebfdba-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.248639 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.248613    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px798\" (UniqueName: \"kubernetes.io/projected/4f98009c-3bcf-4735-a147-fd46e7ebfdba-kube-api-access-px798\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qb9pl\" (UID: \"4f98009c-3bcf-4735-a147-fd46e7ebfdba\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.396903 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.396866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:08.530828 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.530802    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"]
Jul 07 14:09:08.533563 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:09:08.533523    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f98009c_3bcf_4735_a147_fd46e7ebfdba.slice/crio-82e5712c751c107a9039af94593639b2526233f2a127ceaac2317f7591bb22ad WatchSource:0}: Error finding container 82e5712c751c107a9039af94593639b2526233f2a127ceaac2317f7591bb22ad: Status 404 returned error can't find the container with id 82e5712c751c107a9039af94593639b2526233f2a127ceaac2317f7591bb22ad
Jul 07 14:09:08.743630 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:08.743542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl" event={"ID":"4f98009c-3bcf-4735-a147-fd46e7ebfdba","Type":"ContainerStarted","Data":"82e5712c751c107a9039af94593639b2526233f2a127ceaac2317f7591bb22ad"}
Jul 07 14:09:10.753786 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:10.753742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl" event={"ID":"4f98009c-3bcf-4735-a147-fd46e7ebfdba","Type":"ContainerStarted","Data":"4b945eb813e74ce440be196e3d7834729ce99b77717ce83d17e413504d25f755"}
Jul 07 14:09:10.781110 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:10.781051    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl" podStartSLOduration=1.5348482350000001 podStartE2EDuration="2.781033785s" totalImagesPullingTime="1.24618555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:10.778399613 +0000 UTC m=+583.083087282" watchObservedRunningTime="2026-07-07 14:09:10.781033785 +0000 UTC m=+583.085721454"
Jul 07 14:09:18.397626 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:18.397580    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:18.398078 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:18.397648    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:18.410323 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:18.410288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:18.799990 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:18.799908    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qb9pl"
Jul 07 14:09:28.289985 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.287464    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"]
Jul 07 14:09:28.291878 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.291849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.294450 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.294422    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 14:09:28.301176 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.301147    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"]
Jul 07 14:09:28.418286 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.418250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.418464 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.418308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzl89\" (UniqueName: \"kubernetes.io/projected/ea6f6928-0539-47d2-8042-86ec0bd52052-kube-api-access-zzl89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.418464 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.418353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.418464 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.418406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.418464 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.418421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.418464 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.418447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea6f6928-0539-47d2-8042-86ec0bd52052-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.519612 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.519491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzl89\" (UniqueName: \"kubernetes.io/projected/ea6f6928-0539-47d2-8042-86ec0bd52052-kube-api-access-zzl89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.519612 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.519540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.519612 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.519595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.519612 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.519610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.527582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.519638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea6f6928-0539-47d2-8042-86ec0bd52052-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.527582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.519852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.527582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.520114    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.527582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.520138    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.527582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.520206    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.527582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.521927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea6f6928-0539-47d2-8042-86ec0bd52052-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.527582 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.522265    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea6f6928-0539-47d2-8042-86ec0bd52052-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.528560 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.528538    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzl89\" (UniqueName: \"kubernetes.io/projected/ea6f6928-0539-47d2-8042-86ec0bd52052-kube-api-access-zzl89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rdslh\" (UID: \"ea6f6928-0539-47d2-8042-86ec0bd52052\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.605797 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.605670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:28.742863 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.742772    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"]
Jul 07 14:09:28.745619 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:09:28.745586    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6f6928_0539_47d2_8042_86ec0bd52052.slice/crio-ddf65fb56d01083ef956eb468488b0827a645b379c4b80b0c4f5baabe903b1c0 WatchSource:0}: Error finding container ddf65fb56d01083ef956eb468488b0827a645b379c4b80b0c4f5baabe903b1c0: Status 404 returned error can't find the container with id ddf65fb56d01083ef956eb468488b0827a645b379c4b80b0c4f5baabe903b1c0
Jul 07 14:09:28.840126 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:28.840091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh" event={"ID":"ea6f6928-0539-47d2-8042-86ec0bd52052","Type":"ContainerStarted","Data":"ddf65fb56d01083ef956eb468488b0827a645b379c4b80b0c4f5baabe903b1c0"}
Jul 07 14:09:29.847358 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:29.847322    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh" event={"ID":"ea6f6928-0539-47d2-8042-86ec0bd52052","Type":"ContainerStarted","Data":"f63f8d131e97238f3cb2258a47ca2dc74c65c9bf634a3aa9b6d72326635b7413"}
Jul 07 14:09:29.867459 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:29.867402    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh" podStartSLOduration=1.599244801 podStartE2EDuration="1.867385932s" totalImagesPullingTime="268.141131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:29.866902963 +0000 UTC m=+602.171590657" watchObservedRunningTime="2026-07-07 14:09:29.867385932 +0000 UTC m=+602.172073600"
Jul 07 14:09:38.606277 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:38.606234    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:38.606800 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:38.606311    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:38.619037 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:38.618998    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:09:38.898572 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:09:38.898537    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rdslh"
Jul 07 14:10:19.814446 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.814410    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"]
Jul 07 14:10:19.817213 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.817193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.819712 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.819680    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 14:10:19.829088 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.829063    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"]
Jul 07 14:10:19.891750 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.891714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.891914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.891763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6zcc\" (UniqueName: \"kubernetes.io/projected/81f26a6e-37bc-4900-a27a-d5d8dc4422db-kube-api-access-c6zcc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.891914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.891835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.891914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.891871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.892037 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.891926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.892037 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.891957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f26a6e-37bc-4900-a27a-d5d8dc4422db-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.992921 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.992879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993109 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.992944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f26a6e-37bc-4900-a27a-d5d8dc4422db-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993109 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.992976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993109 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.993016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6zcc\" (UniqueName: \"kubernetes.io/projected/81f26a6e-37bc-4900-a27a-d5d8dc4422db-kube-api-access-c6zcc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993109 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.993067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993109 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.993097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993366 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.993329    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993420 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.993376    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.993476 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.993418    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.995323 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.995289    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81f26a6e-37bc-4900-a27a-d5d8dc4422db-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:19.995724 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:19.995681    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81f26a6e-37bc-4900-a27a-d5d8dc4422db-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:20.001880 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:20.001850    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6zcc\" (UniqueName: \"kubernetes.io/projected/81f26a6e-37bc-4900-a27a-d5d8dc4422db-kube-api-access-c6zcc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj\" (UID: \"81f26a6e-37bc-4900-a27a-d5d8dc4422db\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:20.129096 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:20.128999    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:20.265414 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:20.265388    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"]
Jul 07 14:10:20.267345 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:10:20.267318    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81f26a6e_37bc_4900_a27a_d5d8dc4422db.slice/crio-adfd86fb00d47ec6a571c09e815eaa13a6dbe075b93009dc50a45c19f608c248 WatchSource:0}: Error finding container adfd86fb00d47ec6a571c09e815eaa13a6dbe075b93009dc50a45c19f608c248: Status 404 returned error can't find the container with id adfd86fb00d47ec6a571c09e815eaa13a6dbe075b93009dc50a45c19f608c248
Jul 07 14:10:20.268675 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:20.268656    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:10:21.074209 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:21.074174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj" event={"ID":"81f26a6e-37bc-4900-a27a-d5d8dc4422db","Type":"ContainerStarted","Data":"adfd86fb00d47ec6a571c09e815eaa13a6dbe075b93009dc50a45c19f608c248"}
Jul 07 14:10:24.091344 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:24.091311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj" event={"ID":"81f26a6e-37bc-4900-a27a-d5d8dc4422db","Type":"ContainerStarted","Data":"a3d670b47af6e7a965b8ccd09af6c87cdaa81d71ca4f6cf33d8b1cdf05d7221d"}
Jul 07 14:10:30.129646 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:30.129615    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:30.130046 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:30.129657    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:30.142730 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:30.142708    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:10:30.165647 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:30.165598    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj" podStartSLOduration=8.026064101 podStartE2EDuration="11.165581565s" totalImagesPullingTime="3.139517464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:24.118348306 +0000 UTC m=+656.423035975" watchObservedRunningTime="2026-07-07 14:10:30.165581565 +0000 UTC m=+662.470269232"
Jul 07 14:10:31.133224 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:10:31.133196    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj"
Jul 07 14:27:56.205785 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.205675    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"]
Jul 07 14:27:56.208362 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.208341    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.211627 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.211604    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9a9d5643\"/\"openshift-service-ca.crt\""
Jul 07 14:27:56.211766 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.211651    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9a9d5643\"/\"e2e-lifecycle-model-9a9d5643-kserve-self-signed-certs\""
Jul 07 14:27:56.211766 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.211665    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9a9d5643\"/\"default-dockercfg-qz24s\""
Jul 07 14:27:56.211766 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.211612    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9a9d5643\"/\"kube-root-ca.crt\""
Jul 07 14:27:56.219899 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.219876    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"]
Jul 07 14:27:56.330278 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.330238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-model-cache\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.330278 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.330280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6572298-897b-47af-80db-a3bd31c07906-tls-certs\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.330541 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.330308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-home\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.330541 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.330427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-dshm\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.330541 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.330491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzxvz\" (UniqueName: \"kubernetes.io/projected/f6572298-897b-47af-80db-a3bd31c07906-kube-api-access-vzxvz\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.330541 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.330536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-tmp-dir\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.431679 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.431645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-home\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.431873 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.431708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-dshm\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.431873 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.431742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzxvz\" (UniqueName: \"kubernetes.io/projected/f6572298-897b-47af-80db-a3bd31c07906-kube-api-access-vzxvz\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.431873 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.431790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-tmp-dir\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.431873 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.431865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-model-cache\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.432090 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.431894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6572298-897b-47af-80db-a3bd31c07906-tls-certs\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.432154 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.432113    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-home\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.432332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.432301    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-tmp-dir\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.432466 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.432435    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-model-cache\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.433934 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.433913    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-dshm\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.434423 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.434401    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6572298-897b-47af-80db-a3bd31c07906-tls-certs\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.440770 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.440743    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzxvz\" (UniqueName: \"kubernetes.io/projected/f6572298-897b-47af-80db-a3bd31c07906-kube-api-access-vzxvz\") pod \"e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") " pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.517884 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.517783    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:27:56.662117 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.662086    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"]
Jul 07 14:27:56.665471 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:27:56.665444    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6572298_897b_47af_80db_a3bd31c07906.slice/crio-22823d11776574da492effd2bed84a2271ec070f48efa2b9afdcdd0465c0b16d WatchSource:0}: Error finding container 22823d11776574da492effd2bed84a2271ec070f48efa2b9afdcdd0465c0b16d: Status 404 returned error can't find the container with id 22823d11776574da492effd2bed84a2271ec070f48efa2b9afdcdd0465c0b16d
Jul 07 14:27:56.777573 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.777480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm" event={"ID":"f6572298-897b-47af-80db-a3bd31c07906","Type":"ContainerStarted","Data":"ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4"}
Jul 07 14:27:56.777573 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.777525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm" event={"ID":"f6572298-897b-47af-80db-a3bd31c07906","Type":"ContainerStarted","Data":"22823d11776574da492effd2bed84a2271ec070f48efa2b9afdcdd0465c0b16d"}
Jul 07 14:27:56.800527 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:27:56.800471    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm" podStartSLOduration=0.800454018 podStartE2EDuration="800.454018ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:27:56.799342016 +0000 UTC m=+1709.104029685" watchObservedRunningTime="2026-07-07 14:27:56.800454018 +0000 UTC m=+1709.105141687"
Jul 07 14:28:06.517928 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:06.517890    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:28:06.518356 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:06.518157    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:28:06.530402 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:06.530381    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:28:06.834865 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:06.834768    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:28:30.600580 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:30.600539    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"]
Jul 07 14:28:45.621342 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.621302    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm" podUID="f6572298-897b-47af-80db-a3bd31c07906" containerName="main" containerID="cri-o://ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4" gracePeriod=45
Jul 07 14:28:45.863472 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.863448    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:28:45.976008 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.975972    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-tmp-dir\") pod \"f6572298-897b-47af-80db-a3bd31c07906\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") "
Jul 07 14:28:45.976008 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976014    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-model-cache\") pod \"f6572298-897b-47af-80db-a3bd31c07906\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") "
Jul 07 14:28:45.976270 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976042    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-dshm\") pod \"f6572298-897b-47af-80db-a3bd31c07906\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") "
Jul 07 14:28:45.976270 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976068    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6572298-897b-47af-80db-a3bd31c07906-tls-certs\") pod \"f6572298-897b-47af-80db-a3bd31c07906\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") "
Jul 07 14:28:45.976270 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976084    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-home\") pod \"f6572298-897b-47af-80db-a3bd31c07906\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") "
Jul 07 14:28:45.976270 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976122    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzxvz\" (UniqueName: \"kubernetes.io/projected/f6572298-897b-47af-80db-a3bd31c07906-kube-api-access-vzxvz\") pod \"f6572298-897b-47af-80db-a3bd31c07906\" (UID: \"f6572298-897b-47af-80db-a3bd31c07906\") "
Jul 07 14:28:45.976448 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976318    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f6572298-897b-47af-80db-a3bd31c07906" (UID: "f6572298-897b-47af-80db-a3bd31c07906"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:28:45.976448 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976337    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-model-cache" (OuterVolumeSpecName: "model-cache") pod "f6572298-897b-47af-80db-a3bd31c07906" (UID: "f6572298-897b-47af-80db-a3bd31c07906"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:28:45.976448 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.976357    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-home" (OuterVolumeSpecName: "home") pod "f6572298-897b-47af-80db-a3bd31c07906" (UID: "f6572298-897b-47af-80db-a3bd31c07906"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:28:45.978362 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.978333    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6572298-897b-47af-80db-a3bd31c07906-kube-api-access-vzxvz" (OuterVolumeSpecName: "kube-api-access-vzxvz") pod "f6572298-897b-47af-80db-a3bd31c07906" (UID: "f6572298-897b-47af-80db-a3bd31c07906"). InnerVolumeSpecName "kube-api-access-vzxvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:28:45.978362 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.978338    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-dshm" (OuterVolumeSpecName: "dshm") pod "f6572298-897b-47af-80db-a3bd31c07906" (UID: "f6572298-897b-47af-80db-a3bd31c07906"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:28:45.978522 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:45.978387    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6572298-897b-47af-80db-a3bd31c07906-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f6572298-897b-47af-80db-a3bd31c07906" (UID: "f6572298-897b-47af-80db-a3bd31c07906"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:28:46.002281 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.002249    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6572298-897b-47af-80db-a3bd31c07906" containerID="ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4" exitCode=0
Jul 07 14:28:46.002477 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.002294    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"
Jul 07 14:28:46.002477 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.002310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm" event={"ID":"f6572298-897b-47af-80db-a3bd31c07906","Type":"ContainerDied","Data":"ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4"}
Jul 07 14:28:46.002477 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.002343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm" event={"ID":"f6572298-897b-47af-80db-a3bd31c07906","Type":"ContainerDied","Data":"22823d11776574da492effd2bed84a2271ec070f48efa2b9afdcdd0465c0b16d"}
Jul 07 14:28:46.002477 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.002360    2577 scope.go:117] "RemoveContainer" containerID="ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4"
Jul 07 14:28:46.011276 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.011256    2577 scope.go:117] "RemoveContainer" containerID="ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4"
Jul 07 14:28:46.011564 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:28:46.011540    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4\": container with ID starting with ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4 not found: ID does not exist" containerID="ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4"
Jul 07 14:28:46.011603 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.011574    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4"} err="failed to get container status \"ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4\": rpc error: code = NotFound desc = could not find container \"ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4\": container with ID starting with ad7b6abbfd275470c90faa975e3dee73e397e350856eef20069013cafcc597a4 not found: ID does not exist"
Jul 07 14:28:46.025458 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.025425    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"]
Jul 07 14:28:46.029036 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.029010    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9a9d5643/e2e-lifecycle-model-9a9d5643-kserve-7dcb996695-fj2nm"]
Jul 07 14:28:46.077798 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.077757    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzxvz\" (UniqueName: \"kubernetes.io/projected/f6572298-897b-47af-80db-a3bd31c07906-kube-api-access-vzxvz\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:28:46.077957 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.077813    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:28:46.077957 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.077826    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:28:46.077957 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.077834    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:28:46.077957 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.077844    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6572298-897b-47af-80db-a3bd31c07906-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:28:46.077957 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.077851    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6572298-897b-47af-80db-a3bd31c07906-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:28:46.265871 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:28:46.265792    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6572298-897b-47af-80db-a3bd31c07906" path="/var/lib/kubelet/pods/f6572298-897b-47af-80db-a3bd31c07906/volumes"
Jul 07 14:30:32.999353 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:32.999315    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"]
Jul 07 14:30:32.999959 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:32.999835    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6572298-897b-47af-80db-a3bd31c07906" containerName="main"
Jul 07 14:30:32.999959 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:32.999855    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6572298-897b-47af-80db-a3bd31c07906" containerName="main"
Jul 07 14:30:33.000075 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:32.999971    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6572298-897b-47af-80db-a3bd31c07906" containerName="main"
Jul 07 14:30:33.003035 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.003014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.005293 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.005271    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8dd42e\"/\"openshift-service-ca.crt\""
Jul 07 14:30:33.006023 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.006008    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8dd42e\"/\"default-dockercfg-n7fcp\""
Jul 07 14:30:33.006091 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.006019    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8dd42e\"/\"kube-root-ca.crt\""
Jul 07 14:30:33.006091 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.006032    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8dd42e\"/\"test-model-8dd42e-kserve-self-signed-certs\""
Jul 07 14:30:33.015503 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.015478    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"]
Jul 07 14:30:33.062657 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.062617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tls-certs\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.062856 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.062722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-dshm\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.062856 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.062756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-home\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.062856 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.062783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-model-cache\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.062856 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.062805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn6bf\" (UniqueName: \"kubernetes.io/projected/c49f2c4a-457a-40ed-95c0-eff5b61961ea-kube-api-access-fn6bf\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.062856 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.062826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tmp-dir\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.163931 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.163898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tls-certs\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164112 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.163992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-dshm\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164112 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.164027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-home\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164112 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.164069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-model-cache\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164112 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.164097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn6bf\" (UniqueName: \"kubernetes.io/projected/c49f2c4a-457a-40ed-95c0-eff5b61961ea-kube-api-access-fn6bf\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164312 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.164124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tmp-dir\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164565 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.164534    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-model-cache\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164565 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.164553    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-home\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.164797 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.164579    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tmp-dir\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.166411 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.166383    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-dshm\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.166666 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.166647    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tls-certs\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.172337 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.172319    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn6bf\" (UniqueName: \"kubernetes.io/projected/c49f2c4a-457a-40ed-95c0-eff5b61961ea-kube-api-access-fn6bf\") pod \"test-model-8dd42e-kserve-7f5d4f44dc-cxtfp\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") " pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.312564 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.312459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:33.449192 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.449156    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"]
Jul 07 14:30:33.451156 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:30:33.451128    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc49f2c4a_457a_40ed_95c0_eff5b61961ea.slice/crio-f22d7f7971fe9fdeeded694198080d97733a076c7c8323c80da10a0979037b5a WatchSource:0}: Error finding container f22d7f7971fe9fdeeded694198080d97733a076c7c8323c80da10a0979037b5a: Status 404 returned error can't find the container with id f22d7f7971fe9fdeeded694198080d97733a076c7c8323c80da10a0979037b5a
Jul 07 14:30:33.478597 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:33.478558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp" event={"ID":"c49f2c4a-457a-40ed-95c0-eff5b61961ea","Type":"ContainerStarted","Data":"f22d7f7971fe9fdeeded694198080d97733a076c7c8323c80da10a0979037b5a"}
Jul 07 14:30:34.484633 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:34.484584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp" event={"ID":"c49f2c4a-457a-40ed-95c0-eff5b61961ea","Type":"ContainerStarted","Data":"3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e"}
Jul 07 14:30:34.505962 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:34.505901    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp" podStartSLOduration=2.505880459 podStartE2EDuration="2.505880459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:34.505462123 +0000 UTC m=+1866.810149791" watchObservedRunningTime="2026-07-07 14:30:34.505880459 +0000 UTC m=+1866.810568126"
Jul 07 14:30:43.313458 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:43.313413    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:43.313458 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:43.313463    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:43.326287 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:43.326250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:30:43.536395 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:30:43.536363    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:31:15.713020 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.712982    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"]
Jul 07 14:31:15.717004 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.716984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.721194 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.721166    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b9e929\"/\"default-dockercfg-khnhn\""
Jul 07 14:31:15.721329 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.721179    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b9e929\"/\"test-model-b9e929-kserve-self-signed-certs\""
Jul 07 14:31:15.721514 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.721489    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b9e929\"/\"kube-root-ca.crt\""
Jul 07 14:31:15.721849 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.721833    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b9e929\"/\"openshift-service-ca.crt\""
Jul 07 14:31:15.737878 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.737843    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"]
Jul 07 14:31:15.755867 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.755829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tmp-dir\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.756038 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.755875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-dshm\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.756038 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.755909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-home\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.756038 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.755945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-model-cache\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.756038 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.755970    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wvz\" (UniqueName: \"kubernetes.io/projected/d1e054c3-101d-472a-801f-2a4c0e5df6cd-kube-api-access-l5wvz\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.756038 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.755995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tls-certs\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857349 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-home\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857349 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-model-cache\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857615 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wvz\" (UniqueName: \"kubernetes.io/projected/d1e054c3-101d-472a-801f-2a4c0e5df6cd-kube-api-access-l5wvz\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857615 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tls-certs\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857615 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tmp-dir\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857615 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-dshm\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857866 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857773    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-home\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857866 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857836    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-model-cache\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.857943 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.857890    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tmp-dir\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.859882 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.859853    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-dshm\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.860005 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.859989    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tls-certs\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:15.866200 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:15.866177    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wvz\" (UniqueName: \"kubernetes.io/projected/d1e054c3-101d-472a-801f-2a4c0e5df6cd-kube-api-access-l5wvz\") pod \"test-model-b9e929-kserve-6574b5fb45-xxq7l\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") " pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:16.026340 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:16.026243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:16.167836 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:16.167807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"]
Jul 07 14:31:16.170398 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:31:16.170361    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1e054c3_101d_472a_801f_2a4c0e5df6cd.slice/crio-ceded97e3b230603f3f7f0d0e347ebd501091746bfe7da21a125b86ed5052bf9 WatchSource:0}: Error finding container ceded97e3b230603f3f7f0d0e347ebd501091746bfe7da21a125b86ed5052bf9: Status 404 returned error can't find the container with id ceded97e3b230603f3f7f0d0e347ebd501091746bfe7da21a125b86ed5052bf9
Jul 07 14:31:16.677459 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:16.677421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l" event={"ID":"d1e054c3-101d-472a-801f-2a4c0e5df6cd","Type":"ContainerStarted","Data":"d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31"}
Jul 07 14:31:16.677648 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:16.677471    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l" event={"ID":"d1e054c3-101d-472a-801f-2a4c0e5df6cd","Type":"ContainerStarted","Data":"ceded97e3b230603f3f7f0d0e347ebd501091746bfe7da21a125b86ed5052bf9"}
Jul 07 14:31:16.700809 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:16.700757    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l" podStartSLOduration=1.700740999 podStartE2EDuration="1.700740999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:16.698122326 +0000 UTC m=+1909.002809993" watchObservedRunningTime="2026-07-07 14:31:16.700740999 +0000 UTC m=+1909.005428666"
Jul 07 14:31:26.026585 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:26.026527    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:26.026585 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:26.026595    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:26.039477 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:26.039437    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:26.734714 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:26.734667    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:35.260969 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:35.260933    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"]
Jul 07 14:31:36.187772 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:36.187740    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"]
Jul 07 14:31:50.280956 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.280907    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp" podUID="c49f2c4a-457a-40ed-95c0-eff5b61961ea" containerName="main" containerID="cri-o://3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e" gracePeriod=45
Jul 07 14:31:50.542655 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.542586    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:31:50.596271 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596222    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tmp-dir\") pod \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") "
Jul 07 14:31:50.596271 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596276    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-dshm\") pod \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") "
Jul 07 14:31:50.596523 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596302    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn6bf\" (UniqueName: \"kubernetes.io/projected/c49f2c4a-457a-40ed-95c0-eff5b61961ea-kube-api-access-fn6bf\") pod \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") "
Jul 07 14:31:50.596523 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596348    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-model-cache\") pod \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") "
Jul 07 14:31:50.596523 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596375    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-home\") pod \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") "
Jul 07 14:31:50.596523 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596397    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tls-certs\") pod \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\" (UID: \"c49f2c4a-457a-40ed-95c0-eff5b61961ea\") "
Jul 07 14:31:50.596735 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596540    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c49f2c4a-457a-40ed-95c0-eff5b61961ea" (UID: "c49f2c4a-457a-40ed-95c0-eff5b61961ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:50.596735 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596630    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "c49f2c4a-457a-40ed-95c0-eff5b61961ea" (UID: "c49f2c4a-457a-40ed-95c0-eff5b61961ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:50.596735 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596648    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-home" (OuterVolumeSpecName: "home") pod "c49f2c4a-457a-40ed-95c0-eff5b61961ea" (UID: "c49f2c4a-457a-40ed-95c0-eff5b61961ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:50.596842 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596792    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:50.596875 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596838    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:50.596875 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.596851    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:50.598638 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.598609    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c49f2c4a-457a-40ed-95c0-eff5b61961ea" (UID: "c49f2c4a-457a-40ed-95c0-eff5b61961ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:31:50.598936 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.598910    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49f2c4a-457a-40ed-95c0-eff5b61961ea-kube-api-access-fn6bf" (OuterVolumeSpecName: "kube-api-access-fn6bf") pod "c49f2c4a-457a-40ed-95c0-eff5b61961ea" (UID: "c49f2c4a-457a-40ed-95c0-eff5b61961ea"). InnerVolumeSpecName "kube-api-access-fn6bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:50.598936 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.598922    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-dshm" (OuterVolumeSpecName: "dshm") pod "c49f2c4a-457a-40ed-95c0-eff5b61961ea" (UID: "c49f2c4a-457a-40ed-95c0-eff5b61961ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:50.698147 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.698111    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c49f2c4a-457a-40ed-95c0-eff5b61961ea-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:50.698147 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.698142    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn6bf\" (UniqueName: \"kubernetes.io/projected/c49f2c4a-457a-40ed-95c0-eff5b61961ea-kube-api-access-fn6bf\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:50.698147 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.698153    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c49f2c4a-457a-40ed-95c0-eff5b61961ea-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:50.837992 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.837902    2577 generic.go:356] "Generic (PLEG): container finished" podID="c49f2c4a-457a-40ed-95c0-eff5b61961ea" containerID="3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e" exitCode=0
Jul 07 14:31:50.837992 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.837949    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"
Jul 07 14:31:50.838179 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.837998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp" event={"ID":"c49f2c4a-457a-40ed-95c0-eff5b61961ea","Type":"ContainerDied","Data":"3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e"}
Jul 07 14:31:50.838179 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.838046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp" event={"ID":"c49f2c4a-457a-40ed-95c0-eff5b61961ea","Type":"ContainerDied","Data":"f22d7f7971fe9fdeeded694198080d97733a076c7c8323c80da10a0979037b5a"}
Jul 07 14:31:50.838179 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.838064    2577 scope.go:117] "RemoveContainer" containerID="3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e"
Jul 07 14:31:50.846785 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.846768    2577 scope.go:117] "RemoveContainer" containerID="3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e"
Jul 07 14:31:50.847101 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:31:50.847082    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e\": container with ID starting with 3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e not found: ID does not exist" containerID="3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e"
Jul 07 14:31:50.847156 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.847110    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e"} err="failed to get container status \"3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e\": rpc error: code = NotFound desc = could not find container \"3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e\": container with ID starting with 3d5126de9db92ecfc906dd792370b032430881914945e75aa7b7cb942ac1436e not found: ID does not exist"
Jul 07 14:31:50.867736 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.867704    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"]
Jul 07 14:31:50.871499 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:50.871469    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8dd42e/test-model-8dd42e-kserve-7f5d4f44dc-cxtfp"]
Jul 07 14:31:51.207510 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.207469    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l" podUID="d1e054c3-101d-472a-801f-2a4c0e5df6cd" containerName="main" containerID="cri-o://d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31" gracePeriod=45
Jul 07 14:31:51.462801 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.462738    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:51.504898 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.504868    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-model-cache\") pod \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") "
Jul 07 14:31:51.505097 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.504918    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-home\") pod \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") "
Jul 07 14:31:51.505097 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.504967    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tmp-dir\") pod \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") "
Jul 07 14:31:51.505097 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.504993    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5wvz\" (UniqueName: \"kubernetes.io/projected/d1e054c3-101d-472a-801f-2a4c0e5df6cd-kube-api-access-l5wvz\") pod \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") "
Jul 07 14:31:51.505097 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505027    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-dshm\") pod \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") "
Jul 07 14:31:51.505097 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505077    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tls-certs\") pod \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\" (UID: \"d1e054c3-101d-472a-801f-2a4c0e5df6cd\") "
Jul 07 14:31:51.505342 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505218    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1e054c3-101d-472a-801f-2a4c0e5df6cd" (UID: "d1e054c3-101d-472a-801f-2a4c0e5df6cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:51.505342 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505266    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-home" (OuterVolumeSpecName: "home") pod "d1e054c3-101d-472a-801f-2a4c0e5df6cd" (UID: "d1e054c3-101d-472a-801f-2a4c0e5df6cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:51.505342 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505278    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1e054c3-101d-472a-801f-2a4c0e5df6cd" (UID: "d1e054c3-101d-472a-801f-2a4c0e5df6cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:51.505446 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505415    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:51.505446 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505431    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:51.505446 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.505440    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:51.507446 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.507421    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-dshm" (OuterVolumeSpecName: "dshm") pod "d1e054c3-101d-472a-801f-2a4c0e5df6cd" (UID: "d1e054c3-101d-472a-801f-2a4c0e5df6cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:31:51.507550 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.507473    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1e054c3-101d-472a-801f-2a4c0e5df6cd" (UID: "d1e054c3-101d-472a-801f-2a4c0e5df6cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:31:51.507550 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.507486    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e054c3-101d-472a-801f-2a4c0e5df6cd-kube-api-access-l5wvz" (OuterVolumeSpecName: "kube-api-access-l5wvz") pod "d1e054c3-101d-472a-801f-2a4c0e5df6cd" (UID: "d1e054c3-101d-472a-801f-2a4c0e5df6cd"). InnerVolumeSpecName "kube-api-access-l5wvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:51.606125 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.606085    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1e054c3-101d-472a-801f-2a4c0e5df6cd-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:51.606125 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.606117    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1e054c3-101d-472a-801f-2a4c0e5df6cd-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:51.606125 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.606133    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5wvz\" (UniqueName: \"kubernetes.io/projected/d1e054c3-101d-472a-801f-2a4c0e5df6cd-kube-api-access-l5wvz\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:31:51.844357 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.844264    2577 generic.go:356] "Generic (PLEG): container finished" podID="d1e054c3-101d-472a-801f-2a4c0e5df6cd" containerID="d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31" exitCode=0
Jul 07 14:31:51.844357 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.844313    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"
Jul 07 14:31:51.844572 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.844355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l" event={"ID":"d1e054c3-101d-472a-801f-2a4c0e5df6cd","Type":"ContainerDied","Data":"d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31"}
Jul 07 14:31:51.844572 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.844401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l" event={"ID":"d1e054c3-101d-472a-801f-2a4c0e5df6cd","Type":"ContainerDied","Data":"ceded97e3b230603f3f7f0d0e347ebd501091746bfe7da21a125b86ed5052bf9"}
Jul 07 14:31:51.844572 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.844425    2577 scope.go:117] "RemoveContainer" containerID="d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31"
Jul 07 14:31:51.853514 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.853492    2577 scope.go:117] "RemoveContainer" containerID="d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31"
Jul 07 14:31:51.853798 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:31:51.853779    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31\": container with ID starting with d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31 not found: ID does not exist" containerID="d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31"
Jul 07 14:31:51.853859 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.853806    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31"} err="failed to get container status \"d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31\": rpc error: code = NotFound desc = could not find container \"d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31\": container with ID starting with d637b36e16d81014264d6739d1a9d1e6590705dcd2f013d9fb998a214f095d31 not found: ID does not exist"
Jul 07 14:31:51.869560 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.869530    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"]
Jul 07 14:31:51.876136 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:51.876108    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b9e929/test-model-b9e929-kserve-6574b5fb45-xxq7l"]
Jul 07 14:31:52.265711 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:52.265662    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c49f2c4a-457a-40ed-95c0-eff5b61961ea" path="/var/lib/kubelet/pods/c49f2c4a-457a-40ed-95c0-eff5b61961ea/volumes"
Jul 07 14:31:52.266090 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:31:52.266076    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e054c3-101d-472a-801f-2a4c0e5df6cd" path="/var/lib/kubelet/pods/d1e054c3-101d-472a-801f-2a4c0e5df6cd/volumes"
Jul 07 14:33:34.594265 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.594220    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"]
Jul 07 14:33:34.594834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.594757    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49f2c4a-457a-40ed-95c0-eff5b61961ea" containerName="main"
Jul 07 14:33:34.594834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.594777    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49f2c4a-457a-40ed-95c0-eff5b61961ea" containerName="main"
Jul 07 14:33:34.594834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.594794    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e054c3-101d-472a-801f-2a4c0e5df6cd" containerName="main"
Jul 07 14:33:34.594834 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.594803    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e054c3-101d-472a-801f-2a4c0e5df6cd" containerName="main"
Jul 07 14:33:34.595059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.594888    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e054c3-101d-472a-801f-2a4c0e5df6cd" containerName="main"
Jul 07 14:33:34.595059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.594901    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c49f2c4a-457a-40ed-95c0-eff5b61961ea" containerName="main"
Jul 07 14:33:34.597978 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.597956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.601281 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.601240    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"auth-test-model-0b992a-kserve-self-signed-certs\""
Jul 07 14:33:34.601281 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.601246    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"default-dockercfg-wzrc2\""
Jul 07 14:33:34.601469 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.601282    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"kube-root-ca.crt\""
Jul 07 14:33:34.601469 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.601294    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"openshift-service-ca.crt\""
Jul 07 14:33:34.608783 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.608761    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"]
Jul 07 14:33:34.762018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.761982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-model-cache\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.762018 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.762029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec8b224-148f-45e1-855c-775a95ce49ad-tls-certs\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.762269 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.762067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-tmp-dir\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.762269 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.762093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-home\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.762269 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.762119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w48r4\" (UniqueName: \"kubernetes.io/projected/2ec8b224-148f-45e1-855c-775a95ce49ad-kube-api-access-w48r4\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.762269 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.762191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-dshm\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.863734 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.863614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-dshm\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.863734 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.863660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-model-cache\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.863734 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.863710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec8b224-148f-45e1-855c-775a95ce49ad-tls-certs\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.863990 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.863750    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-tmp-dir\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.863990 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.863773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-home\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.863990 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.863810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w48r4\" (UniqueName: \"kubernetes.io/projected/2ec8b224-148f-45e1-855c-775a95ce49ad-kube-api-access-w48r4\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.864151 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.864130    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-tmp-dir\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.864151 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.864144    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-model-cache\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.864270 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.864219    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-home\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.865986 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.865957    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-dshm\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.866318 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.866293    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec8b224-148f-45e1-855c-775a95ce49ad-tls-certs\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.873812 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.873791    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w48r4\" (UniqueName: \"kubernetes.io/projected/2ec8b224-148f-45e1-855c-775a95ce49ad-kube-api-access-w48r4\") pod \"auth-test-model-0b992a-kserve-66596cc779-zj7d8\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") " pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:34.907435 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:34.907402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:35.045293 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:35.045268    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"]
Jul 07 14:33:35.047643 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:33:35.047614    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ec8b224_148f_45e1_855c_775a95ce49ad.slice/crio-8425a1aeadb405d02f1cf118d3ed29c6be53ae81a6abfc3abb613b28b979ec20 WatchSource:0}: Error finding container 8425a1aeadb405d02f1cf118d3ed29c6be53ae81a6abfc3abb613b28b979ec20: Status 404 returned error can't find the container with id 8425a1aeadb405d02f1cf118d3ed29c6be53ae81a6abfc3abb613b28b979ec20
Jul 07 14:33:35.314030 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:35.313993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8" event={"ID":"2ec8b224-148f-45e1-855c-775a95ce49ad","Type":"ContainerStarted","Data":"4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08"}
Jul 07 14:33:35.314030 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:35.314034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8" event={"ID":"2ec8b224-148f-45e1-855c-775a95ce49ad","Type":"ContainerStarted","Data":"8425a1aeadb405d02f1cf118d3ed29c6be53ae81a6abfc3abb613b28b979ec20"}
Jul 07 14:33:35.332740 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:35.332663    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8" podStartSLOduration=1.3326436560000001 podStartE2EDuration="1.332643656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:35.332197641 +0000 UTC m=+2047.636885309" watchObservedRunningTime="2026-07-07 14:33:35.332643656 +0000 UTC m=+2047.637331325"
Jul 07 14:33:44.908332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:44.908281    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:44.908332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:44.908339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:44.920737 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:44.920713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:33:45.369842 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:33:45.369754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:34:09.003352 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.003311    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"]
Jul 07 14:34:09.006874 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.006851    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.009394 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.009371    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"kube-root-ca.crt\""
Jul 07 14:34:09.010211 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.010187    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"openshift-service-ca.crt\""
Jul 07 14:34:09.010320 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.010240    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"auth-test-model-bb9591-kserve-self-signed-certs\""
Jul 07 14:34:09.010320 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.010268    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"default-dockercfg-g2nq9\""
Jul 07 14:34:09.016757 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.016733    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"]
Jul 07 14:34:09.058168 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.058131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-home\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.058365 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.058183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-dshm\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.058365 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.058210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-model-cache\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.058365 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.058298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tls-certs\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.058538 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.058365    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tmp-dir\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.058538 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.058390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcsg\" (UniqueName: \"kubernetes.io/projected/d44a550f-6ad7-4917-b5f8-38461fd63a9c-kube-api-access-wpcsg\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159088 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tls-certs\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tmp-dir\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcsg\" (UniqueName: \"kubernetes.io/projected/d44a550f-6ad7-4917-b5f8-38461fd63a9c-kube-api-access-wpcsg\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-home\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-dshm\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-model-cache\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159576 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159554    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tmp-dir\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159637 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159582    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-home\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.159637 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.159610    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-model-cache\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.161508 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.161487    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-dshm\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.161777 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.161759    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tls-certs\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.168886 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.168851    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcsg\" (UniqueName: \"kubernetes.io/projected/d44a550f-6ad7-4917-b5f8-38461fd63a9c-kube-api-access-wpcsg\") pod \"auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") " pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.318076 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.317979    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:09.458124 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.458087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"]
Jul 07 14:34:09.460635 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:34:09.460610    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd44a550f_6ad7_4917_b5f8_38461fd63a9c.slice/crio-5ffaea99ca6ac8ced9f0f831e7be47bae2db8cca38ec38f0296e9377e29f0d93 WatchSource:0}: Error finding container 5ffaea99ca6ac8ced9f0f831e7be47bae2db8cca38ec38f0296e9377e29f0d93: Status 404 returned error can't find the container with id 5ffaea99ca6ac8ced9f0f831e7be47bae2db8cca38ec38f0296e9377e29f0d93
Jul 07 14:34:09.467335 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:09.467306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk" event={"ID":"d44a550f-6ad7-4917-b5f8-38461fd63a9c","Type":"ContainerStarted","Data":"5ffaea99ca6ac8ced9f0f831e7be47bae2db8cca38ec38f0296e9377e29f0d93"}
Jul 07 14:34:10.473788 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:10.473749    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk" event={"ID":"d44a550f-6ad7-4917-b5f8-38461fd63a9c","Type":"ContainerStarted","Data":"2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01"}
Jul 07 14:34:10.497482 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:10.497425    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk" podStartSLOduration=2.497408055 podStartE2EDuration="2.497408055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:10.496433119 +0000 UTC m=+2082.801120787" watchObservedRunningTime="2026-07-07 14:34:10.497408055 +0000 UTC m=+2082.802095740"
Jul 07 14:34:19.318366 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:19.318322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:19.319055 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:19.318391    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:19.331006 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:19.330977    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:34:19.525804 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:34:19.525771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:36:16.304745 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:16.304710    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"]
Jul 07 14:36:17.135738 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:17.135680    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"]
Jul 07 14:36:21.195663 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.195631    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"]
Jul 07 14:36:21.198917 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.198895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.201397 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.201381    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"sub-test-model-0b992a-kserve-self-signed-certs\""
Jul 07 14:36:21.208502 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.208478    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"]
Jul 07 14:36:21.259146 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.259112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-home\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.259332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.259154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf2aee8-81d3-40b0-9617-853932eb11a6-tls-certs\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.259332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.259226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw4tv\" (UniqueName: \"kubernetes.io/projected/3bf2aee8-81d3-40b0-9617-853932eb11a6-kube-api-access-fw4tv\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.259332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.259247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-model-cache\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.259332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.259271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-tmp-dir\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.259332 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.259321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-dshm\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.360449 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-home\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.360663 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf2aee8-81d3-40b0-9617-853932eb11a6-tls-certs\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.360663 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw4tv\" (UniqueName: \"kubernetes.io/projected/3bf2aee8-81d3-40b0-9617-853932eb11a6-kube-api-access-fw4tv\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.360663 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-model-cache\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.360663 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-tmp-dir\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.360663 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-dshm\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.360965 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360937    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-home\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.361013 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.360988    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-model-cache\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.361278 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.361255    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-tmp-dir\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.363374 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.363352    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-dshm\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.363656 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.363638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf2aee8-81d3-40b0-9617-853932eb11a6-tls-certs\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.371195 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.371172    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw4tv\" (UniqueName: \"kubernetes.io/projected/3bf2aee8-81d3-40b0-9617-853932eb11a6-kube-api-access-fw4tv\") pod \"sub-test-model-0b992a-kserve-559d466cb9-2jqtx\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") " pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.509318 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.509215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:21.646254 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:21.646228    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"]
Jul 07 14:36:21.648435 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:36:21.648408    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bf2aee8_81d3_40b0_9617_853932eb11a6.slice/crio-bdde900bc649de3979411480aba1694fa01b10f46a41fe2ffa17455c64cd0d31 WatchSource:0}: Error finding container bdde900bc649de3979411480aba1694fa01b10f46a41fe2ffa17455c64cd0d31: Status 404 returned error can't find the container with id bdde900bc649de3979411480aba1694fa01b10f46a41fe2ffa17455c64cd0d31
Jul 07 14:36:22.064637 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:22.064604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx" event={"ID":"3bf2aee8-81d3-40b0-9617-853932eb11a6","Type":"ContainerStarted","Data":"1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de"}
Jul 07 14:36:22.064854 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:22.064645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx" event={"ID":"3bf2aee8-81d3-40b0-9617-853932eb11a6","Type":"ContainerStarted","Data":"bdde900bc649de3979411480aba1694fa01b10f46a41fe2ffa17455c64cd0d31"}
Jul 07 14:36:31.324988 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.324916    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8" podUID="2ec8b224-148f-45e1-855c-775a95ce49ad" containerName="main" containerID="cri-o://4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08" gracePeriod=45
Jul 07 14:36:31.510093 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.510056    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:31.510093 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.510117    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:31.522832 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.522805    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:31.548702 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.542880    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx" podStartSLOduration=10.542857136 podStartE2EDuration="10.542857136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:22.082003611 +0000 UTC m=+2214.386691279" watchObservedRunningTime="2026-07-07 14:36:31.542857136 +0000 UTC m=+2223.847544808"
Jul 07 14:36:31.573084 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.573051    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:36:31.659342 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659306    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-model-cache\") pod \"2ec8b224-148f-45e1-855c-775a95ce49ad\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") "
Jul 07 14:36:31.659342 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659346    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-dshm\") pod \"2ec8b224-148f-45e1-855c-775a95ce49ad\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") "
Jul 07 14:36:31.659605 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w48r4\" (UniqueName: \"kubernetes.io/projected/2ec8b224-148f-45e1-855c-775a95ce49ad-kube-api-access-w48r4\") pod \"2ec8b224-148f-45e1-855c-775a95ce49ad\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") "
Jul 07 14:36:31.659605 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659410    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec8b224-148f-45e1-855c-775a95ce49ad-tls-certs\") pod \"2ec8b224-148f-45e1-855c-775a95ce49ad\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") "
Jul 07 14:36:31.659605 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659425    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-home\") pod \"2ec8b224-148f-45e1-855c-775a95ce49ad\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") "
Jul 07 14:36:31.659605 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659537    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-tmp-dir\") pod \"2ec8b224-148f-45e1-855c-775a95ce49ad\" (UID: \"2ec8b224-148f-45e1-855c-775a95ce49ad\") "
Jul 07 14:36:31.659859 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659662    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ec8b224-148f-45e1-855c-775a95ce49ad" (UID: "2ec8b224-148f-45e1-855c-775a95ce49ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:31.659859 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659822    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-home" (OuterVolumeSpecName: "home") pod "2ec8b224-148f-45e1-855c-775a95ce49ad" (UID: "2ec8b224-148f-45e1-855c-775a95ce49ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:31.659974 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659897    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ec8b224-148f-45e1-855c-775a95ce49ad" (UID: "2ec8b224-148f-45e1-855c-775a95ce49ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:31.660026 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.659999    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:31.660026 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.660017    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:31.660128 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.660033    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:31.661784 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.661751    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-dshm" (OuterVolumeSpecName: "dshm") pod "2ec8b224-148f-45e1-855c-775a95ce49ad" (UID: "2ec8b224-148f-45e1-855c-775a95ce49ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:31.661913 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.661822    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec8b224-148f-45e1-855c-775a95ce49ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ec8b224-148f-45e1-855c-775a95ce49ad" (UID: "2ec8b224-148f-45e1-855c-775a95ce49ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:36:31.661913 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.661857    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec8b224-148f-45e1-855c-775a95ce49ad-kube-api-access-w48r4" (OuterVolumeSpecName: "kube-api-access-w48r4") pod "2ec8b224-148f-45e1-855c-775a95ce49ad" (UID: "2ec8b224-148f-45e1-855c-775a95ce49ad"). InnerVolumeSpecName "kube-api-access-w48r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:36:31.761221 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.761186    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ec8b224-148f-45e1-855c-775a95ce49ad-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:31.761221 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.761218    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w48r4\" (UniqueName: \"kubernetes.io/projected/2ec8b224-148f-45e1-855c-775a95ce49ad-kube-api-access-w48r4\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:31.761221 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:31.761228    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ec8b224-148f-45e1-855c-775a95ce49ad-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:32.115443 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.115352    2577 generic.go:356] "Generic (PLEG): container finished" podID="2ec8b224-148f-45e1-855c-775a95ce49ad" containerID="4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08" exitCode=0
Jul 07 14:36:32.115443 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.115404    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"
Jul 07 14:36:32.115443 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.115433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8" event={"ID":"2ec8b224-148f-45e1-855c-775a95ce49ad","Type":"ContainerDied","Data":"4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08"}
Jul 07 14:36:32.115753 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.115470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8" event={"ID":"2ec8b224-148f-45e1-855c-775a95ce49ad","Type":"ContainerDied","Data":"8425a1aeadb405d02f1cf118d3ed29c6be53ae81a6abfc3abb613b28b979ec20"}
Jul 07 14:36:32.115753 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.115487    2577 scope.go:117] "RemoveContainer" containerID="4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08"
Jul 07 14:36:32.124787 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.124762    2577 scope.go:117] "RemoveContainer" containerID="4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08"
Jul 07 14:36:32.125100 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:36:32.125079    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08\": container with ID starting with 4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08 not found: ID does not exist" containerID="4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08"
Jul 07 14:36:32.125174 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.125117    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08"} err="failed to get container status \"4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08\": rpc error: code = NotFound desc = could not find container \"4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08\": container with ID starting with 4bfd57affffbc12e95f69e116b3ba63bd69e3e00816892faae5a447e779c8d08 not found: ID does not exist"
Jul 07 14:36:32.127846 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.127827    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:36:32.145868 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.145832    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"]
Jul 07 14:36:32.149398 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.149372    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/auth-test-model-0b992a-kserve-66596cc779-zj7d8"]
Jul 07 14:36:32.155537 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.155509    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk" podUID="d44a550f-6ad7-4917-b5f8-38461fd63a9c" containerName="main" containerID="cri-o://2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01" gracePeriod=45
Jul 07 14:36:32.267291 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.267251    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec8b224-148f-45e1-855c-775a95ce49ad" path="/var/lib/kubelet/pods/2ec8b224-148f-45e1-855c-775a95ce49ad/volumes"
Jul 07 14:36:32.411987 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.411962    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:36:32.468394 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468347    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tls-certs\") pod \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") "
Jul 07 14:36:32.468394 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468396    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-dshm\") pod \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") "
Jul 07 14:36:32.468654 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468422    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-model-cache\") pod \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") "
Jul 07 14:36:32.468654 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tmp-dir\") pod \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") "
Jul 07 14:36:32.468654 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468570    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-home\") pod \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") "
Jul 07 14:36:32.468654 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468625    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpcsg\" (UniqueName: \"kubernetes.io/projected/d44a550f-6ad7-4917-b5f8-38461fd63a9c-kube-api-access-wpcsg\") pod \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\" (UID: \"d44a550f-6ad7-4917-b5f8-38461fd63a9c\") "
Jul 07 14:36:32.468891 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468754    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d44a550f-6ad7-4917-b5f8-38461fd63a9c" (UID: "d44a550f-6ad7-4917-b5f8-38461fd63a9c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:32.468891 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468770    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d44a550f-6ad7-4917-b5f8-38461fd63a9c" (UID: "d44a550f-6ad7-4917-b5f8-38461fd63a9c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:32.468891 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.468868    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-home" (OuterVolumeSpecName: "home") pod "d44a550f-6ad7-4917-b5f8-38461fd63a9c" (UID: "d44a550f-6ad7-4917-b5f8-38461fd63a9c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:32.469036 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.469019    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:32.469073 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.469043    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:32.469073 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.469055    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:32.470891 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.470867    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d44a550f-6ad7-4917-b5f8-38461fd63a9c-kube-api-access-wpcsg" (OuterVolumeSpecName: "kube-api-access-wpcsg") pod "d44a550f-6ad7-4917-b5f8-38461fd63a9c" (UID: "d44a550f-6ad7-4917-b5f8-38461fd63a9c"). InnerVolumeSpecName "kube-api-access-wpcsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:36:32.470891 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.470877    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-dshm" (OuterVolumeSpecName: "dshm") pod "d44a550f-6ad7-4917-b5f8-38461fd63a9c" (UID: "d44a550f-6ad7-4917-b5f8-38461fd63a9c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:32.471009 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.470880    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d44a550f-6ad7-4917-b5f8-38461fd63a9c" (UID: "d44a550f-6ad7-4917-b5f8-38461fd63a9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:36:32.569900 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.569858    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d44a550f-6ad7-4917-b5f8-38461fd63a9c-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:32.569900 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.569896    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d44a550f-6ad7-4917-b5f8-38461fd63a9c-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:32.569900 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:32.569907    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpcsg\" (UniqueName: \"kubernetes.io/projected/d44a550f-6ad7-4917-b5f8-38461fd63a9c-kube-api-access-wpcsg\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:36:33.122297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.122258    2577 generic.go:356] "Generic (PLEG): container finished" podID="d44a550f-6ad7-4917-b5f8-38461fd63a9c" containerID="2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01" exitCode=0
Jul 07 14:36:33.122297 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.122302    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"
Jul 07 14:36:33.122535 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.122339    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk" event={"ID":"d44a550f-6ad7-4917-b5f8-38461fd63a9c","Type":"ContainerDied","Data":"2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01"}
Jul 07 14:36:33.122535 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.122379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk" event={"ID":"d44a550f-6ad7-4917-b5f8-38461fd63a9c","Type":"ContainerDied","Data":"5ffaea99ca6ac8ced9f0f831e7be47bae2db8cca38ec38f0296e9377e29f0d93"}
Jul 07 14:36:33.122535 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.122397    2577 scope.go:117] "RemoveContainer" containerID="2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01"
Jul 07 14:36:33.131196 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.131176    2577 scope.go:117] "RemoveContainer" containerID="2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01"
Jul 07 14:36:33.131457 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:36:33.131439    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01\": container with ID starting with 2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01 not found: ID does not exist" containerID="2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01"
Jul 07 14:36:33.131503 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.131465    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01"} err="failed to get container status \"2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01\": rpc error: code = NotFound desc = could not find container \"2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01\": container with ID starting with 2f9295b1baf27cdcd6b6df39e59c2a9ec8407f9435987d0156efc68de32b0e01 not found: ID does not exist"
Jul 07 14:36:33.143517 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.143487    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"]
Jul 07 14:36:33.148302 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:33.148280    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/auth-test-model-bb9591-kserve-57cfcb7fc9-5sxvk"]
Jul 07 14:36:34.264972 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:34.264941    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d44a550f-6ad7-4917-b5f8-38461fd63a9c" path="/var/lib/kubelet/pods/d44a550f-6ad7-4917-b5f8-38461fd63a9c/volumes"
Jul 07 14:36:56.501720 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.501617    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"]
Jul 07 14:36:56.502288 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.502255    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec8b224-148f-45e1-855c-775a95ce49ad" containerName="main"
Jul 07 14:36:56.502288 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.502278    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec8b224-148f-45e1-855c-775a95ce49ad" containerName="main"
Jul 07 14:36:56.502408 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.502294    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44a550f-6ad7-4917-b5f8-38461fd63a9c" containerName="main"
Jul 07 14:36:56.502408 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.502303    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44a550f-6ad7-4917-b5f8-38461fd63a9c" containerName="main"
Jul 07 14:36:56.502408 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.502383    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d44a550f-6ad7-4917-b5f8-38461fd63a9c" containerName="main"
Jul 07 14:36:56.502408 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.502398    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec8b224-148f-45e1-855c-775a95ce49ad" containerName="main"
Jul 07 14:36:56.507105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.507083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.510429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.510403    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"kube-root-ca.crt\""
Jul 07 14:36:56.510429 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.510417    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"openshift-service-ca.crt\""
Jul 07 14:36:56.510635 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.510447    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"default-dockercfg-g2nq9\""
Jul 07 14:36:56.510635 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.510451    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"sub-test-model-bb9591-kserve-self-signed-certs\""
Jul 07 14:36:56.516763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.516734    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"]
Jul 07 14:36:56.585027 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.584988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2w7j\" (UniqueName: \"kubernetes.io/projected/2821095d-9df5-41aa-97ad-1ee317937083-kube-api-access-h2w7j\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.585027 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.585032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-tmp-dir\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.585235 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.585128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-dshm\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.585235 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.585166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2821095d-9df5-41aa-97ad-1ee317937083-tls-certs\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.585235 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.585184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-model-cache\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.585235 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.585234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-home\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.685867 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.685828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2821095d-9df5-41aa-97ad-1ee317937083-tls-certs\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.685867 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.685867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-model-cache\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.686079 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.685901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-home\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.686079 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.685929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2w7j\" (UniqueName: \"kubernetes.io/projected/2821095d-9df5-41aa-97ad-1ee317937083-kube-api-access-h2w7j\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.686079 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.685954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-tmp-dir\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.686079 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.686020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-dshm\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.686397 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.686372    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-home\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.686457 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.686422    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-model-cache\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.686457 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.686447    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-tmp-dir\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.688251 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.688234    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-dshm\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.688506 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.688490    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2821095d-9df5-41aa-97ad-1ee317937083-tls-certs\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.695519 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.695490    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2w7j\" (UniqueName: \"kubernetes.io/projected/2821095d-9df5-41aa-97ad-1ee317937083-kube-api-access-h2w7j\") pod \"sub-test-model-bb9591-kserve-8599c894bc-bk455\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") " pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.818043 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.817943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:36:56.955988 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:56.955961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"]
Jul 07 14:36:56.958193 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:36:56.958160    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2821095d_9df5_41aa_97ad_1ee317937083.slice/crio-8646b90e259ae37ffb6d32a3761eb745651511572c5edf5a74b4ae57d38c4ba9 WatchSource:0}: Error finding container 8646b90e259ae37ffb6d32a3761eb745651511572c5edf5a74b4ae57d38c4ba9: Status 404 returned error can't find the container with id 8646b90e259ae37ffb6d32a3761eb745651511572c5edf5a74b4ae57d38c4ba9
Jul 07 14:36:57.236754 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:57.236711    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455" event={"ID":"2821095d-9df5-41aa-97ad-1ee317937083","Type":"ContainerStarted","Data":"81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba"}
Jul 07 14:36:57.236947 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:57.236761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455" event={"ID":"2821095d-9df5-41aa-97ad-1ee317937083","Type":"ContainerStarted","Data":"8646b90e259ae37ffb6d32a3761eb745651511572c5edf5a74b4ae57d38c4ba9"}
Jul 07 14:36:57.257507 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:36:57.257447    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455" podStartSLOduration=1.257430719 podStartE2EDuration="1.257430719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:57.255133782 +0000 UTC m=+2249.559821449" watchObservedRunningTime="2026-07-07 14:36:57.257430719 +0000 UTC m=+2249.562118384"
Jul 07 14:37:06.819138 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:06.819097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:37:06.819571 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:06.819213    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:37:06.831753 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:06.831725    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:37:07.295392 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:07.295362    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:37:40.632996 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:40.632957    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"]
Jul 07 14:37:41.606061 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:41.606025    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"]
Jul 07 14:37:55.653452 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:55.653409    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx" podUID="3bf2aee8-81d3-40b0-9617-853932eb11a6" containerName="main" containerID="cri-o://1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de" gracePeriod=45
Jul 07 14:37:55.906747 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:55.906670    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:37:56.023143 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023102    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw4tv\" (UniqueName: \"kubernetes.io/projected/3bf2aee8-81d3-40b0-9617-853932eb11a6-kube-api-access-fw4tv\") pod \"3bf2aee8-81d3-40b0-9617-853932eb11a6\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") "
Jul 07 14:37:56.023405 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023164    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-tmp-dir\") pod \"3bf2aee8-81d3-40b0-9617-853932eb11a6\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") "
Jul 07 14:37:56.023405 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023198    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-dshm\") pod \"3bf2aee8-81d3-40b0-9617-853932eb11a6\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") "
Jul 07 14:37:56.023405 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023242    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-model-cache\") pod \"3bf2aee8-81d3-40b0-9617-853932eb11a6\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") "
Jul 07 14:37:56.023405 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023278    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf2aee8-81d3-40b0-9617-853932eb11a6-tls-certs\") pod \"3bf2aee8-81d3-40b0-9617-853932eb11a6\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") "
Jul 07 14:37:56.023405 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023315    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-home\") pod \"3bf2aee8-81d3-40b0-9617-853932eb11a6\" (UID: \"3bf2aee8-81d3-40b0-9617-853932eb11a6\") "
Jul 07 14:37:56.023658 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023510    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-model-cache" (OuterVolumeSpecName: "model-cache") pod "3bf2aee8-81d3-40b0-9617-853932eb11a6" (UID: "3bf2aee8-81d3-40b0-9617-853932eb11a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.023658 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023525    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3bf2aee8-81d3-40b0-9617-853932eb11a6" (UID: "3bf2aee8-81d3-40b0-9617-853932eb11a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.023802 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.023766    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-home" (OuterVolumeSpecName: "home") pod "3bf2aee8-81d3-40b0-9617-853932eb11a6" (UID: "3bf2aee8-81d3-40b0-9617-853932eb11a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.025365 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.025337    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bf2aee8-81d3-40b0-9617-853932eb11a6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3bf2aee8-81d3-40b0-9617-853932eb11a6" (UID: "3bf2aee8-81d3-40b0-9617-853932eb11a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:37:56.025365 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.025353    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf2aee8-81d3-40b0-9617-853932eb11a6-kube-api-access-fw4tv" (OuterVolumeSpecName: "kube-api-access-fw4tv") pod "3bf2aee8-81d3-40b0-9617-853932eb11a6" (UID: "3bf2aee8-81d3-40b0-9617-853932eb11a6"). InnerVolumeSpecName "kube-api-access-fw4tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:37:56.025365 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.025356    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-dshm" (OuterVolumeSpecName: "dshm") pod "3bf2aee8-81d3-40b0-9617-853932eb11a6" (UID: "3bf2aee8-81d3-40b0-9617-853932eb11a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.124376 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.124337    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw4tv\" (UniqueName: \"kubernetes.io/projected/3bf2aee8-81d3-40b0-9617-853932eb11a6-kube-api-access-fw4tv\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:56.124376 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.124372    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:56.124376 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.124386    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:56.124727 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.124398    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:56.124727 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.124409    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf2aee8-81d3-40b0-9617-853932eb11a6-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:56.124727 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.124422    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf2aee8-81d3-40b0-9617-853932eb11a6-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:56.514669 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.514634    2577 generic.go:356] "Generic (PLEG): container finished" podID="3bf2aee8-81d3-40b0-9617-853932eb11a6" containerID="1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de" exitCode=0
Jul 07 14:37:56.514669 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.514675    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"
Jul 07 14:37:56.514902 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.514708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx" event={"ID":"3bf2aee8-81d3-40b0-9617-853932eb11a6","Type":"ContainerDied","Data":"1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de"}
Jul 07 14:37:56.514902 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.514741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx" event={"ID":"3bf2aee8-81d3-40b0-9617-853932eb11a6","Type":"ContainerDied","Data":"bdde900bc649de3979411480aba1694fa01b10f46a41fe2ffa17455c64cd0d31"}
Jul 07 14:37:56.514902 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.514757    2577 scope.go:117] "RemoveContainer" containerID="1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de"
Jul 07 14:37:56.523866 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.523844    2577 scope.go:117] "RemoveContainer" containerID="1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de"
Jul 07 14:37:56.524189 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:37:56.524169    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de\": container with ID starting with 1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de not found: ID does not exist" containerID="1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de"
Jul 07 14:37:56.524236 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.524199    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de"} err="failed to get container status \"1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de\": rpc error: code = NotFound desc = could not find container \"1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de\": container with ID starting with 1ad72fbcb1ba184f2b111641ed6c280d75bb4b793d03768857204f2868d9f0de not found: ID does not exist"
Jul 07 14:37:56.534314 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.534287    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"]
Jul 07 14:37:56.539491 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.539462    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/sub-test-model-0b992a-kserve-559d466cb9-2jqtx"]
Jul 07 14:37:56.626086 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.626041    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455" podUID="2821095d-9df5-41aa-97ad-1ee317937083" containerName="main" containerID="cri-o://81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba" gracePeriod=45
Jul 07 14:37:56.879390 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.879361    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:37:56.933338 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933302    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2821095d-9df5-41aa-97ad-1ee317937083-tls-certs\") pod \"2821095d-9df5-41aa-97ad-1ee317937083\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") "
Jul 07 14:37:56.933512 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-tmp-dir\") pod \"2821095d-9df5-41aa-97ad-1ee317937083\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") "
Jul 07 14:37:56.933512 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933413    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-model-cache\") pod \"2821095d-9df5-41aa-97ad-1ee317937083\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") "
Jul 07 14:37:56.933512 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933435    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-dshm\") pod \"2821095d-9df5-41aa-97ad-1ee317937083\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") "
Jul 07 14:37:56.933512 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933455    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-home\") pod \"2821095d-9df5-41aa-97ad-1ee317937083\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") "
Jul 07 14:37:56.933512 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933490    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2w7j\" (UniqueName: \"kubernetes.io/projected/2821095d-9df5-41aa-97ad-1ee317937083-kube-api-access-h2w7j\") pod \"2821095d-9df5-41aa-97ad-1ee317937083\" (UID: \"2821095d-9df5-41aa-97ad-1ee317937083\") "
Jul 07 14:37:56.933811 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933653    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2821095d-9df5-41aa-97ad-1ee317937083" (UID: "2821095d-9df5-41aa-97ad-1ee317937083"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.933907 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933881    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-model-cache" (OuterVolumeSpecName: "model-cache") pod "2821095d-9df5-41aa-97ad-1ee317937083" (UID: "2821095d-9df5-41aa-97ad-1ee317937083"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.933907 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.933893    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-home" (OuterVolumeSpecName: "home") pod "2821095d-9df5-41aa-97ad-1ee317937083" (UID: "2821095d-9df5-41aa-97ad-1ee317937083"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.935618 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.935586    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2821095d-9df5-41aa-97ad-1ee317937083-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2821095d-9df5-41aa-97ad-1ee317937083" (UID: "2821095d-9df5-41aa-97ad-1ee317937083"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:37:56.935618 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.935589    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-dshm" (OuterVolumeSpecName: "dshm") pod "2821095d-9df5-41aa-97ad-1ee317937083" (UID: "2821095d-9df5-41aa-97ad-1ee317937083"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:37:56.935801 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:56.935634    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2821095d-9df5-41aa-97ad-1ee317937083-kube-api-access-h2w7j" (OuterVolumeSpecName: "kube-api-access-h2w7j") pod "2821095d-9df5-41aa-97ad-1ee317937083" (UID: "2821095d-9df5-41aa-97ad-1ee317937083"). InnerVolumeSpecName "kube-api-access-h2w7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:37:57.035059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.035017    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:57.035059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.035047    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:57.035059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.035055    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:57.035059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.035064    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2w7j\" (UniqueName: \"kubernetes.io/projected/2821095d-9df5-41aa-97ad-1ee317937083-kube-api-access-h2w7j\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:57.035059 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.035072    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2821095d-9df5-41aa-97ad-1ee317937083-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:57.035351 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.035081    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2821095d-9df5-41aa-97ad-1ee317937083-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:37:57.521420 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.521381    2577 generic.go:356] "Generic (PLEG): container finished" podID="2821095d-9df5-41aa-97ad-1ee317937083" containerID="81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba" exitCode=0
Jul 07 14:37:57.521420 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.521420    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455" event={"ID":"2821095d-9df5-41aa-97ad-1ee317937083","Type":"ContainerDied","Data":"81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba"}
Jul 07 14:37:57.521420 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.521427    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"
Jul 07 14:37:57.521737 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.521451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455" event={"ID":"2821095d-9df5-41aa-97ad-1ee317937083","Type":"ContainerDied","Data":"8646b90e259ae37ffb6d32a3761eb745651511572c5edf5a74b4ae57d38c4ba9"}
Jul 07 14:37:57.521737 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.521474    2577 scope.go:117] "RemoveContainer" containerID="81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba"
Jul 07 14:37:57.530366 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.530346    2577 scope.go:117] "RemoveContainer" containerID="81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba"
Jul 07 14:37:57.530629 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:37:57.530607    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba\": container with ID starting with 81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba not found: ID does not exist" containerID="81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba"
Jul 07 14:37:57.530705 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.530636    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba"} err="failed to get container status \"81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba\": rpc error: code = NotFound desc = could not find container \"81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba\": container with ID starting with 81664b4d39417a0e4b9c7f3abb01577ebbdd695cbb02df41c0cb48de05e750ba not found: ID does not exist"
Jul 07 14:37:57.544860 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.544825    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"]
Jul 07 14:37:57.549432 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:57.549406    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/sub-test-model-bb9591-kserve-8599c894bc-bk455"]
Jul 07 14:37:58.266353 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.266320    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2821095d-9df5-41aa-97ad-1ee317937083" path="/var/lib/kubelet/pods/2821095d-9df5-41aa-97ad-1ee317937083/volumes"
Jul 07 14:37:58.266767 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.266748    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf2aee8-81d3-40b0-9617-853932eb11a6" path="/var/lib/kubelet/pods/3bf2aee8-81d3-40b0-9617-853932eb11a6/volumes"
Jul 07 14:37:58.916384 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.916342    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"]
Jul 07 14:37:58.916744 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.916730    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf2aee8-81d3-40b0-9617-853932eb11a6" containerName="main"
Jul 07 14:37:58.916744 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.916745    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf2aee8-81d3-40b0-9617-853932eb11a6" containerName="main"
Jul 07 14:37:58.916860 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.916753    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2821095d-9df5-41aa-97ad-1ee317937083" containerName="main"
Jul 07 14:37:58.916860 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.916759    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2821095d-9df5-41aa-97ad-1ee317937083" containerName="main"
Jul 07 14:37:58.916860 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.916812    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf2aee8-81d3-40b0-9617-853932eb11a6" containerName="main"
Jul 07 14:37:58.916860 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.916821    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2821095d-9df5-41aa-97ad-1ee317937083" containerName="main"
Jul 07 14:37:58.921283 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.921259    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:58.925113 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.925086    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"rate-test-model-0b992a-kserve-self-signed-certs\""
Jul 07 14:37:58.925324 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.925220    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"openshift-service-ca.crt\""
Jul 07 14:37:58.925324 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.925220    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"default-dockercfg-wzrc2\""
Jul 07 14:37:58.925324 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.925252    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b992a\"/\"kube-root-ca.crt\""
Jul 07 14:37:58.931683 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:58.931659    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"]
Jul 07 14:37:59.052918 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.052876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780d1ee9-c913-41f6-99a2-aef394a743c3-tls-certs\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.053121 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.052962    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-model-cache\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.053121 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.052997    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-tmp-dir\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.053121 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.053019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-dshm\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.053267 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.053123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-home\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.053267 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.053171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcg6t\" (UniqueName: \"kubernetes.io/projected/780d1ee9-c913-41f6-99a2-aef394a743c3-kube-api-access-vcg6t\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154029 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.153985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-home\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154202 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcg6t\" (UniqueName: \"kubernetes.io/projected/780d1ee9-c913-41f6-99a2-aef394a743c3-kube-api-access-vcg6t\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154202 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780d1ee9-c913-41f6-99a2-aef394a743c3-tls-certs\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154202 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-model-cache\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154202 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-tmp-dir\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154202 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-dshm\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154468 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154302    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-home\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154535 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154484    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-model-cache\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.154593 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.154548    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-tmp-dir\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.156492 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.156458    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-dshm\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.156731 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.156710    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780d1ee9-c913-41f6-99a2-aef394a743c3-tls-certs\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.163470 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.163447    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcg6t\" (UniqueName: \"kubernetes.io/projected/780d1ee9-c913-41f6-99a2-aef394a743c3-kube-api-access-vcg6t\") pod \"rate-test-model-0b992a-kserve-d99bfdf95-8snxc\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") " pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.231082 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.230970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:37:59.370466 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.370430    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"]
Jul 07 14:37:59.374106 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:37:59.374070    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod780d1ee9_c913_41f6_99a2_aef394a743c3.slice/crio-5133787336a216f1e640dbee711e648d0b9fa925df26863c849c48e433114dcc WatchSource:0}: Error finding container 5133787336a216f1e640dbee711e648d0b9fa925df26863c849c48e433114dcc: Status 404 returned error can't find the container with id 5133787336a216f1e640dbee711e648d0b9fa925df26863c849c48e433114dcc
Jul 07 14:37:59.536175 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.536089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc" event={"ID":"780d1ee9-c913-41f6-99a2-aef394a743c3","Type":"ContainerStarted","Data":"85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa"}
Jul 07 14:37:59.536175 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.536133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc" event={"ID":"780d1ee9-c913-41f6-99a2-aef394a743c3","Type":"ContainerStarted","Data":"5133787336a216f1e640dbee711e648d0b9fa925df26863c849c48e433114dcc"}
Jul 07 14:37:59.560186 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:37:59.560133    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc" podStartSLOduration=1.5601151629999999 podStartE2EDuration="1.560115163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:59.557470772 +0000 UTC m=+2311.862158439" watchObservedRunningTime="2026-07-07 14:37:59.560115163 +0000 UTC m=+2311.864802867"
Jul 07 14:38:09.231747 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:09.231683    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:38:09.231747 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:09.231760    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:38:09.244299 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:09.244270    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:38:09.591542 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:09.591459    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:38:49.418736 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.418674    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"]
Jul 07 14:38:49.422364 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.422341    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.427494 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.427468    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"default-dockercfg-g2nq9\""
Jul 07 14:38:49.428507 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.428472    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"rate-test-model-bb9591-kserve-self-signed-certs\""
Jul 07 14:38:49.428631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.428527    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"openshift-service-ca.crt\""
Jul 07 14:38:49.428631 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.428545    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bb9591\"/\"kube-root-ca.crt\""
Jul 07 14:38:49.445861 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.445829    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"]
Jul 07 14:38:49.520091 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.520044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-home\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.520280 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.520110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tls-certs\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.520280 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.520145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q8d4\" (UniqueName: \"kubernetes.io/projected/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-kube-api-access-4q8d4\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.520280 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.520179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-model-cache\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.520280 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.520207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tmp-dir\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.520280 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.520247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-dshm\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.621623 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.621576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-home\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.621623 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.621629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tls-certs\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.621914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.621656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q8d4\" (UniqueName: \"kubernetes.io/projected/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-kube-api-access-4q8d4\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.621914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.621682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-model-cache\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.621914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.621730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tmp-dir\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.621914 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.621759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-dshm\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.622128 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.622044    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-home\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.622128 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.622085    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-model-cache\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.622225 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.622154    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tmp-dir\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.624161 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.624135    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-dshm\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.624359 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.624339    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tls-certs\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.634958 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.634927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q8d4\" (UniqueName: \"kubernetes.io/projected/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-kube-api-access-4q8d4\") pod \"rate-test-model-bb9591-kserve-5475df8759-7n2g4\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") " pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.732039 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.731938    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:49.872009 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:49.871983    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"]
Jul 07 14:38:49.874104 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:38:49.874063    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd48ca7ed_6e25_44ee_af7d_e64e5c2447b7.slice/crio-0805a75eca6330ddc5e557f4708b089a5b498e7717e31182fc0edc426c5bf049 WatchSource:0}: Error finding container 0805a75eca6330ddc5e557f4708b089a5b498e7717e31182fc0edc426c5bf049: Status 404 returned error can't find the container with id 0805a75eca6330ddc5e557f4708b089a5b498e7717e31182fc0edc426c5bf049
Jul 07 14:38:50.765430 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:50.765399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4" event={"ID":"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7","Type":"ContainerStarted","Data":"9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196"}
Jul 07 14:38:50.765843 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:50.765439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4" event={"ID":"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7","Type":"ContainerStarted","Data":"0805a75eca6330ddc5e557f4708b089a5b498e7717e31182fc0edc426c5bf049"}
Jul 07 14:38:50.788566 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:50.788505    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4" podStartSLOduration=1.788486851 podStartE2EDuration="1.788486851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:50.78600669 +0000 UTC m=+2363.090694364" watchObservedRunningTime="2026-07-07 14:38:50.788486851 +0000 UTC m=+2363.093174540"
Jul 07 14:38:59.732764 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:59.732718    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:59.733181 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:59.732787    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:59.745638 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:59.745609    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:38:59.814965 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:38:59.814933    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:39:32.310030 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:32.309989    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"]
Jul 07 14:39:33.282073 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:33.282036    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"]
Jul 07 14:39:47.330397 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.330337    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc" podUID="780d1ee9-c913-41f6-99a2-aef394a743c3" containerName="main" containerID="cri-o://85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa" gracePeriod=45
Jul 07 14:39:47.589758 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.589676    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:39:47.762696 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.762661    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-home\") pod \"780d1ee9-c913-41f6-99a2-aef394a743c3\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") "
Jul 07 14:39:47.762907 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.762740    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-model-cache\") pod \"780d1ee9-c913-41f6-99a2-aef394a743c3\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") "
Jul 07 14:39:47.762907 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.762765    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcg6t\" (UniqueName: \"kubernetes.io/projected/780d1ee9-c913-41f6-99a2-aef394a743c3-kube-api-access-vcg6t\") pod \"780d1ee9-c913-41f6-99a2-aef394a743c3\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") "
Jul 07 14:39:47.762907 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.762876    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780d1ee9-c913-41f6-99a2-aef394a743c3-tls-certs\") pod \"780d1ee9-c913-41f6-99a2-aef394a743c3\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") "
Jul 07 14:39:47.763096 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.762915    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-tmp-dir\") pod \"780d1ee9-c913-41f6-99a2-aef394a743c3\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") "
Jul 07 14:39:47.763096 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.762963    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-home" (OuterVolumeSpecName: "home") pod "780d1ee9-c913-41f6-99a2-aef394a743c3" (UID: "780d1ee9-c913-41f6-99a2-aef394a743c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:47.763096 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.763051    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-dshm\") pod \"780d1ee9-c913-41f6-99a2-aef394a743c3\" (UID: \"780d1ee9-c913-41f6-99a2-aef394a743c3\") "
Jul 07 14:39:47.763266 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.763048    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "780d1ee9-c913-41f6-99a2-aef394a743c3" (UID: "780d1ee9-c913-41f6-99a2-aef394a743c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:47.763266 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.763125    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "780d1ee9-c913-41f6-99a2-aef394a743c3" (UID: "780d1ee9-c913-41f6-99a2-aef394a743c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:47.763393 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.763370    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:47.763466 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.763397    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:47.763466 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.763409    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:47.765126 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.765103    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780d1ee9-c913-41f6-99a2-aef394a743c3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "780d1ee9-c913-41f6-99a2-aef394a743c3" (UID: "780d1ee9-c913-41f6-99a2-aef394a743c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:39:47.765412 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.765390    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-dshm" (OuterVolumeSpecName: "dshm") pod "780d1ee9-c913-41f6-99a2-aef394a743c3" (UID: "780d1ee9-c913-41f6-99a2-aef394a743c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:47.765477 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.765426    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780d1ee9-c913-41f6-99a2-aef394a743c3-kube-api-access-vcg6t" (OuterVolumeSpecName: "kube-api-access-vcg6t") pod "780d1ee9-c913-41f6-99a2-aef394a743c3" (UID: "780d1ee9-c913-41f6-99a2-aef394a743c3"). InnerVolumeSpecName "kube-api-access-vcg6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:39:47.864211 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.864103    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/780d1ee9-c913-41f6-99a2-aef394a743c3-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:47.864211 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.864152    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/780d1ee9-c913-41f6-99a2-aef394a743c3-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:47.864211 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:47.864163    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcg6t\" (UniqueName: \"kubernetes.io/projected/780d1ee9-c913-41f6-99a2-aef394a743c3-kube-api-access-vcg6t\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:48.024020 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.023981    2577 generic.go:356] "Generic (PLEG): container finished" podID="780d1ee9-c913-41f6-99a2-aef394a743c3" containerID="85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa" exitCode=0
Jul 07 14:39:48.024020 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.024022    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"
Jul 07 14:39:48.024247 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.024064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc" event={"ID":"780d1ee9-c913-41f6-99a2-aef394a743c3","Type":"ContainerDied","Data":"85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa"}
Jul 07 14:39:48.024247 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.024108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc" event={"ID":"780d1ee9-c913-41f6-99a2-aef394a743c3","Type":"ContainerDied","Data":"5133787336a216f1e640dbee711e648d0b9fa925df26863c849c48e433114dcc"}
Jul 07 14:39:48.024247 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.024126    2577 scope.go:117] "RemoveContainer" containerID="85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa"
Jul 07 14:39:48.033276 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.033257    2577 scope.go:117] "RemoveContainer" containerID="85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa"
Jul 07 14:39:48.033575 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:39:48.033555    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa\": container with ID starting with 85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa not found: ID does not exist" containerID="85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa"
Jul 07 14:39:48.033648 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.033585    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa"} err="failed to get container status \"85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa\": rpc error: code = NotFound desc = could not find container \"85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa\": container with ID starting with 85b6f90aeb6c937ff6dbdc23c0fb846e6be0bbe0afbbd37d7121ca95329f74aa not found: ID does not exist"
Jul 07 14:39:48.046316 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.046287    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"]
Jul 07 14:39:48.051958 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.051935    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0b992a/rate-test-model-0b992a-kserve-d99bfdf95-8snxc"]
Jul 07 14:39:48.265169 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.265135    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780d1ee9-c913-41f6-99a2-aef394a743c3" path="/var/lib/kubelet/pods/780d1ee9-c913-41f6-99a2-aef394a743c3/volumes"
Jul 07 14:39:48.302040 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.302001    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4" podUID="d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" containerName="main" containerID="cri-o://9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196" gracePeriod=45
Jul 07 14:39:48.566124 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.566091    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:39:48.670749 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.670679    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-home\") pod \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") "
Jul 07 14:39:48.670960 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.670778    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tls-certs\") pod \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") "
Jul 07 14:39:48.670960 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.670810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tmp-dir\") pod \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") "
Jul 07 14:39:48.670960 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.670845    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q8d4\" (UniqueName: \"kubernetes.io/projected/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-kube-api-access-4q8d4\") pod \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") "
Jul 07 14:39:48.670960 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.670879    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-dshm\") pod \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") "
Jul 07 14:39:48.670960 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.670899    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-model-cache\") pod \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\" (UID: \"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7\") "
Jul 07 14:39:48.671201 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.671067    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-home" (OuterVolumeSpecName: "home") pod "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" (UID: "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:48.671201 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.671108    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" (UID: "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:48.671283 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.671231    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-home\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:48.671283 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.671242    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" (UID: "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:48.671283 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.671252    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tmp-dir\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:48.673087 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.673063    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-dshm" (OuterVolumeSpecName: "dshm") pod "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" (UID: "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:39:48.673196 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.673139    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" (UID: "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:39:48.673196 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.673152    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-kube-api-access-4q8d4" (OuterVolumeSpecName: "kube-api-access-4q8d4") pod "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" (UID: "d48ca7ed-6e25-44ee-af7d-e64e5c2447b7"). InnerVolumeSpecName "kube-api-access-4q8d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:39:48.772391 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.772201    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-tls-certs\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:48.772391 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.772246    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q8d4\" (UniqueName: \"kubernetes.io/projected/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-kube-api-access-4q8d4\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:48.772391 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.772263    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-dshm\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:48.772391 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:48.772292    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7-model-cache\") on node \"ip-10-0-128-208.ec2.internal\" DevicePath \"\""
Jul 07 14:39:49.031271 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.031236    2577 generic.go:356] "Generic (PLEG): container finished" podID="d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" containerID="9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196" exitCode=0
Jul 07 14:39:49.031452 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.031298    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4" event={"ID":"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7","Type":"ContainerDied","Data":"9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196"}
Jul 07 14:39:49.031452 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.031330    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4" event={"ID":"d48ca7ed-6e25-44ee-af7d-e64e5c2447b7","Type":"ContainerDied","Data":"0805a75eca6330ddc5e557f4708b089a5b498e7717e31182fc0edc426c5bf049"}
Jul 07 14:39:49.031452 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.031299    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"
Jul 07 14:39:49.031452 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.031356    2577 scope.go:117] "RemoveContainer" containerID="9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196"
Jul 07 14:39:49.040462 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.040440    2577 scope.go:117] "RemoveContainer" containerID="9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196"
Jul 07 14:39:49.040787 ip-10-0-128-208 kubenswrapper[2577]: E0707 14:39:49.040764    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196\": container with ID starting with 9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196 not found: ID does not exist" containerID="9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196"
Jul 07 14:39:49.040882 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.040795    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196"} err="failed to get container status \"9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196\": rpc error: code = NotFound desc = could not find container \"9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196\": container with ID starting with 9a902a9a40c5c8810dc31930e378ff96c6fe02c272630a5b0b32ba5fa3459196 not found: ID does not exist"
Jul 07 14:39:49.053934 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.053892    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"]
Jul 07 14:39:49.057590 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:49.057561    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bb9591/rate-test-model-bb9591-kserve-5475df8759-7n2g4"]
Jul 07 14:39:50.264874 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:39:50.264799    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" path="/var/lib/kubelet/pods/d48ca7ed-6e25-44ee-af7d-e64e5c2447b7/volumes"
Jul 07 14:40:26.658983 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:26.658917    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b9gkc_78948922-c3c2-4174-a7c6-f981e70dc209/manager/0.log"
Jul 07 14:40:27.692546 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:27.692517    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-dnjpr_14f5b861-4b78-418e-8c25-a4734c1581ab/copy-manifests/0.log"
Jul 07 14:40:27.701743 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:27.701715    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-dnjpr_14f5b861-4b78-418e-8c25-a4734c1581ab/manager/0.log"
Jul 07 14:40:29.864682 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:29.864653    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7fr2p_e5dc75c6-6618-49d2-8b55-0ad0288b2a5c/kuadrant-console-plugin/0.log"
Jul 07 14:40:30.426057 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:30.426014    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5vrxz_67fec775-60e3-4f8e-966e-fa370187008b/manager/0.log"
Jul 07 14:40:31.052572 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:31.052537    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-65ds2_e7395196-c624-4f5d-8f1c-4a81128ba97e/kube-auth-proxy/0.log"
Jul 07 14:40:32.206202 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:32.206172    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qb9pl_4f98009c-3bcf-4735-a147-fd46e7ebfdba/main/0.log"
Jul 07 14:40:32.348729 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:32.348677    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rdslh_ea6f6928-0539-47d2-8042-86ec0bd52052/main/0.log"
Jul 07 14:40:32.727363 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:32.727333    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-82qfj_81f26a6e-37bc-4900-a27a-d5d8dc4422db/main/0.log"
Jul 07 14:40:37.130719 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.130670    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6d5pc/must-gather-qsbht"]
Jul 07 14:40:37.131107 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.131043    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" containerName="main"
Jul 07 14:40:37.131107 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.131056    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" containerName="main"
Jul 07 14:40:37.131107 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.131074    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780d1ee9-c913-41f6-99a2-aef394a743c3" containerName="main"
Jul 07 14:40:37.131107 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.131079    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="780d1ee9-c913-41f6-99a2-aef394a743c3" containerName="main"
Jul 07 14:40:37.131238 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.131141    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="780d1ee9-c913-41f6-99a2-aef394a743c3" containerName="main"
Jul 07 14:40:37.131238 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.131151    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d48ca7ed-6e25-44ee-af7d-e64e5c2447b7" containerName="main"
Jul 07 14:40:37.133105 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.133088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.135992 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.135970    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6d5pc\"/\"default-dockercfg-ftvtb\""
Jul 07 14:40:37.136256 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.136240    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6d5pc\"/\"openshift-service-ca.crt\""
Jul 07 14:40:37.138380 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.138362    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6d5pc\"/\"kube-root-ca.crt\""
Jul 07 14:40:37.147364 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.147339    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/must-gather-qsbht"]
Jul 07 14:40:37.307075 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.307035    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/63a73969-c50b-40d6-8f9e-4b1804908aa1-must-gather-output\") pod \"must-gather-qsbht\" (UID: \"63a73969-c50b-40d6-8f9e-4b1804908aa1\") " pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.307075 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.307079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8sws\" (UniqueName: \"kubernetes.io/projected/63a73969-c50b-40d6-8f9e-4b1804908aa1-kube-api-access-j8sws\") pod \"must-gather-qsbht\" (UID: \"63a73969-c50b-40d6-8f9e-4b1804908aa1\") " pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.408301 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.408265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/63a73969-c50b-40d6-8f9e-4b1804908aa1-must-gather-output\") pod \"must-gather-qsbht\" (UID: \"63a73969-c50b-40d6-8f9e-4b1804908aa1\") " pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.408469 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.408310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8sws\" (UniqueName: \"kubernetes.io/projected/63a73969-c50b-40d6-8f9e-4b1804908aa1-kube-api-access-j8sws\") pod \"must-gather-qsbht\" (UID: \"63a73969-c50b-40d6-8f9e-4b1804908aa1\") " pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.408675 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.408651    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/63a73969-c50b-40d6-8f9e-4b1804908aa1-must-gather-output\") pod \"must-gather-qsbht\" (UID: \"63a73969-c50b-40d6-8f9e-4b1804908aa1\") " pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.419727 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.419678    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8sws\" (UniqueName: \"kubernetes.io/projected/63a73969-c50b-40d6-8f9e-4b1804908aa1-kube-api-access-j8sws\") pod \"must-gather-qsbht\" (UID: \"63a73969-c50b-40d6-8f9e-4b1804908aa1\") " pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.442725 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.442664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/must-gather-qsbht"
Jul 07 14:40:37.582350 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.582319    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/must-gather-qsbht"]
Jul 07 14:40:37.584337 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:40:37.584311    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63a73969_c50b_40d6_8f9e_4b1804908aa1.slice/crio-d65090a805f668dc46d5eeb92a2cd6bd160d84e913b1f308cfbb10235f4cf64a WatchSource:0}: Error finding container d65090a805f668dc46d5eeb92a2cd6bd160d84e913b1f308cfbb10235f4cf64a: Status 404 returned error can't find the container with id d65090a805f668dc46d5eeb92a2cd6bd160d84e913b1f308cfbb10235f4cf64a
Jul 07 14:40:37.586251 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:37.586235    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:40:38.264505 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:38.264468    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/must-gather-qsbht" event={"ID":"63a73969-c50b-40d6-8f9e-4b1804908aa1","Type":"ContainerStarted","Data":"d65090a805f668dc46d5eeb92a2cd6bd160d84e913b1f308cfbb10235f4cf64a"}
Jul 07 14:40:39.270196 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:39.270110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/must-gather-qsbht" event={"ID":"63a73969-c50b-40d6-8f9e-4b1804908aa1","Type":"ContainerStarted","Data":"08639d4b573f0035c12559add7403d1f7c4d09adbd88d516828413c31ec930c2"}
Jul 07 14:40:39.270196 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:39.270161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/must-gather-qsbht" event={"ID":"63a73969-c50b-40d6-8f9e-4b1804908aa1","Type":"ContainerStarted","Data":"ed0b4260f46fcc6f24473b7d93cebb89f98457f76b86e6739eff796ec4843845"}
Jul 07 14:40:39.288171 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:39.288114    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6d5pc/must-gather-qsbht" podStartSLOduration=0.977055371 podStartE2EDuration="2.288091467s" totalImagesPullingTime="1.311036096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:39.286962984 +0000 UTC m=+2471.591650649" watchObservedRunningTime="2026-07-07 14:40:39.288091467 +0000 UTC m=+2471.592779138"
Jul 07 14:40:40.530970 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:40.530933    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b49hp_5513fbde-d669-45b1-965c-a250ed46ae4f/global-pull-secret-syncer/0.log"
Jul 07 14:40:40.737884 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:40.737850    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rnd4k_dd65ef2c-b6f5-46dc-940e-a196b2b5ae75/konnectivity-agent/0.log"
Jul 07 14:40:40.799013 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:40.798916    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-208.ec2.internal_3d9495d3c832a204d3734ce071daf0a8/haproxy/0.log"
Jul 07 14:40:46.393260 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:46.393231    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7fr2p_e5dc75c6-6618-49d2-8b55-0ad0288b2a5c/kuadrant-console-plugin/0.log"
Jul 07 14:40:46.709709 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:46.709610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5vrxz_67fec775-60e3-4f8e-966e-fa370187008b/manager/0.log"
Jul 07 14:40:48.686669 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:48.686637    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-7dvs6_1153ec1c-d841-417a-b084-debde898d01d/monitoring-plugin/0.log"
Jul 07 14:40:48.821003 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:48.820971    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmpqs_c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64/node-exporter/0.log"
Jul 07 14:40:48.847575 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:48.847490    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmpqs_c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64/kube-rbac-proxy/0.log"
Jul 07 14:40:48.871988 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:48.871962    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmpqs_c4f76a5f-0f3b-4621-82fd-ae0fda8b5e64/init-textfile/0.log"
Jul 07 14:40:48.995721 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:48.995671    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ddlhg_436b4492-2e27-4317-889e-7fabc84c4584/kube-rbac-proxy-main/0.log"
Jul 07 14:40:49.021334 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.021302    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ddlhg_436b4492-2e27-4317-889e-7fabc84c4584/kube-rbac-proxy-self/0.log"
Jul 07 14:40:49.048598 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.048562    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ddlhg_436b4492-2e27-4317-889e-7fabc84c4584/openshift-state-metrics/0.log"
Jul 07 14:40:49.097187 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.097154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_917ec750-7361-41bb-8a2e-fa2fe39680fb/prometheus/0.log"
Jul 07 14:40:49.130228 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.130143    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_917ec750-7361-41bb-8a2e-fa2fe39680fb/config-reloader/0.log"
Jul 07 14:40:49.157907 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.157873    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_917ec750-7361-41bb-8a2e-fa2fe39680fb/thanos-sidecar/0.log"
Jul 07 14:40:49.185044 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.185011    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_917ec750-7361-41bb-8a2e-fa2fe39680fb/kube-rbac-proxy-web/0.log"
Jul 07 14:40:49.215408 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.215366    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_917ec750-7361-41bb-8a2e-fa2fe39680fb/kube-rbac-proxy/0.log"
Jul 07 14:40:49.241306 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.241276    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_917ec750-7361-41bb-8a2e-fa2fe39680fb/kube-rbac-proxy-thanos/0.log"
Jul 07 14:40:49.266216 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.266187    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_917ec750-7361-41bb-8a2e-fa2fe39680fb/init-config-reloader/0.log"
Jul 07 14:40:49.298108 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.298080    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-5ckmd_cf347f3b-e0e7-44ce-9065-f9e4b64b2529/prometheus-operator/0.log"
Jul 07 14:40:49.324033 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.324002    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-5ckmd_cf347f3b-e0e7-44ce-9065-f9e4b64b2529/kube-rbac-proxy/0.log"
Jul 07 14:40:49.476886 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.476838    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66d55d44fb-ptwdc_a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2/thanos-query/0.log"
Jul 07 14:40:49.500734 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.500704    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66d55d44fb-ptwdc_a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2/kube-rbac-proxy-web/0.log"
Jul 07 14:40:49.529264 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.529236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66d55d44fb-ptwdc_a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2/kube-rbac-proxy/0.log"
Jul 07 14:40:49.552111 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.552078    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66d55d44fb-ptwdc_a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2/prom-label-proxy/0.log"
Jul 07 14:40:49.578398 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.578362    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66d55d44fb-ptwdc_a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2/kube-rbac-proxy-rules/0.log"
Jul 07 14:40:49.603218 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:49.603189    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66d55d44fb-ptwdc_a9501b1c-ed1e-4551-8d0b-8921bb3bf8b2/kube-rbac-proxy-metrics/0.log"
Jul 07 14:40:50.810672 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.810628    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"]
Jul 07 14:40:50.816420 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.816381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.823551 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.823512    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"]
Jul 07 14:40:50.845756 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.844108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-proc\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.845756 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.844169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-sys\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.845756 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.844223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njbmn\" (UniqueName: \"kubernetes.io/projected/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-kube-api-access-njbmn\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.845756 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.844316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-podres\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.845756 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.844355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-lib-modules\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.945178 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.945142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-podres\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.945451 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.945426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-lib-modules\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.945620 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.945607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-proc\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.945747 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.945733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-sys\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.945863 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.945849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njbmn\" (UniqueName: \"kubernetes.io/projected/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-kube-api-access-njbmn\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.946343 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.946313    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-lib-modules\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.946442 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.946422    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-podres\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.946503 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.946470    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-sys\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.946613 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.946589    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-proc\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:50.955216 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:50.955189    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njbmn\" (UniqueName: \"kubernetes.io/projected/d81e53ac-3bc1-41ce-b4ab-6d490a014eb7-kube-api-access-njbmn\") pod \"perf-node-gather-daemonset-7hffx\" (UID: \"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:51.136763 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:51.136649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:51.354312 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:51.353547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"]
Jul 07 14:40:51.359334 ip-10-0-128-208 kubenswrapper[2577]: W0707 14:40:51.359293    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd81e53ac_3bc1_41ce_b4ab_6d490a014eb7.slice/crio-e5011cd72e265bf90e02c402b7f387977e16591aa53559bd6d7873db4fc2dcb2 WatchSource:0}: Error finding container e5011cd72e265bf90e02c402b7f387977e16591aa53559bd6d7873db4fc2dcb2: Status 404 returned error can't find the container with id e5011cd72e265bf90e02c402b7f387977e16591aa53559bd6d7873db4fc2dcb2
Jul 07 14:40:51.915388 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:51.915361    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75df6bb4cb-tqfns_a46936b3-faa3-4686-8b1d-19d9533db780/console/0.log"
Jul 07 14:40:52.358028 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:52.357938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx" event={"ID":"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7","Type":"ContainerStarted","Data":"6019d1dc24fd4359f757f78652fd65485d7390078c14bc5d8363d9ba4bfb73e2"}
Jul 07 14:40:52.358028 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:52.358009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx" event={"ID":"d81e53ac-3bc1-41ce-b4ab-6d490a014eb7","Type":"ContainerStarted","Data":"e5011cd72e265bf90e02c402b7f387977e16591aa53559bd6d7873db4fc2dcb2"}
Jul 07 14:40:52.358409 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:52.358386    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:52.382461 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:52.382381    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx" podStartSLOduration=2.382362453 podStartE2EDuration="2.382362453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:52.374013427 +0000 UTC m=+2484.678701095" watchObservedRunningTime="2026-07-07 14:40:52.382362453 +0000 UTC m=+2484.687050131"
Jul 07 14:40:53.659217 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:53.659183    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvmnz_11cfe292-b441-45fa-84a9-df8130b27d32/dns/0.log"
Jul 07 14:40:53.681732 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:53.681680    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvmnz_11cfe292-b441-45fa-84a9-df8130b27d32/kube-rbac-proxy/0.log"
Jul 07 14:40:53.759554 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:53.759517    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9q4hg_5e79d75f-5c28-40c9-ac5e-0b3a33813105/dns-node-resolver/0.log"
Jul 07 14:40:54.422840 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:54.422804    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qpmwx_9d69e339-c88f-4eeb-91d9-6ed08cac7d20/node-ca/0.log"
Jul 07 14:40:55.504255 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:55.504220    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-65ds2_e7395196-c624-4f5d-8f1c-4a81128ba97e/kube-auth-proxy/0.log"
Jul 07 14:40:56.458962 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:56.458915    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mdv2b_0897d57f-e7b9-4346-8ded-d4f1fd68ca99/serve-healthcheck-canary/0.log"
Jul 07 14:40:57.089893 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:57.089859    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cphg_d5714e4c-867c-4a5a-b791-aaa1baeffb78/kube-rbac-proxy/0.log"
Jul 07 14:40:57.112482 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:57.112454    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cphg_d5714e4c-867c-4a5a-b791-aaa1baeffb78/exporter/0.log"
Jul 07 14:40:57.140248 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:57.140215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4cphg_d5714e4c-867c-4a5a-b791-aaa1baeffb78/extractor/0.log"
Jul 07 14:40:58.374146 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:58.374110    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-7hffx"
Jul 07 14:40:59.546625 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:40:59.546589    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b9gkc_78948922-c3c2-4174-a7c6-f981e70dc209/manager/0.log"
Jul 07 14:41:00.201030 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:41:00.200944    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-dnjpr_14f5b861-4b78-418e-8c25-a4734c1581ab/manager/0.log"
Jul 07 14:41:00.230185 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:41:00.230155    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-dnjpr_14f5b861-4b78-418e-8c25-a4734c1581ab/copy-manifests/0.log"
Jul 07 14:41:01.668540 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:41:01.668506    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-65ds2_e7395196-c624-4f5d-8f1c-4a81128ba97e/kube-auth-proxy/0.log"
Jul 07 14:41:01.858459 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:41:01.858429    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c9dfbb547-2p5vk_1abc93a1-5599-4093-abf7-5a23b7c4362d/manager/0.log"
Jul 07 14:41:03.202281 ip-10-0-128-208 kubenswrapper[2577]: I0707 14:41:03.202204    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-65ds2_e7395196-c624-4f5d-8f1c-4a81128ba97e/kube-auth-proxy/0.log"