Jul 09 20:03:26.949895 ip-10-0-139-14 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 20:03:27.398903 ip-10-0-139-14 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 20:03:27.398903 ip-10-0-139-14 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 20:03:27.398903 ip-10-0-139-14 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 20:03:27.398903 ip-10-0-139-14 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 20:03:27.398903 ip-10-0-139-14 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 20:03:27.399896 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.399794    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405521    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405544    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405564    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405567    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405570    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405574    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405577    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405580    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 20:03:27.405572 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405583    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405586    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405589    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405591    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405594    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405596    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405599    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405601    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405604    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405608    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405612    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405614    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405617    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405620    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405623    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405625    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405627    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405630    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405632    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405635    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 20:03:27.405875 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405637    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405640    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405642    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405648    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405650    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405653    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405656    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405658    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405661    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405664    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405666    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405669    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405671    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405674    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405678    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405680    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405683    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405686    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405688    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405691    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 20:03:27.406379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405693    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405696    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405698    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405701    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405704    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405706    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405709    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405711    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405714    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405716    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405718    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405721    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405723    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405726    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405729    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405731    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405734    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405737    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405739    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405742    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 20:03:27.406898 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405746    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405748    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405750    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405753    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405755    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405758    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405761    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405765    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405769    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405771    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405774    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405776    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405779    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405781    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405784    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405787    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405789    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405792    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405794    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 20:03:27.407375 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405797    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405799    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405801    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405804    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405806    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405809    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405811    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405814    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405816    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405819    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405822    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.405825    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406565    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406571    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406574    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406579    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406584    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406587    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406590    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 20:03:27.407842 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406594    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406597    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406600    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406603    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406605    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406608    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406610    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406613    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406615    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406618    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406621    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406623    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406626    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406628    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406631    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406633    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406635    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406638    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406640    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406643    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 20:03:27.408310 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406645    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406648    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406650    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406653    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406656    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406660    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406663    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406666    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406669    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406672    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406675    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406677    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406680    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406682    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406685    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406687    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406689    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406691    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406694    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 20:03:27.408859 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406696    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406699    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406702    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406704    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406707    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406710    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406712    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406715    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406718    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406722    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406725    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406727    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406729    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406732    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406734    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406737    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406740    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406743    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406745    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406747    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 20:03:27.409325 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406750    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406752    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406756    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406759    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406761    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406764    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406766    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406768    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406771    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406773    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406776    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406778    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406780    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406783    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406785    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406787    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406790    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406792    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406795    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406797    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 20:03:27.409839 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406799    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406802    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406804    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406807    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406809    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406811    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406814    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406816    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406820    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406822    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406825    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406827    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.406830    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407217    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407221    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407224    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407226    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407229    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407232    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407234    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 20:03:27.410328 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407237    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407239    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407242    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407245    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407247    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407249    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407252    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407254    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407257    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407260    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407262    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407266    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407269    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407271    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407274    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407278    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407281    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407284    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407287    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 20:03:27.410818 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407291    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407294    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407297    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407300    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407302    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407305    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407308    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407310    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407313    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407315    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407318    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407320    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407323    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407325    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407328    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407330    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407332    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407335    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407338    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 20:03:27.411266 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407340    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407344    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407348    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407351    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407354    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407357    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407360    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407362    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407365    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407368    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407370    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407373    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407376    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407378    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407381    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407384    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407387    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407390    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407393    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407395    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 20:03:27.411786 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407398    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407400    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407403    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407405    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407408    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407410    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407412    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407415    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407417    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407419    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407422    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407424    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407427    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407429    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407431    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407433    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407436    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407441    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407444    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407448    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 20:03:27.412298 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407451    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407454    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407456    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407458    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407461    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407464    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407467    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407470    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407472    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407474    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407477    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407479    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407482    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.407484    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407572    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407580    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407586    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407591    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407595    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407598    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407603    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 20:03:27.412800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407607    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407610    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407613    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407617    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407620    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407623    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407626    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407628    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407631    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407635    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407639    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407643    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407646    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407649    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407652    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407656    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407663    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407666    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407669    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407673    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407675    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407679    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407681    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407684    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 20:03:27.413312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407687    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407691    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407694    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407697    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407700    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407702    2565 flags.go:64] FLAG: --enable-server="true"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407705    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407709    2565 flags.go:64] FLAG: --event-burst="100"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407712    2565 flags.go:64] FLAG: --event-qps="50"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407715    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407718    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407721    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407724    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407727    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407730    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407733    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407736    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407739    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407742    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407750    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407752    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407755    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407758    2565 flags.go:64] FLAG: --feature-gates=""
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407762    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407768    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 20:03:27.413880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407771    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407774    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407777    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407780    2565 flags.go:64] FLAG: --help="false"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407783    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407786    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407789    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407792    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407795    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407799    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407801    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407804    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407807    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407809    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407812    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407815    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407818    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407820    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407823    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407826    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407828    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407831    2565 flags.go:64] FLAG: --lock-file=""
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407834    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407837    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 20:03:27.414534 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407839    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407845    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407848    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407851    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407854    2565 flags.go:64] FLAG: --logging-format="text"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407857    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407860    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407866    2565 flags.go:64] FLAG: --manifest-url=""
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407875    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407881    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407884    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407887    2565 flags.go:64] FLAG: --max-pods="110"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407891    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407894    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407896    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407899    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407902    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407905    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407908    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407915    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407918    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407921    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407924    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 09 20:03:27.415165 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407927    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407933    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407935    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407938    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407941    2565 flags.go:64] FLAG: --port="10250"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407944    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407946    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f249a7c6db878da"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407949    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407952    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407955    2565 flags.go:64] FLAG: --register-node="true"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407958    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407962    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407966    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407969    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407971    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407975    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407979    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407983    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407986    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407988    2565 flags.go:64] FLAG: --runonce="false"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407991    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407994    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.407998    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408000    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408003    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408006    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 20:03:27.415740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408009    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408012    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408015    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408017    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408020    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408023    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408026    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408028    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408031    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408036    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408039    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408041    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408047    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408049    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408052    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408054    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408057    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408060    2565 flags.go:64] FLAG: --v="2"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408064    2565 flags.go:64] FLAG: --version="false"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408068    2565 flags.go:64] FLAG: --vmodule=""
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408072    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.408075    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408190    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408196    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 20:03:27.416379 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408199    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408202    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408205    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408208    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408211    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408214    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408216    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408219    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408222    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408224    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408227    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408229    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408231    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408234    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408238    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408241    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408245    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408247    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408250    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 20:03:27.416970 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408253    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408255    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408257    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408260    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408262    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408265    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408267    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408269    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408272    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408275    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408279    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408284    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408288    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408291    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408294    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408296    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408299    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408301    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408304    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 20:03:27.417439 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408306    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408309    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408311    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408314    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408317    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408319    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408322    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408324    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408327    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408330    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408332    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408335    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408337    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408339    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408342    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408344    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408347    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408349    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408351    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408354    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 20:03:27.417952 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408356    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408359    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408361    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408364    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408369    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408373    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408375    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408378    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408380    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408384    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408388    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408391    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408393    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408396    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408399    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408401    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408403    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408407    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408409    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408411    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 20:03:27.418438 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408414    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408416    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408419    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408421    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408423    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408426    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408428    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408431    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408433    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408435    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408438    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408440    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408442    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408445    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408447    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408450    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408455    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408458    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 20:03:27.418992 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.408461    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.409927    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.416809    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.416826    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.416846    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.416852    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416910    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416915    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416918    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416921    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416924    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416926    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416929    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416931    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416934    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 20:03:27.419429 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416937    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416940    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416942    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416945    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416947    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416950    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416952    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416955    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416957    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416960    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416963    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416965    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416968    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416971    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416974    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416977    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416979    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416982    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416985    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416987    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 20:03:27.419813 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416991    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416994    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416997    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.416999    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417002    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417005    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417007    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417010    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417012    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417015    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417017    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417020    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417022    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417025    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417027    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417029    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417032    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417035    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417037    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417039    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 20:03:27.420301 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417042    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417044    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417047    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417049    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417053    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417057    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417059    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417062    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417066    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417069    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417072    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417075    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417079    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417082    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417085    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417088    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417090    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417093    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417095    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 20:03:27.420805 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417098    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417101    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417103    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417106    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417108    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417111    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417113    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417116    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417118    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417120    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417123    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417127    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417130    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417132    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417135    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417138    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417140    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417142    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417145    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 20:03:27.421300 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417147    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417150    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417152    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417155    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417158    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417160    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417163    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417166    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417169    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417171    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417175    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417180    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.417185    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417295    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417300    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 20:03:27.421768 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417303    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417306    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417308    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417311    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417313    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417316    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417319    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417322    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417324    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417327    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417329    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417332    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417334    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417337    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417339    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417342    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417345    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417347    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417350    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417352    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 20:03:27.422138 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417355    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417359    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417363    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417367    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417370    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417372    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417375    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417377    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417381    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417384    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417387    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417390    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417393    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417395    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417398    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417401    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417403    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417406    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417408    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 20:03:27.422634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417411    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417413    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417416    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417418    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417421    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417423    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417426    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417429    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417431    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417434    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417436    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417439    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417441    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417444    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417446    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417449    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417452    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417455    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417458    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417461    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 20:03:27.423092 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417463    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417466    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417468    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417470    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417472    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417475    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417477    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417480    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417482    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417485    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417487    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417489    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417492    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417494    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417497    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417499    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417501    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417504    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417506    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417509    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 20:03:27.423574 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417511    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417514    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417516    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417519    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417521    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417523    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417526    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417528    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417532    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417535    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417538    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417541    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417544    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417560    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417563    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417566    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417568    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 20:03:27.424061 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:27.417571    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 20:03:27.424470 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.417576    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 20:03:27.424470 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.417688    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 20:03:27.424470 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.420860    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 20:03:27.424470 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.422264    2565 server.go:1019] "Starting client certificate rotation"
Jul 09 20:03:27.424470 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.422365    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 20:03:27.424470 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.422405    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 20:03:27.424876 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.424862    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 20:03:27.427503 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.427466    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 20:03:27.443200 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.443181    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 09 20:03:27.445601 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.445582    2565 log.go:25] "Validated CRI v1 image API"
Jul 09 20:03:27.446427 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.446410    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 20:03:27.449091 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.449071    2565 fs.go:135] Filesystem UUIDs: map[2381f1c8-900b-46a5-b1b5-28509f03f9ba:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c39fcbe1-fb38-4450-80c1-f3fb785bce6a:/dev/nvme0n1p4]
Jul 09 20:03:27.449151 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.449091    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 20:03:27.452739 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.452723    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 20:03:27.454397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.454286    2565 manager.go:216] Machine: {Timestamp:2026-07-09 20:03:27.452806468 +0000 UTC m=+0.370907518 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092061 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2276dfd8f6a250ba56555395b8c487 SystemUUID:ec2276df-d8f6-a250-ba56-555395b8c487 BootID:0683a7eb-05a7-4d1e-85f6-c38c9b2965a4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:92:8a:92:64:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:92:8a:92:64:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:95:3e:80:1e:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 20:03:27.454397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.454393    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 20:03:27.454503 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.454483    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 20:03:27.458763 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.458735    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 20:03:27.458913 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.458768    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-14.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 20:03:27.459591 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.459581    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 20:03:27.459623 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.459593    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 20:03:27.459623 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.459601    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 20:03:27.460355 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.460344    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 20:03:27.461728 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.461718    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 20:03:27.464890 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.464876    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 20:03:27.465015 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465005    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 20:03:27.465049 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465037    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 20:03:27.465049 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465047    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 20:03:27.465115 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465058    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 20:03:27.465115 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465068    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 09 20:03:27.465115 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465077    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 20:03:27.465437 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465412    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 20:03:27.465437 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.465436    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 20:03:27.468151 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.468136    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 20:03:27.470261 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470244    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 20:03:27.470356 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470291    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 20:03:27.470478 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470464    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 20:03:27.470539 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470487    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 20:03:27.470539 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470497    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 20:03:27.470539 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470505    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 20:03:27.470539 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470518    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 20:03:27.470539 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.470527    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 20:03:27.471089 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.471078    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 20:03:27.471140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.471094    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 20:03:27.471140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.471106    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 20:03:27.471140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.471116    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 20:03:27.471140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.471139    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 20:03:27.471265 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.471152    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 20:03:27.472109 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.472098    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 20:03:27.472169 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.472112    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 20:03:27.475359 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.475342    2565 server.go:1268] "Started kubelet"
Jul 09 20:03:27.475452 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.475426    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 20:03:27.475638 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.475583    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 20:03:27.475745 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.475662    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 20:03:27.476494 ip-10-0-139-14 systemd[1]: Started Kubernetes Kubelet.
Jul 09 20:03:27.479929 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.479905    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 20:03:27.480032 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.479970    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-14.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 20:03:27.480141 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.480116    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 20:03:27.480378 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.480357    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 20:03:27.481295 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.481274    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-45gd4"
Jul 09 20:03:27.483176 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.483154    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 20:03:27.483259 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.483248    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 20:03:27.485755 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.484445    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-14.ec2.internal.18c0b7ad52379a2f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-14.ec2.internal,UID:ip-10-0-139-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-14.ec2.internal,},FirstTimestamp:2026-07-09 20:03:27.475317295 +0000 UTC m=+0.393418346,LastTimestamp:2026-07-09 20:03:27.475317295 +0000 UTC m=+0.393418346,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-14.ec2.internal,}"
Jul 09 20:03:27.486065 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.486052    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 20:03:27.486143 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.486081    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 20:03:27.486242 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.486161    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:27.486615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.486456    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-45gd4"
Jul 09 20:03:27.486686 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.486637    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 20:03:27.486931 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.486914    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 20:03:27.486931 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.486931    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 20:03:27.487046 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.486998    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 20:03:27.487046 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487010    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 20:03:27.487132 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487067    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 20:03:27.487132 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487081    2565 factory.go:55] Registering systemd factory
Jul 09 20:03:27.487132 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487089    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 09 20:03:27.487330 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487314    2565 factory.go:153] Registering CRI-O factory
Jul 09 20:03:27.487330 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487331    2565 factory.go:223] Registration of the crio container factory successfully
Jul 09 20:03:27.487462 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487352    2565 factory.go:103] Registering Raw factory
Jul 09 20:03:27.487462 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487367    2565 manager.go:1196] Started watching for new ooms in manager
Jul 09 20:03:27.487731 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.487718    2565 manager.go:349] Starting recovery of all containers
Jul 09 20:03:27.496268 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.496165    2565 manager.go:354] Recovery completed
Jul 09 20:03:27.497733 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.497675    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 20:03:27.500332 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.500321    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 20:03:27.500835 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.500819    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-14.ec2.internal\" not found" node="ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.502228 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.502213    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 20:03:27.502283 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.502243    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 20:03:27.502283 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.502254    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID"
Jul 09 20:03:27.503125 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.503033    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 20:03:27.503125 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.503047    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 20:03:27.503125 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.503066    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 20:03:27.503301 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.503169    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 20:03:27.504338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.504315    2565 policy_none.go:49] "None policy: Start"
Jul 09 20:03:27.504338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.504332    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 20:03:27.504458 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.504347    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 20:03:27.504458 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.504399    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 20:03:27.504458 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.504428    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 20:03:27.504458 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.504440    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID"
Jul 09 20:03:27.505293 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.505282    2565 policy_none.go:47] "Start"
Jul 09 20:03:27.545104 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.545079    2565 manager.go:337] "Starting Device Plugin manager"
Jul 09 20:03:27.545199 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.545124    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 20:03:27.545199 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.545137    2565 server.go:87] "Starting device plugin registration server"
Jul 09 20:03:27.545430 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.545418    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 20:03:27.545468 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.545434    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 20:03:27.545588 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.545543    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 20:03:27.545779 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.545656    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 20:03:27.545779 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.545664    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 20:03:27.546150 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.546136    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 20:03:27.546221 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.546178    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:27.646081 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.646046    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 20:03:27.647233 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.647095    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 20:03:27.647233 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.647133    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 20:03:27.647233 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.647147    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID"
Jul 09 20:03:27.647233 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.647174    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.655942 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.655893    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.655942 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.655924    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-14.ec2.internal\": node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:27.669456 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.669426    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:27.673241 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.673207    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 20:03:27.674681 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.674656    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 20:03:27.674774 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.674703    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 20:03:27.674774 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.674731    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 20:03:27.674774 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.674771    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 20:03:27.678235 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.678215    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 20:03:27.770118 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.770068    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:27.775241 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.775216    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"]
Jul 09 20:03:27.775314 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.775292    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 20:03:27.777615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.777597    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 20:03:27.777743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.777636    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 20:03:27.777743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.777655    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID"
Jul 09 20:03:27.779087 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779071    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 20:03:27.779182 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.779236 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779200    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 20:03:27.779922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779904    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 20:03:27.779922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779917    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 20:03:27.780026 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779935    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 20:03:27.780026 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779936    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 20:03:27.780026 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779947    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID"
Jul 09 20:03:27.780026 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.779986    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID"
Jul 09 20:03:27.781104 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.781089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.781171 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.781114    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 20:03:27.781838 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.781822    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 20:03:27.781924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.781851    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 20:03:27.781924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.781861    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeHasSufficientPID"
Jul 09 20:03:27.789903 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.789886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.789990 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.789909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.789990 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.789933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51adeb82ef9cf7027b389777ed26ae92-config\") pod \"kube-apiserver-proxy-ip-10-0-139-14.ec2.internal\" (UID: \"51adeb82ef9cf7027b389777ed26ae92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.804476 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.804452    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-14.ec2.internal\" not found" node="ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.808915 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.808900    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-14.ec2.internal\" not found" node="ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.870358 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.870328    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:27.890207 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.890180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.890314 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.890210    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.890314 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.890227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51adeb82ef9cf7027b389777ed26ae92-config\") pod \"kube-apiserver-proxy-ip-10-0-139-14.ec2.internal\" (UID: \"51adeb82ef9cf7027b389777ed26ae92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.890314 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.890274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51adeb82ef9cf7027b389777ed26ae92-config\") pod \"kube-apiserver-proxy-ip-10-0-139-14.ec2.internal\" (UID: \"51adeb82ef9cf7027b389777ed26ae92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.890314 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.890302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.890461 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:27.890299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa6fa0e50e78b9ac1702f959fc0c02aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal\" (UID: \"aa6fa0e50e78b9ac1702f959fc0c02aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:27.970707 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:27.970622    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:28.071150 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:28.071110    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:29.540269 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:29.540246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:29.546021 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:29.546002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:29.605728 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:29.605695    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:29.706247 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:29.706165    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:29.806686 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:29.806656    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:29.855115 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:29.855094    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 20:03:29.855694 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:29.855268    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 20:03:29.855694 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:29.855268    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 20:03:29.907548 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:29.907505    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:29.923176 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:29.923136    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 19:58:28 +0000 UTC" deadline="2028-02-18 14:04:07.756231236 +0000 UTC"
Jul 09 20:03:29.923268 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:29.923176    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14130h0m37.833060777s"
Jul 09 20:03:30.007722 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:30.007641    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-14.ec2.internal\" not found"
Jul 09 20:03:30.010019 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.010002    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 20:03:30.020910 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.020882    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:30.032571 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.032542    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 20:03:30.034513 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.034484    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal"
Jul 09 20:03:30.043384 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.043366    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 20:03:30.174487 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:30.174449    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51adeb82ef9cf7027b389777ed26ae92.slice/crio-25b64bc4d0f65ff0bc91393663734ec0ec6511504689af49b818c7f43966d4b4 WatchSource:0}: Error finding container 25b64bc4d0f65ff0bc91393663734ec0ec6511504689af49b818c7f43966d4b4: Status 404 returned error can't find the container with id 25b64bc4d0f65ff0bc91393663734ec0ec6511504689af49b818c7f43966d4b4
Jul 09 20:03:30.174685 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:30.174665    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6fa0e50e78b9ac1702f959fc0c02aa.slice/crio-8c5c6aae4483c723531207609cc94abc400237ac64ed46411d559f54b003dd01 WatchSource:0}: Error finding container 8c5c6aae4483c723531207609cc94abc400237ac64ed46411d559f54b003dd01: Status 404 returned error can't find the container with id 8c5c6aae4483c723531207609cc94abc400237ac64ed46411d559f54b003dd01
Jul 09 20:03:30.181550 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.181527    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 20:03:30.487653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.487576    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 20:03:30.900123 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.900043    2565 apiserver.go:52] "Watching apiserver"
Jul 09 20:03:30.907281 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.907258    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 20:03:30.907720 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.907694    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal","openshift-multus/network-metrics-daemon-jtndh","openshift-network-diagnostics/network-check-target-w9hkk","openshift-network-operator/iptables-alerter-l9x6p","kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sz6xk","openshift-image-registry/node-ca-kqnm9","openshift-multus/multus-additional-cni-plugins-9s28c","openshift-multus/multus-z9c6q","openshift-ovn-kubernetes/ovnkube-node-h4fcj","kube-system/global-pull-secret-syncer-nt2zq","kube-system/konnectivity-agent-sfb7k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b","openshift-dns/node-resolver-t2sg7"]
Jul 09 20:03:30.909230 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.909189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:30.910387 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.910361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:30.910482 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:30.910434    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:30.911509 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.911489    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-755w5\""
Jul 09 20:03:30.911594 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.911514    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:30.911642 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:30.911583    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:30.911642 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.911608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 20:03:30.911741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.911667    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 20:03:30.911741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.911673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 20:03:30.912631 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.912612    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:30.914039 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.914023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:30.914847 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.914829    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 20:03:30.914935 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.914883    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5f9xc\""
Jul 09 20:03:30.915014 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.915000    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 20:03:30.915089 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.915074    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 20:03:30.915370 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.915354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.915950 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.915931    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 20:03:30.916360 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.916343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8d7mv\""
Jul 09 20:03:30.916360 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.916356    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 20:03:30.916622 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.916609    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.918266 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.917506    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 20:03:30.918266 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.917843    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 20:03:30.918266 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.918027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvvz5\""
Jul 09 20:03:30.918738 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.918311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.919059 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.919041    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 20:03:30.919155 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.919051    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 20:03:30.919155 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.919088    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 20:03:30.919155 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.919087    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 20:03:30.919317 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.919160    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xpxsp\""
Jul 09 20:03:30.919371 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.919324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:30.919416 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:30.919389    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:30.920353 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.920336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 20:03:30.920595 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.920574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 20:03:30.920671 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.920596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 20:03:30.920781 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.920760    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 20:03:30.920892 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.920803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.920892 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.920877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5k92c\""
Jul 09 20:03:30.923111 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.923080    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 20:03:30.923297 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.923276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 20:03:30.923541 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.923513    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 20:03:30.923994 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.923969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:30.925026 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.924967    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4kk25\""
Jul 09 20:03:30.926007 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.925988    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:30.927446 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.926321    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 20:03:30.928025 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.928000    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 20:03:30.928334 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.928315    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 20:03:30.928415 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.928377    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 20:03:30.928648 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.928620    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 20:03:30.930065 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.930045    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bgxxg\""
Jul 09 20:03:30.930155 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.930088    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w2jfv\""
Jul 09 20:03:30.931093 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.930523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 20:03:30.931441 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.931423    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 20:03:30.932047 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-systemd-units\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932124 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-run-netns\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932124 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932124 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932091    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovnkube-config\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932124 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbfe789b-fa2d-453a-a5f4-9563e45ac656-cni-binary-copy\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.932124 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-k8s-cni-cncf-io\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-kubernetes\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-cni-bin\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovnkube-script-lib\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-run\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-node-log\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-log-socket\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-kubelet\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-modprobe-d\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysctl-d\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovn-node-metrics-cert\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vld27\" (UniqueName: \"kubernetes.io/projected/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-kube-api-access-vld27\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-etc-selinux\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kd4t\" (UniqueName: \"kubernetes.io/projected/89c454a1-8e1c-4606-875a-f9015cf3dfff-kube-api-access-5kd4t\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-systemd\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-serviceca\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-hosts-file\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kgwv\" (UniqueName: \"kubernetes.io/projected/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-kube-api-access-9kgwv\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-socket-dir-parent\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-cni-multus\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-etc-kubernetes\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-var-lib-kubelet\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-host\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-sys-fs\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-slash\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.932877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-var-lib-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysctl-conf\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-systemd\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59lw\" (UniqueName: \"kubernetes.io/projected/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-kube-api-access-r59lw\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-conf-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysconfig\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-ovn\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e54656f1-7f4a-45df-baed-7d9ba120876c-kubelet-config\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e54656f1-7f4a-45df-baed-7d9ba120876c-dbus\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-system-cni-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-hostroot\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-cni-netd\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74pm6\" (UniqueName: \"kubernetes.io/projected/90d468c6-af6a-4e86-b4a6-0dacef723e27-kube-api-access-74pm6\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-device-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.933786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9hjz\" (UniqueName: \"kubernetes.io/projected/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-kube-api-access-p9hjz\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-etc-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-iptables-alerter-script\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-host-slash\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.932976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-netns\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-multus-certs\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-cni-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-os-release\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-cni-bin\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-tuned\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-registration-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-host\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-sys\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-lib-modules\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-kubelet\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-tmp-dir\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:30.934499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-cnibin\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.935038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-daemon-config\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.935038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr5cg\" (UniqueName: \"kubernetes.io/projected/cbfe789b-fa2d-453a-a5f4-9563e45ac656-kube-api-access-pr5cg\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:30.935038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-tmp\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.935038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn8gh\" (UniqueName: \"kubernetes.io/projected/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-kube-api-access-zn8gh\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:30.935038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:30.935038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-env-overrides\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:30.935038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.933487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-socket-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:30.937043 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.937026    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 20:03:30.958166 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.958142    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrnzt"
Jul 09 20:03:30.969138 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:30.969112    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hrnzt"
Jul 09 20:03:31.021202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.021173    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 20:03:31.033810 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.033777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn8gh\" (UniqueName: \"kubernetes.io/projected/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-kube-api-access-zn8gh\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.033810 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.033811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:31.034020 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.033837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-env-overrides\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034020 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.033860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-socket-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.034020 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.033999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-socket-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.034188 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-systemd-units\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034188 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.034131    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:31.034188 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-run-netns\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034188 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.034194    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:03:31.534171455 +0000 UTC m=+3.018611454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovnkube-config\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x9h9\" (UniqueName: \"kubernetes.io/projected/01b0228b-9a43-413f-afb7-c839f9e9713b-kube-api-access-2x9h9\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbfe789b-fa2d-453a-a5f4-9563e45ac656-cni-binary-copy\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-run-netns\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-k8s-cni-cncf-io\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-kubernetes\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-cni-bin\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034404 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovnkube-script-lib\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-run\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-node-log\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-log-socket\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-kubelet\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-modprobe-d\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysctl-d\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovn-node-metrics-cert\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-system-cni-dir\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-cni-binary-copy\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.034797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6955bbb-5870-4a78-9a96-f0bd49a7e5f8-agent-certs\") pod \"konnectivity-agent-sfb7k\" (UID: \"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8\") " pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vld27\" (UniqueName: \"kubernetes.io/projected/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-kube-api-access-vld27\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-etc-selinux\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kd4t\" (UniqueName: \"kubernetes.io/projected/89c454a1-8e1c-4606-875a-f9015cf3dfff-kube-api-access-5kd4t\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-systemd\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovnkube-config\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-serviceca\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-os-release\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-hosts-file\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kgwv\" (UniqueName: \"kubernetes.io/projected/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-kube-api-access-9kgwv\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-socket-dir-parent\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.035112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035140    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-cni-multus\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-etc-kubernetes\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-var-lib-kubelet\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-host\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-sys-fs\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-env-overrides\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-slash\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-var-lib-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysctl-conf\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-systemd\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r59lw\" (UniqueName: \"kubernetes.io/projected/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-kube-api-access-r59lw\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:31.035494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-conf-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysconfig\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-ovn\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-etc-selinux\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e54656f1-7f4a-45df-baed-7d9ba120876c-kubelet-config\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:31.035862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.034271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-systemd-units\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.036167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-run-ovn-kubernetes\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.036167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.035995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e54656f1-7f4a-45df-baed-7d9ba120876c-dbus\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:31.036167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-cni-multus\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.036167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-system-cni-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.036167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-hostroot\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.036167 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.036109    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.036176    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret podName:e54656f1-7f4a-45df-baed-7d9ba120876c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:31.536154435 +0000 UTC m=+3.020594416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret") pod "global-pull-secret-syncer-nt2zq" (UID: "e54656f1-7f4a-45df-baed-7d9ba120876c") : object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-cni-netd\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74pm6\" (UniqueName: \"kubernetes.io/projected/90d468c6-af6a-4e86-b4a6-0dacef723e27-kube-api-access-74pm6\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-etc-kubernetes\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-device-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-kubelet\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-socket-dir-parent\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-host\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-systemd\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-var-lib-kubelet\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.036457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036450    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysctl-d\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysconfig\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e54656f1-7f4a-45df-baed-7d9ba120876c-kubelet-config\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-ovn\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-slash\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e54656f1-7f4a-45df-baed-7d9ba120876c-dbus\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovnkube-script-lib\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-run\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-system-cni-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-var-lib-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-hostroot\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-sys-fs\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-modprobe-d\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.037027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037019    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-k8s-cni-cncf-io\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-node-log\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-conf-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9hjz\" (UniqueName: \"kubernetes.io/projected/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-kube-api-access-p9hjz\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-run-systemd\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-cni-bin\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-hosts-file\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.036454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-log-socket\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037398    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-cni-netd\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-etc-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-sysctl-conf\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-iptables-alerter-script\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-serviceca\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-host-slash\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-etc-openvswitch\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-netns\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-host-slash\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-multus-certs\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.037826 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-kubernetes\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-device-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6955bbb-5870-4a78-9a96-f0bd49a7e5f8-konnectivity-ca\") pod \"konnectivity-agent-sfb7k\" (UID: \"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8\") " pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-cni-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-netns\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-run-multus-certs\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-os-release\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbfe789b-fa2d-453a-a5f4-9563e45ac656-cni-binary-copy\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-cni-bin\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.037984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-cni-dir\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-os-release\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-tuned\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-registration-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-host\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-iptables-alerter-script\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-host-var-lib-cni-bin\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-cnibin\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-host\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:31.038669 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-sys\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-lib-modules\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-kubelet\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-tmp-dir\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-cnibin\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-daemon-config\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89c454a1-8e1c-4606-875a-f9015cf3dfff-registration-dir\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr5cg\" (UniqueName: \"kubernetes.io/projected/cbfe789b-fa2d-453a-a5f4-9563e45ac656-kube-api-access-pr5cg\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.038848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-tmp\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.039089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbfe789b-fa2d-453a-a5f4-9563e45ac656-multus-daemon-config\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.039131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-sys\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.039185 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.039193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-lib-modules\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.039779 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.039243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d468c6-af6a-4e86-b4a6-0dacef723e27-host-kubelet\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.039779 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.039720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbfe789b-fa2d-453a-a5f4-9563e45ac656-cnibin\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.040232 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.040161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-tmp-dir\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:31.040517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.040388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90d468c6-af6a-4e86-b4a6-0dacef723e27-ovn-node-metrics-cert\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.041061 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.040589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-etc-tuned\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.042588 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.042564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-tmp\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.045495 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.045476    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 20:03:31.045622 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.045504    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 20:03:31.045622 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.045518    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jjlzd for pod openshift-network-diagnostics/network-check-target-w9hkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:31.045622 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.045609    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd podName:0201a641-dec4-4448-8dc4-244f8e4a8eb9 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:31.545588122 +0000 UTC m=+3.030028102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jjlzd" (UniqueName: "kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd") pod "network-check-target-w9hkk" (UID: "0201a641-dec4-4448-8dc4-244f8e4a8eb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:31.047791 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.047760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn8gh\" (UniqueName: \"kubernetes.io/projected/c05bdbf2-ce55-4ba9-be59-3f11e1a9f462-kube-api-access-zn8gh\") pod \"tuned-sz6xk\" (UID: \"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462\") " pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.048555 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.048536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kgwv\" (UniqueName: \"kubernetes.io/projected/5fc880f4-8c16-459c-8ca8-c2f1e08f35aa-kube-api-access-9kgwv\") pod \"node-resolver-t2sg7\" (UID: \"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa\") " pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:31.051235 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.049997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vld27\" (UniqueName: \"kubernetes.io/projected/c6355eac-c7d8-4d12-beb7-93c0f2b7dcde-kube-api-access-vld27\") pod \"iptables-alerter-l9x6p\" (UID: \"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde\") " pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:31.051235 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.050198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59lw\" (UniqueName: \"kubernetes.io/projected/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-kube-api-access-r59lw\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:31.051931 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.051911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kd4t\" (UniqueName: \"kubernetes.io/projected/89c454a1-8e1c-4606-875a-f9015cf3dfff-kube-api-access-5kd4t\") pod \"aws-ebs-csi-driver-node-7jj2b\" (UID: \"89c454a1-8e1c-4606-875a-f9015cf3dfff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.052849 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.052827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74pm6\" (UniqueName: \"kubernetes.io/projected/90d468c6-af6a-4e86-b4a6-0dacef723e27-kube-api-access-74pm6\") pod \"ovnkube-node-h4fcj\" (UID: \"90d468c6-af6a-4e86-b4a6-0dacef723e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.053205 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.053184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9hjz\" (UniqueName: \"kubernetes.io/projected/410bcb74-59c1-476b-ac5e-cbb8fe5fe94d-kube-api-access-p9hjz\") pod \"node-ca-kqnm9\" (UID: \"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d\") " pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:31.054276 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.054254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr5cg\" (UniqueName: \"kubernetes.io/projected/cbfe789b-fa2d-453a-a5f4-9563e45ac656-kube-api-access-pr5cg\") pod \"multus-z9c6q\" (UID: \"cbfe789b-fa2d-453a-a5f4-9563e45ac656\") " pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.113299 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.113242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" event={"ID":"aa6fa0e50e78b9ac1702f959fc0c02aa","Type":"ContainerStarted","Data":"8c5c6aae4483c723531207609cc94abc400237ac64ed46411d559f54b003dd01"}
Jul 09 20:03:31.113807 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.113758    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 20:03:31.114951 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.114925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" event={"ID":"51adeb82ef9cf7027b389777ed26ae92","Type":"ContainerStarted","Data":"25b64bc4d0f65ff0bc91393663734ec0ec6511504689af49b818c7f43966d4b4"}
Jul 09 20:03:31.140152 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x9h9\" (UniqueName: \"kubernetes.io/projected/01b0228b-9a43-413f-afb7-c839f9e9713b-kube-api-access-2x9h9\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140305 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140361 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-system-cni-dir\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140407 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-cni-binary-copy\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140407 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6955bbb-5870-4a78-9a96-f0bd49a7e5f8-agent-certs\") pod \"konnectivity-agent-sfb7k\" (UID: \"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8\") " pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:31.140468 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-os-release\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140468 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-system-cni-dir\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140523 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140553 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-os-release\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140553 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6955bbb-5870-4a78-9a96-f0bd49a7e5f8-konnectivity-ca\") pod \"konnectivity-agent-sfb7k\" (UID: \"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8\") " pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:31.140610 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-cnibin\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140652 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140764 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140857 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-cni-binary-copy\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.140922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.140904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-cnibin\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.141048 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.141026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01b0228b-9a43-413f-afb7-c839f9e9713b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.141101 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.141067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01b0228b-9a43-413f-afb7-c839f9e9713b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.141250 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.141230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f6955bbb-5870-4a78-9a96-f0bd49a7e5f8-konnectivity-ca\") pod \"konnectivity-agent-sfb7k\" (UID: \"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8\") " pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:31.143116 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.143096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f6955bbb-5870-4a78-9a96-f0bd49a7e5f8-agent-certs\") pod \"konnectivity-agent-sfb7k\" (UID: \"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8\") " pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:31.150241 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.150183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x9h9\" (UniqueName: \"kubernetes.io/projected/01b0228b-9a43-413f-afb7-c839f9e9713b-kube-api-access-2x9h9\") pod \"multus-additional-cni-plugins-9s28c\" (UID: \"01b0228b-9a43-413f-afb7-c839f9e9713b\") " pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.222226 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.222171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kqnm9"
Jul 09 20:03:31.229687 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.229658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l9x6p"
Jul 09 20:03:31.237881 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.237855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t2sg7"
Jul 09 20:03:31.240113 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:31.240034    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6355eac_c7d8_4d12_beb7_93c0f2b7dcde.slice/crio-b500f5d5e1ce55f9a4d498956c24921679f044622e2694bd41a8ace22b423261 WatchSource:0}: Error finding container b500f5d5e1ce55f9a4d498956c24921679f044622e2694bd41a8ace22b423261: Status 404 returned error can't find the container with id b500f5d5e1ce55f9a4d498956c24921679f044622e2694bd41a8ace22b423261
Jul 09 20:03:31.248831 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:31.248794    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc880f4_8c16_459c_8ca8_c2f1e08f35aa.slice/crio-b7236480935511645a337d0081394d05765e9abb27093b0aa51fdc7e45f6f940 WatchSource:0}: Error finding container b7236480935511645a337d0081394d05765e9abb27093b0aa51fdc7e45f6f940: Status 404 returned error can't find the container with id b7236480935511645a337d0081394d05765e9abb27093b0aa51fdc7e45f6f940
Jul 09 20:03:31.250229 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.250190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sz6xk"
Jul 09 20:03:31.260707 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.260683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9c6q"
Jul 09 20:03:31.269556 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.269534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b"
Jul 09 20:03:31.279712 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.279521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:31.287366 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.287344    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9s28c"
Jul 09 20:03:31.292464 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.292438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:31.365692 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.365664    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 20:03:31.543966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.543892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:31.543966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.543936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:31.544169 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.544038    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:31.544169 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.544041    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:31.544169 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.544095    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret podName:e54656f1-7f4a-45df-baed-7d9ba120876c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:32.544081877 +0000 UTC m=+4.028521855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret") pod "global-pull-secret-syncer-nt2zq" (UID: "e54656f1-7f4a-45df-baed-7d9ba120876c") : object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:31.544169 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.544108    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:03:32.544102916 +0000 UTC m=+4.028542894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:31.645160 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.645115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:31.645351 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.645324    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 20:03:31.645351 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.645346    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 20:03:31.645454 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.645359    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jjlzd for pod openshift-network-diagnostics/network-check-target-w9hkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:31.645454 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:31.645417    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd podName:0201a641-dec4-4448-8dc4-244f8e4a8eb9 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:32.645397914 +0000 UTC m=+4.129837909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjlzd" (UniqueName: "kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd") pod "network-check-target-w9hkk" (UID: "0201a641-dec4-4448-8dc4-244f8e4a8eb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:31.972339 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.972237    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 19:58:30 +0000 UTC" deadline="2028-03-16 18:52:08.03147387 +0000 UTC"
Jul 09 20:03:31.972339 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:31.972285    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14782h48m36.059193006s"
Jul 09 20:03:32.108999 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.108960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:32.109195 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.109016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:32.109195 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.109136    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:32.109331 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.109261    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:32.118281 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.118249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t2sg7" event={"ID":"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa","Type":"ContainerStarted","Data":"b7236480935511645a337d0081394d05765e9abb27093b0aa51fdc7e45f6f940"}
Jul 09 20:03:32.119400 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.119368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l9x6p" event={"ID":"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde","Type":"ContainerStarted","Data":"b500f5d5e1ce55f9a4d498956c24921679f044622e2694bd41a8ace22b423261"}
Jul 09 20:03:32.120314 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.120293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqnm9" event={"ID":"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d","Type":"ContainerStarted","Data":"1d6e0b2d718c08a067b83b38ada7f9e69346c232d27550558a73fcaf73f6a09a"}
Jul 09 20:03:32.261123 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:32.261098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c454a1_8e1c_4606_875a_f9015cf3dfff.slice/crio-b2774c176f49c1ccd09e5dcc81fade0ff09d64bafa3a2f3298be3ac9ca26f17c WatchSource:0}: Error finding container b2774c176f49c1ccd09e5dcc81fade0ff09d64bafa3a2f3298be3ac9ca26f17c: Status 404 returned error can't find the container with id b2774c176f49c1ccd09e5dcc81fade0ff09d64bafa3a2f3298be3ac9ca26f17c
Jul 09 20:03:32.263243 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:32.263187    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b0228b_9a43_413f_afb7_c839f9e9713b.slice/crio-bd56cb488c9e31b152a9e5e8ba3aebf06dc4d3acc6da4dbf01b9bdf171edca1e WatchSource:0}: Error finding container bd56cb488c9e31b152a9e5e8ba3aebf06dc4d3acc6da4dbf01b9bdf171edca1e: Status 404 returned error can't find the container with id bd56cb488c9e31b152a9e5e8ba3aebf06dc4d3acc6da4dbf01b9bdf171edca1e
Jul 09 20:03:32.267004 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:32.266797    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6955bbb_5870_4a78_9a96_f0bd49a7e5f8.slice/crio-2087e56b2def1e826829def31a7adba1b8c231b0d6f2a98131f8210093687ce8 WatchSource:0}: Error finding container 2087e56b2def1e826829def31a7adba1b8c231b0d6f2a98131f8210093687ce8: Status 404 returned error can't find the container with id 2087e56b2def1e826829def31a7adba1b8c231b0d6f2a98131f8210093687ce8
Jul 09 20:03:32.267764 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:32.267737    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfe789b_fa2d_453a_a5f4_9563e45ac656.slice/crio-6a2ed9f636711ef2f5bd2ef2d44e0f970c633f0ccccf07b70e7318b1d608548e WatchSource:0}: Error finding container 6a2ed9f636711ef2f5bd2ef2d44e0f970c633f0ccccf07b70e7318b1d608548e: Status 404 returned error can't find the container with id 6a2ed9f636711ef2f5bd2ef2d44e0f970c633f0ccccf07b70e7318b1d608548e
Jul 09 20:03:32.269355 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:03:32.268925    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d468c6_af6a_4e86_b4a6_0dacef723e27.slice/crio-83f2be810ec0b80dec7f6bc7d099ead345d2acca6b9d0de48a493dce5ae4a5e0 WatchSource:0}: Error finding container 83f2be810ec0b80dec7f6bc7d099ead345d2acca6b9d0de48a493dce5ae4a5e0: Status 404 returned error can't find the container with id 83f2be810ec0b80dec7f6bc7d099ead345d2acca6b9d0de48a493dce5ae4a5e0
Jul 09 20:03:32.552836 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.552798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:32.552973 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.552887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:32.553041 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.553022    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:32.553114 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.553092    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:03:34.55307464 +0000 UTC m=+6.037514621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:32.553525 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.553502    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:32.553649 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.553593    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret podName:e54656f1-7f4a-45df-baed-7d9ba120876c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:34.553558774 +0000 UTC m=+6.037998756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret") pod "global-pull-secret-syncer-nt2zq" (UID: "e54656f1-7f4a-45df-baed-7d9ba120876c") : object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:32.653762 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.653541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:32.653762 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.653733    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 20:03:32.653762 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.653752    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 20:03:32.653762 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.653765    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jjlzd for pod openshift-network-diagnostics/network-check-target-w9hkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:32.654075 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:32.653832    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd podName:0201a641-dec4-4448-8dc4-244f8e4a8eb9 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:34.653814186 +0000 UTC m=+6.138254183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjlzd" (UniqueName: "kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd") pod "network-check-target-w9hkk" (UID: "0201a641-dec4-4448-8dc4-244f8e4a8eb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:32.973121 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.972984    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 19:58:30 +0000 UTC" deadline="2028-03-16 17:02:16.129942272 +0000 UTC"
Jul 09 20:03:32.973121 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:32.973045    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14780h58m43.156901816s"
Jul 09 20:03:33.112102 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.111597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:33.112102 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:33.111728    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:33.137678 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.137640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"83f2be810ec0b80dec7f6bc7d099ead345d2acca6b9d0de48a493dce5ae4a5e0"}
Jul 09 20:03:33.147836 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.147800    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sfb7k" event={"ID":"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8","Type":"ContainerStarted","Data":"2087e56b2def1e826829def31a7adba1b8c231b0d6f2a98131f8210093687ce8"}
Jul 09 20:03:33.153343 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.153310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerStarted","Data":"bd56cb488c9e31b152a9e5e8ba3aebf06dc4d3acc6da4dbf01b9bdf171edca1e"}
Jul 09 20:03:33.158833 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.158805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sz6xk" event={"ID":"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462","Type":"ContainerStarted","Data":"68328297f3b47effbd9d5363569d3d922ebf0d536c4fe861f642d9706c4f2c49"}
Jul 09 20:03:33.170050 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.169368    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa6fa0e50e78b9ac1702f959fc0c02aa" containerID="7bcde14202e3901f285105bed0af817912e6063c805b8fa120650ad2fee4ebed" exitCode=0
Jul 09 20:03:33.170050 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.169734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" event={"ID":"aa6fa0e50e78b9ac1702f959fc0c02aa","Type":"ContainerDied","Data":"7bcde14202e3901f285105bed0af817912e6063c805b8fa120650ad2fee4ebed"}
Jul 09 20:03:33.177393 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.177363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" event={"ID":"51adeb82ef9cf7027b389777ed26ae92","Type":"ContainerStarted","Data":"766c465c733aad241fc1f4c758885a25d8acfc7e8846eeb9a886b0d28027e9be"}
Jul 09 20:03:33.180668 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.180644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9c6q" event={"ID":"cbfe789b-fa2d-453a-a5f4-9563e45ac656","Type":"ContainerStarted","Data":"6a2ed9f636711ef2f5bd2ef2d44e0f970c633f0ccccf07b70e7318b1d608548e"}
Jul 09 20:03:33.186305 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:33.186282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b" event={"ID":"89c454a1-8e1c-4606-875a-f9015cf3dfff","Type":"ContainerStarted","Data":"b2774c176f49c1ccd09e5dcc81fade0ff09d64bafa3a2f3298be3ac9ca26f17c"}
Jul 09 20:03:34.109616 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:34.108855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:34.109616 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.108997    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:34.109616 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:34.109443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:34.109616 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.109546    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:34.212882 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:34.212808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" event={"ID":"aa6fa0e50e78b9ac1702f959fc0c02aa","Type":"ContainerStarted","Data":"181ec3a94277a93ba26e6eadb17ac15793f6fc4a65854f3707e975eff0eb4143"}
Jul 09 20:03:34.228465 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:34.227654    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-14.ec2.internal" podStartSLOduration=4.227632174 podStartE2EDuration="4.227632174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:33.196058166 +0000 UTC m=+4.680498167" watchObservedRunningTime="2026-07-09 20:03:34.227632174 +0000 UTC m=+5.712072177"
Jul 09 20:03:34.572726 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:34.572643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:34.572726 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:34.572711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:34.572947 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.572862    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:34.572947 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.572928    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret podName:e54656f1-7f4a-45df-baed-7d9ba120876c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:38.572908012 +0000 UTC m=+10.057348016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret") pod "global-pull-secret-syncer-nt2zq" (UID: "e54656f1-7f4a-45df-baed-7d9ba120876c") : object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:34.573512 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.573325    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:34.573512 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.573386    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:03:38.573368795 +0000 UTC m=+10.057808775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:34.673273 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:34.673236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:34.673464 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.673405    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 20:03:34.673464 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.673426    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 20:03:34.673464 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.673438    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jjlzd for pod openshift-network-diagnostics/network-check-target-w9hkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:34.673656 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:34.673496    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd podName:0201a641-dec4-4448-8dc4-244f8e4a8eb9 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:38.673477832 +0000 UTC m=+10.157917824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjlzd" (UniqueName: "kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd") pod "network-check-target-w9hkk" (UID: "0201a641-dec4-4448-8dc4-244f8e4a8eb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:35.111827 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:35.111342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:35.111827 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:35.111472    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:36.109421 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:36.109390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:36.109421 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:36.109420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:36.109667 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:36.109513    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:36.109667 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:36.109644    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:37.108928 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:37.108844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:37.109343 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:37.108973    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:38.109757 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:38.109707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:38.110267 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.109848    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:38.110366 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:38.110270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:38.110366 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.110350    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:38.605114 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:38.605023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:38.605114 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:38.605086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:38.605337 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.605189    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:38.605337 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.605194    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:38.605337 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.605280    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret podName:e54656f1-7f4a-45df-baed-7d9ba120876c nodeName:}" failed. No retries permitted until 2026-07-09 20:03:46.605261464 +0000 UTC m=+18.089701442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret") pod "global-pull-secret-syncer-nt2zq" (UID: "e54656f1-7f4a-45df-baed-7d9ba120876c") : object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:38.605337 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.605299    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:03:46.605289034 +0000 UTC m=+18.089729016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:38.706054 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:38.706018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:38.706258 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.706179    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 20:03:38.706258 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.706198    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 20:03:38.706258 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.706228    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jjlzd for pod openshift-network-diagnostics/network-check-target-w9hkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:38.706396 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:38.706289    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd podName:0201a641-dec4-4448-8dc4-244f8e4a8eb9 nodeName:}" failed. No retries permitted until 2026-07-09 20:03:46.706266891 +0000 UTC m=+18.190706869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjlzd" (UniqueName: "kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd") pod "network-check-target-w9hkk" (UID: "0201a641-dec4-4448-8dc4-244f8e4a8eb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:39.111633 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:39.111599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:39.112069 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:39.111689    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:40.109695 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:40.109655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:40.109695 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:40.109690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:40.109891 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:40.109790    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:40.109951 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:40.109909    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:41.109081 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:41.109047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:41.109583 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:41.109237    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:42.108983 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:42.108946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:42.109172 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:42.108957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:42.109172 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:42.109069    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:42.109172 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:42.109114    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:43.109803 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.109460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:43.110265 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:43.109925    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:43.231283 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.231168    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b0228b-9a43-413f-afb7-c839f9e9713b" containerID="6a6c3010dfe8e461956ae67fdafbcb48384299f4b678ee4860a94a238acad830" exitCode=0
Jul 09 20:03:43.231437 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.231284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerDied","Data":"6a6c3010dfe8e461956ae67fdafbcb48384299f4b678ee4860a94a238acad830"}
Jul 09 20:03:43.235807 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.235687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sz6xk" event={"ID":"c05bdbf2-ce55-4ba9-be59-3f11e1a9f462","Type":"ContainerStarted","Data":"7708b7cb10cfee7a019ff9670149d8e4b00296277367ab22eb6e9e1489afb321"}
Jul 09 20:03:43.240260 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.240233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t2sg7" event={"ID":"5fc880f4-8c16-459c-8ca8-c2f1e08f35aa","Type":"ContainerStarted","Data":"c630432b05e231b53c617ee63a87d18d878e1a8ece3b2900a04684064d62e9e6"}
Jul 09 20:03:43.242707 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.242681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b" event={"ID":"89c454a1-8e1c-4606-875a-f9015cf3dfff","Type":"ContainerStarted","Data":"b7140442098257cecfe417fe0239c1526266a0ad1140861f793ba1d3b75bea04"}
Jul 09 20:03:43.244985 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.244958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kqnm9" event={"ID":"410bcb74-59c1-476b-ac5e-cbb8fe5fe94d","Type":"ContainerStarted","Data":"8549782ac4c98707b0207b72ff794ce5002f2610ff4c6a1202db1776d0f0b238"}
Jul 09 20:03:43.248394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.248371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sfb7k" event={"ID":"f6955bbb-5870-4a78-9a96-f0bd49a7e5f8","Type":"ContainerStarted","Data":"2a2b620dfb57d5c1434fe6ee2155e293cc37000d0890484c0769ebb9b1e2d77a"}
Jul 09 20:03:43.254471 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.254434    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-14.ec2.internal" podStartSLOduration=13.254422294 podStartE2EDuration="13.254422294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:34.228433095 +0000 UTC m=+5.712873096" watchObservedRunningTime="2026-07-09 20:03:43.254422294 +0000 UTC m=+14.738862292"
Jul 09 20:03:43.265865 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.265820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kqnm9" podStartSLOduration=3.204448976 podStartE2EDuration="14.265804141s" totalImagesPullingTime="11.061355165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:43.265703914 +0000 UTC m=+14.750143916" watchObservedRunningTime="2026-07-09 20:03:43.265804141 +0000 UTC m=+14.750244142"
Jul 09 20:03:43.279192 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.279141    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t2sg7" podStartSLOduration=3.209033475 podStartE2EDuration="14.279121352s" totalImagesPullingTime="11.070087877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:43.278083082 +0000 UTC m=+14.762523083" watchObservedRunningTime="2026-07-09 20:03:43.279121352 +0000 UTC m=+14.763561355"
Jul 09 20:03:43.314748 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.314690    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sfb7k" podStartSLOduration=4.262763004 podStartE2EDuration="14.314659054s" totalImagesPullingTime="10.05189605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:43.314573535 +0000 UTC m=+14.799013537" watchObservedRunningTime="2026-07-09 20:03:43.314659054 +0000 UTC m=+14.799099055"
Jul 09 20:03:43.315118 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.315088    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sz6xk" podStartSLOduration=4.046550543 podStartE2EDuration="14.315076607s" totalImagesPullingTime="10.268526064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:43.298165233 +0000 UTC m=+14.782605234" watchObservedRunningTime="2026-07-09 20:03:43.315076607 +0000 UTC m=+14.799516608"
Jul 09 20:03:43.898572 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.898532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:43.899150 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:43.899128    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:44.109793 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:44.109301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:44.109793 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:44.109339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:44.109793 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:44.109432    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:44.109793 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:44.109550    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:44.252820 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:44.252687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l9x6p" event={"ID":"c6355eac-c7d8-4d12-beb7-93c0f2b7dcde","Type":"ContainerStarted","Data":"0ef763d9b6cd250e03a399299dd841169811bf9d4369d5ccacfeb36371e91fca"}
Jul 09 20:03:44.253249 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:44.253070    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:44.253916 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:44.253895    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sfb7k"
Jul 09 20:03:44.269391 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:44.269341    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l9x6p" podStartSLOduration=4.191302299 podStartE2EDuration="15.269321894s" totalImagesPullingTime="11.078019595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:44.269223425 +0000 UTC m=+15.753663419" watchObservedRunningTime="2026-07-09 20:03:44.269321894 +0000 UTC m=+15.753761896"
Jul 09 20:03:45.108906 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:45.108861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:45.109069 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:45.109007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:46.109141 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:46.109102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:46.109800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:46.109322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:46.109800 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.109420    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:46.109800 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.109469    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:46.667537 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:46.667501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:46.667816 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:46.667568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:46.667816 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.667678    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:46.667816 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.667680    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:46.667816 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.667750    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:04:02.667729182 +0000 UTC m=+34.152169163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:03:46.667816 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.667769    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret podName:e54656f1-7f4a-45df-baed-7d9ba120876c nodeName:}" failed. No retries permitted until 2026-07-09 20:04:02.667760111 +0000 UTC m=+34.152200094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret") pod "global-pull-secret-syncer-nt2zq" (UID: "e54656f1-7f4a-45df-baed-7d9ba120876c") : object "kube-system"/"original-pull-secret" not registered
Jul 09 20:03:46.768549 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:46.768514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:46.768746 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.768723    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 20:03:46.768801 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.768757    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 20:03:46.768801 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.768771    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jjlzd for pod openshift-network-diagnostics/network-check-target-w9hkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:46.768898 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:46.768850    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd podName:0201a641-dec4-4448-8dc4-244f8e4a8eb9 nodeName:}" failed. No retries permitted until 2026-07-09 20:04:02.768820067 +0000 UTC m=+34.253260065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjlzd" (UniqueName: "kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd") pod "network-check-target-w9hkk" (UID: "0201a641-dec4-4448-8dc4-244f8e4a8eb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:03:47.111975 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:47.111944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:47.112533 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:47.112049    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:48.108855 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:48.108821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:48.109031 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:48.108957    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:48.109031 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:48.109005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:48.109131 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:48.109112    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:49.110407 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:49.110370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:49.110926 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:49.110506    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:50.109257 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:50.109035    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:50.109447 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:50.109063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:50.109447 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:50.109346    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:50.109447 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:50.109404    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:51.109853 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:51.109668    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:51.109853 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:51.109809    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:52.108608 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:52.108563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:52.108753 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:52.108618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:52.108753 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:52.108690    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:52.108832 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:52.108811    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:53.112363 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:53.112333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:53.112795 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:53.112448    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:54.072077 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.072051    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 20:03:54.109460 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.109436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:54.109595 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.109467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:54.109595 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:54.109579    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:54.109749 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:54.109721    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:54.273529 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.273492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9c6q" event={"ID":"cbfe789b-fa2d-453a-a5f4-9563e45ac656","Type":"ContainerStarted","Data":"00cf5c7d845449e7e0f55297e3d9e255ddf203051fff91cefbcb98a7d655592a"}
Jul 09 20:03:54.275251 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.275225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b" event={"ID":"89c454a1-8e1c-4606-875a-f9015cf3dfff","Type":"ContainerStarted","Data":"01273cad7a1e9d815108dc6235f015eb711d91784dfd83c802f5930aa8cabc40"}
Jul 09 20:03:54.276699 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.276595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:03:54.276922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.276899    2565 generic.go:356] "Generic (PLEG): container finished" podID="90d468c6-af6a-4e86-b4a6-0dacef723e27" containerID="9c2e70b8e7efabe8e4af5a534af1f45bce4c4bcab0b773cdd206ac2e340b143b" exitCode=1
Jul 09 20:03:54.276958 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.276929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerDied","Data":"9c2e70b8e7efabe8e4af5a534af1f45bce4c4bcab0b773cdd206ac2e340b143b"}
Jul 09 20:03:54.276986 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.276974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"9e5b129ff0a0b5ac5ad648259dd890d5caf998a1b8aef8ed1c65d3fa1688b433"}
Jul 09 20:03:54.296751 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.296702    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z9c6q" podStartSLOduration=5.223799276 podStartE2EDuration="25.296688276s" totalImagesPullingTime="20.072889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:54.296439571 +0000 UTC m=+25.780879573" watchObservedRunningTime="2026-07-09 20:03:54.296688276 +0000 UTC m=+25.781128326"
Jul 09 20:03:54.995559 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.995299    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T20:03:54.072074764Z","UUID":"fbdaeb72-0ecb-4ca7-b27c-300a3433cd19","Handler":null,"Name":"","Endpoint":""}
Jul 09 20:03:54.996848 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.996822    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 20:03:54.996961 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:54.996873    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 20:03:55.109484 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.109453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:55.109674 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:55.109626    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:55.283566 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.283488    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b0228b-9a43-413f-afb7-c839f9e9713b" containerID="bd0f551fefb81c023fa9239d6b093b98a7b10ad0f77fa8de724eff06c4a6420e" exitCode=0
Jul 09 20:03:55.284057 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.283557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerDied","Data":"bd0f551fefb81c023fa9239d6b093b98a7b10ad0f77fa8de724eff06c4a6420e"}
Jul 09 20:03:55.286367 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.286352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:03:55.286771 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.286731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"b75e392d8ea67448eb4612c0f8644523573761f090c22eec1de0f2b84fd988e6"}
Jul 09 20:03:55.286870 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.286812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"874765ee37a6f55b24e46b3c884ad4655d33b78bad4e6e913f70fcd1ea078775"}
Jul 09 20:03:55.286924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.286904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"9d83b78b5848d219e012347ce1bbc2294aa92d1dc726236d7b1b9b7c19c3c519"}
Jul 09 20:03:55.286966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:55.286945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"f9d55844e68fb13a9f9ec9899d64584b3ff8262fdb488b189d73bd7bd00f69da"}
Jul 09 20:03:56.109528 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:56.109493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:56.109528 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:56.109537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:56.109828 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:56.109660    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:56.109828 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:56.109722    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:56.290999 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:56.290969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b" event={"ID":"89c454a1-8e1c-4606-875a-f9015cf3dfff","Type":"ContainerStarted","Data":"bbe79860eebef598e45a96f6d4f5f90fd338fecdff3b2d46657283fc060f0eba"}
Jul 09 20:03:56.306888 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:56.306841    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7jj2b" podStartSLOduration=6.099544257 podStartE2EDuration="27.306826463s" totalImagesPullingTime="21.207282206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:03:56.305585685 +0000 UTC m=+27.790025685" watchObservedRunningTime="2026-07-09 20:03:56.306826463 +0000 UTC m=+27.791266463"
Jul 09 20:03:57.108752 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:57.108723    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:57.108971 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:57.108849    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:57.295805 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:57.295779    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:03:57.296182 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:57.296121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"d977283b50fe07f0a3a2d12e547c0ab68eb5d2b1cc882ea3826f7e3eecdc9044"}
Jul 09 20:03:57.298059 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:57.298036    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b0228b-9a43-413f-afb7-c839f9e9713b" containerID="6db9a174630ed671e1ffeab5e78de82099de6fc4a89a428c6dffaf9e5d76a4d5" exitCode=0
Jul 09 20:03:57.298168 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:57.298116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerDied","Data":"6db9a174630ed671e1ffeab5e78de82099de6fc4a89a428c6dffaf9e5d76a4d5"}
Jul 09 20:03:58.109110 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:58.109075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:03:58.109282 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:58.109189    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:03:58.109282 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:58.109245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:03:58.109401 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:58.109382    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:03:59.111930 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.111773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:03:59.112459 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:03:59.112022    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:03:59.304512 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.304404    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:03:59.304775 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.304744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"9db1b8055a27d34be5b090a9a6a8f9697ce1b8f6596addc17c3ba6c67ce52853"}
Jul 09 20:03:59.305049 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.305029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:03:59.305310 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.305285    2565 scope.go:117] "RemoveContainer" containerID="9c2e70b8e7efabe8e4af5a534af1f45bce4c4bcab0b773cdd206ac2e340b143b"
Jul 09 20:03:59.307309 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.307289    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b0228b-9a43-413f-afb7-c839f9e9713b" containerID="90ea56e8665e3ced1f2dcb5bb67efd2829837ef440aa0d3133aea84f9049feed" exitCode=0
Jul 09 20:03:59.307398 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.307329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerDied","Data":"90ea56e8665e3ced1f2dcb5bb67efd2829837ef440aa0d3133aea84f9049feed"}
Jul 09 20:03:59.323572 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:03:59.323549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:04:00.109140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.109104    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:04:00.109140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.109132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:00.109358 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:00.109249    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:04:00.109358 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:00.109282    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:04:00.314496 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.314415    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:04:00.315121 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.315039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" event={"ID":"90d468c6-af6a-4e86-b4a6-0dacef723e27","Type":"ContainerStarted","Data":"4af4fa294ac18c968098bc810efdba9f3198a31e966e8be628e7e511a4545ea4"}
Jul 09 20:04:00.316083 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.315559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:04:00.316083 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.315632    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:04:00.335642 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.335610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:04:00.344150 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:00.344093    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj" podStartSLOduration=9.646990002999999 podStartE2EDuration="31.344073526s" totalImagesPullingTime="21.697083523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:04:00.342137069 +0000 UTC m=+31.826577092" watchObservedRunningTime="2026-07-09 20:04:00.344073526 +0000 UTC m=+31.828513527"
Jul 09 20:04:01.037880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:01.037847    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nt2zq"]
Jul 09 20:04:01.038045 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:01.037967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:01.038106 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:01.038067    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:04:01.042006 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:01.041973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jtndh"]
Jul 09 20:04:01.042202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:01.042185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:04:01.042371 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:01.042348    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:04:01.055391 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:01.055368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w9hkk"]
Jul 09 20:04:01.055521 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:01.055496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:01.055746 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:01.055575    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:04:02.690551 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:02.690510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:04:02.691049 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:02.690588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:02.691049 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.690691    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 20:04:02.691049 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.690692    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:04:02.691049 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.690749    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret podName:e54656f1-7f4a-45df-baed-7d9ba120876c nodeName:}" failed. No retries permitted until 2026-07-09 20:04:34.690730857 +0000 UTC m=+66.175170839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret") pod "global-pull-secret-syncer-nt2zq" (UID: "e54656f1-7f4a-45df-baed-7d9ba120876c") : object "kube-system"/"original-pull-secret" not registered
Jul 09 20:04:02.691049 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.690767    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:04:34.69075853 +0000 UTC m=+66.175198510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 20:04:02.791865 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:02.791831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:02.792016 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.791999    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 20:04:02.792070 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.792023    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 20:04:02.792070 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.792033    2565 projected.go:196] Error preparing data for projected volume kube-api-access-jjlzd for pod openshift-network-diagnostics/network-check-target-w9hkk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:04:02.792132 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:02.792087    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd podName:0201a641-dec4-4448-8dc4-244f8e4a8eb9 nodeName:}" failed. No retries permitted until 2026-07-09 20:04:34.792072799 +0000 UTC m=+66.276512777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jjlzd" (UniqueName: "kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd") pod "network-check-target-w9hkk" (UID: "0201a641-dec4-4448-8dc4-244f8e4a8eb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 20:04:03.109683 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:03.109653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:04:03.109850 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:03.109775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:03.109850 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:03.109792    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:04:03.109978 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:03.109890    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:04:03.109978 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:03.109935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:03.110063 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:03.110008    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:04:04.328330 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:04.328051    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b0228b-9a43-413f-afb7-c839f9e9713b" containerID="fecd7c4a535c450462dcc05c71d05d634b554d0a4f71d90ab151a521d8524724" exitCode=0
Jul 09 20:04:04.328330 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:04.328137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerDied","Data":"fecd7c4a535c450462dcc05c71d05d634b554d0a4f71d90ab151a521d8524724"}
Jul 09 20:04:05.109456 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:05.109414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:04:05.109619 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:05.109418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:05.109619 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:05.109607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:05.109690 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:05.109615    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:04:05.109690 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:05.109676    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt2zq" podUID="e54656f1-7f4a-45df-baed-7d9ba120876c"
Jul 09 20:04:05.109830 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:05.109802    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w9hkk" podUID="0201a641-dec4-4448-8dc4-244f8e4a8eb9"
Jul 09 20:04:05.333202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:05.333171    2565 generic.go:356] "Generic (PLEG): container finished" podID="01b0228b-9a43-413f-afb7-c839f9e9713b" containerID="1c18e5248f0163663fed2f708089cdcaf73c8d1f17161f33b58c6016d91b871b" exitCode=0
Jul 09 20:04:05.333691 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:05.333234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerDied","Data":"1c18e5248f0163663fed2f708089cdcaf73c8d1f17161f33b58c6016d91b871b"}
Jul 09 20:04:06.339197 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.339153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s28c" event={"ID":"01b0228b-9a43-413f-afb7-c839f9e9713b","Type":"ContainerStarted","Data":"166e391da112bec4dc583ffa98f16fc7ba0bd44125420fbc97571accc75b2526"}
Jul 09 20:04:06.360713 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.360673    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9s28c" podStartSLOduration=9.224355284 podStartE2EDuration="37.360652566s" totalImagesPullingTime="28.136297282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:04:06.359200632 +0000 UTC m=+37.843640633" watchObservedRunningTime="2026-07-09 20:04:06.360652566 +0000 UTC m=+37.845092569"
Jul 09 20:04:06.804054 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.803976    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-14.ec2.internal" event="NodeReady"
Jul 09 20:04:06.804196 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.804108    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 20:04:06.841338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.841301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s4xnm"]
Jul 09 20:04:06.864921 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.864889    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7sm7q"]
Jul 09 20:04:06.865059 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.865001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:06.867080 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.867050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 20:04:06.867318 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.867304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lrpv\""
Jul 09 20:04:06.867419 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.867310    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 20:04:06.888615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.888591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:06.888615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.888609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4xnm"]
Jul 09 20:04:06.888763 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.888647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7sm7q"]
Jul 09 20:04:06.891178 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.891156    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 20:04:06.891351 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.891337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 20:04:06.891428 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.891415    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 20:04:06.891428 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:06.891423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-57xht\""
Jul 09 20:04:07.022704 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.022675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt7nk\" (UniqueName: \"kubernetes.io/projected/d8901041-35a4-4db0-bbbd-2c46ddc6a8fb-kube-api-access-nt7nk\") pod \"ingress-canary-7sm7q\" (UID: \"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb\") " pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:07.022991 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.022713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8901041-35a4-4db0-bbbd-2c46ddc6a8fb-cert\") pod \"ingress-canary-7sm7q\" (UID: \"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb\") " pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:07.022991 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.022758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a24ff45-361f-4666-8ae0-fe63706f0bab-tmp-dir\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.022991 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.022816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.022991 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.022861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a24ff45-361f-4666-8ae0-fe63706f0bab-config-volume\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.022991 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.022893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snx96\" (UniqueName: \"kubernetes.io/projected/8a24ff45-361f-4666-8ae0-fe63706f0bab-kube-api-access-snx96\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.109518 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.109480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:07.109643 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.109480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:04:07.109690 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.109480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:07.112077 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.112050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 20:04:07.112077 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.112063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 20:04:07.112972 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.112949    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 20:04:07.113067 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.112986    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s29qd\""
Jul 09 20:04:07.113067 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.113000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kv5k8\""
Jul 09 20:04:07.113187 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.113108    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 20:04:07.123440 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.123419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snx96\" (UniqueName: \"kubernetes.io/projected/8a24ff45-361f-4666-8ae0-fe63706f0bab-kube-api-access-snx96\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.123504 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.123460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt7nk\" (UniqueName: \"kubernetes.io/projected/d8901041-35a4-4db0-bbbd-2c46ddc6a8fb-kube-api-access-nt7nk\") pod \"ingress-canary-7sm7q\" (UID: \"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb\") " pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:07.123555 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.123505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8901041-35a4-4db0-bbbd-2c46ddc6a8fb-cert\") pod \"ingress-canary-7sm7q\" (UID: \"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb\") " pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:07.123595 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.123571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a24ff45-361f-4666-8ae0-fe63706f0bab-tmp-dir\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.123640 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.123602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.123686 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.123638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a24ff45-361f-4666-8ae0-fe63706f0bab-config-volume\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.123732 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:07.123707    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:04:07.123782 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:07.123759    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:04:07.623744173 +0000 UTC m=+39.108184152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:04:07.123892 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.123876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a24ff45-361f-4666-8ae0-fe63706f0bab-tmp-dir\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.124282 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.124261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a24ff45-361f-4666-8ae0-fe63706f0bab-config-volume\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.128230 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.128188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8901041-35a4-4db0-bbbd-2c46ddc6a8fb-cert\") pod \"ingress-canary-7sm7q\" (UID: \"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb\") " pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:07.133318 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.133297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snx96\" (UniqueName: \"kubernetes.io/projected/8a24ff45-361f-4666-8ae0-fe63706f0bab-kube-api-access-snx96\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.134090 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.134072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt7nk\" (UniqueName: \"kubernetes.io/projected/d8901041-35a4-4db0-bbbd-2c46ddc6a8fb-kube-api-access-nt7nk\") pod \"ingress-canary-7sm7q\" (UID: \"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb\") " pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:07.196251 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.196201    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7sm7q"
Jul 09 20:04:07.369193 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.368965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7sm7q"]
Jul 09 20:04:07.372274 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:04:07.372251    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8901041_35a4_4db0_bbbd_2c46ddc6a8fb.slice/crio-b4675a359312ba6075b44582708ed43d52888f057081d0183954992ba1f2713b WatchSource:0}: Error finding container b4675a359312ba6075b44582708ed43d52888f057081d0183954992ba1f2713b: Status 404 returned error can't find the container with id b4675a359312ba6075b44582708ed43d52888f057081d0183954992ba1f2713b
Jul 09 20:04:07.627253 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:07.627145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:07.627419 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:07.627341    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:04:07.627419 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:07.627408    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:04:08.627392794 +0000 UTC m=+40.111832774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:04:08.345231 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:08.345171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7sm7q" event={"ID":"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb","Type":"ContainerStarted","Data":"b4675a359312ba6075b44582708ed43d52888f057081d0183954992ba1f2713b"}
Jul 09 20:04:08.635520 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:08.635433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:08.635948 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:08.635587    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:04:08.635948 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:08.635663    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:04:10.635641337 +0000 UTC m=+42.120081334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:04:10.351502 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:10.351457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7sm7q" event={"ID":"d8901041-35a4-4db0-bbbd-2c46ddc6a8fb","Type":"ContainerStarted","Data":"095924c82d3d7054ec53c49ef9c7fd4806d4a3b9ab728c06fbc983526629f726"}
Jul 09 20:04:10.367980 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:10.367915    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7sm7q" podStartSLOduration=1.585568812 podStartE2EDuration="4.367895011s" totalImagesPullingTime="2.782326199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:04:10.367392519 +0000 UTC m=+41.851832524" watchObservedRunningTime="2026-07-09 20:04:10.367895011 +0000 UTC m=+41.852335012"
Jul 09 20:04:10.650704 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:10.650653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:10.650879 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:10.650809    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:04:10.650879 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:10.650877    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:04:14.650860511 +0000 UTC m=+46.135300489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:04:14.679771 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:14.679735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:14.680154 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:14.679910    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:04:14.680154 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:14.679978    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:04:22.679962944 +0000 UTC m=+54.164402922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:04:22.734232 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:22.734004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:22.734694 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:22.734170    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:04:22.734694 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:22.734321    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:04:38.734305902 +0000 UTC m=+70.218745881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:04:32.331624 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:32.331595    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h4fcj"
Jul 09 20:04:34.719402 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.719360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:04:34.719786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.719418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:34.721748 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.721724    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 20:04:34.721835 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.721760    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 20:04:34.729976 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:34.729953    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 20:04:34.730091 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:34.730027    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:05:38.730006074 +0000 UTC m=+130.214446066 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : secret "metrics-daemon-secret" not found
Jul 09 20:04:34.733858 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.733839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e54656f1-7f4a-45df-baed-7d9ba120876c-original-pull-secret\") pod \"global-pull-secret-syncer-nt2zq\" (UID: \"e54656f1-7f4a-45df-baed-7d9ba120876c\") " pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:34.820406 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.820365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:34.822879 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.822860    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 20:04:34.834286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.834262    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 20:04:34.844392 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:34.844366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlzd\" (UniqueName: \"kubernetes.io/projected/0201a641-dec4-4448-8dc4-244f8e4a8eb9-kube-api-access-jjlzd\") pod \"network-check-target-w9hkk\" (UID: \"0201a641-dec4-4448-8dc4-244f8e4a8eb9\") " pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:35.019527 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:35.019448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt2zq"
Jul 09 20:04:35.036984 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:35.036958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kv5k8\""
Jul 09 20:04:35.043965 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:35.043943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:35.173704 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:35.173672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nt2zq"]
Jul 09 20:04:35.191763 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:35.191741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w9hkk"]
Jul 09 20:04:35.194668 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:04:35.194646    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0201a641_dec4_4448_8dc4_244f8e4a8eb9.slice/crio-2c353e944c2c3cf366a09830fd15b4f323bc366f1954c1e860df4527b74b7001 WatchSource:0}: Error finding container 2c353e944c2c3cf366a09830fd15b4f323bc366f1954c1e860df4527b74b7001: Status 404 returned error can't find the container with id 2c353e944c2c3cf366a09830fd15b4f323bc366f1954c1e860df4527b74b7001
Jul 09 20:04:35.407833 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:35.407797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w9hkk" event={"ID":"0201a641-dec4-4448-8dc4-244f8e4a8eb9","Type":"ContainerStarted","Data":"2c353e944c2c3cf366a09830fd15b4f323bc366f1954c1e860df4527b74b7001"}
Jul 09 20:04:35.408881 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:35.408858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nt2zq" event={"ID":"e54656f1-7f4a-45df-baed-7d9ba120876c","Type":"ContainerStarted","Data":"e6fae423aa00d644a30d48469aaa20fe8f794a50d896c5679cc6549d52c98ba2"}
Jul 09 20:04:38.748333 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:38.748288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:04:38.748802 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:38.748444    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:04:38.748802 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:04:38.748521    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:05:10.748502141 +0000 UTC m=+102.232942140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:04:41.425889 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:41.425831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w9hkk" event={"ID":"0201a641-dec4-4448-8dc4-244f8e4a8eb9","Type":"ContainerStarted","Data":"a2ca16c05ac14891d35e4dcea30225d2a742c807ab9debadc3082677e310b618"}
Jul 09 20:04:41.426356 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:41.425944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:04:41.427038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:41.427014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nt2zq" event={"ID":"e54656f1-7f4a-45df-baed-7d9ba120876c","Type":"ContainerStarted","Data":"8a94f810783d9999cb117c2706d032819fea42070fe43009ff60cc4b91537cfd"}
Jul 09 20:04:41.442536 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:41.442493    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w9hkk" podStartSLOduration=67.233276676 podStartE2EDuration="1m12.442479746s" totalImagesPullingTime="5.20920307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:04:41.441931645 +0000 UTC m=+72.926371656" watchObservedRunningTime="2026-07-09 20:04:41.442479746 +0000 UTC m=+72.926919745"
Jul 09 20:04:41.458405 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:04:41.458360    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nt2zq" podStartSLOduration=67.22780645 podStartE2EDuration="1m12.458347223s" totalImagesPullingTime="5.230540773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:04:41.458175154 +0000 UTC m=+72.942615146" watchObservedRunningTime="2026-07-09 20:04:41.458347223 +0000 UTC m=+72.942787221"
Jul 09 20:05:10.764467 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:05:10.764426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:05:10.764870 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:05:10.764588    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:05:10.764870 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:05:10.764663    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:06:14.764643708 +0000 UTC m=+166.249083689 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:05:12.431479 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:05:12.431448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w9hkk"
Jul 09 20:05:38.753682 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:05:38.753623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:05:38.754149 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:05:38.753781    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 20:05:38.754149 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:05:38.753876    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs podName:1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff nodeName:}" failed. No retries permitted until 2026-07-09 20:07:40.753860023 +0000 UTC m=+252.238300002 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs") pod "network-metrics-daemon-jtndh" (UID: "1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff") : secret "metrics-daemon-secret" not found
Jul 09 20:06:09.874311 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:06:09.874250    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s4xnm" podUID="8a24ff45-361f-4666-8ae0-fe63706f0bab"
Jul 09 20:06:10.125741 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:06:10.125647    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jtndh" podUID="1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff"
Jul 09 20:06:10.635047 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:06:10.635017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:06:14.790657 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:06:14.790612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:06:14.791043 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:06:14.790742    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 20:06:14.791043 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:06:14.790810    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls podName:8a24ff45-361f-4666-8ae0-fe63706f0bab nodeName:}" failed. No retries permitted until 2026-07-09 20:08:16.790792026 +0000 UTC m=+288.275232028 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls") pod "dns-default-s4xnm" (UID: "8a24ff45-361f-4666-8ae0-fe63706f0bab") : secret "dns-default-metrics-tls" not found
Jul 09 20:06:23.109568 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:06:23.109470    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:07:15.188850 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.188816    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c99d8d86b-z4c6d"]
Jul 09 20:07:15.190854 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.190834    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"]
Jul 09 20:07:15.190979 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.190958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.192472 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.192454    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"]
Jul 09 20:07:15.192592 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.192563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.196629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.194022    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 20:07:15.196629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.194055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 20:07:15.196629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.194111    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 20:07:15.196629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.196056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x2x88\""
Jul 09 20:07:15.196629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.196111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.196629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.196315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 20:07:15.197806 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.197782    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 20:07:15.198978 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.198960    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 20:07:15.199054 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.198969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 20:07:15.199293 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.199280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9cv67\""
Jul 09 20:07:15.201021 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.201003    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 20:07:15.201137 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.201052    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 20:07:15.201137 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.201010    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 20:07:15.201568 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.201551    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 20:07:15.201696 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.201571    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 20:07:15.201765 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.201694    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wwf6v\""
Jul 09 20:07:15.214275 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.214254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"]
Jul 09 20:07:15.218973 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.218952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"]
Jul 09 20:07:15.219711 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.219679    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c99d8d86b-z4c6d"]
Jul 09 20:07:15.274229 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.274180    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"]
Jul 09 20:07:15.276093 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.276077    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"
Jul 09 20:07:15.277248 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.277226    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dhxkj"]
Jul 09 20:07:15.278331 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.278314    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 20:07:15.278679 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.278667    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 20:07:15.279004 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.278991    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.279307 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.279180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qtkwq\""
Jul 09 20:07:15.281911 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.281889    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 20:07:15.282015 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.281909    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 20:07:15.282015 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.281997    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 20:07:15.282121 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.282019    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 20:07:15.282243 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.282229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nnvlw\""
Jul 09 20:07:15.288833 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.288812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"]
Jul 09 20:07:15.289770 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.289499    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 20:07:15.292741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.292717    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dhxkj"]
Jul 09 20:07:15.312223 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.312325 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-ca-trust-extracted\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.312325 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc350c8b-482e-473a-8426-dd3f5eb125ff-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.312325 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5rn6\" (UniqueName: \"kubernetes.io/projected/a210567a-7e11-4ddc-b0b0-a2a84accfb77-kube-api-access-j5rn6\") pod \"volume-data-source-validator-78495597f6-2qq5n\" (UID: \"a210567a-7e11-4ddc-b0b0-a2a84accfb77\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"
Jul 09 20:07:15.312325 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc350c8b-482e-473a-8426-dd3f5eb125ff-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.312500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrvgk\" (UniqueName: \"kubernetes.io/projected/dc350c8b-482e-473a-8426-dd3f5eb125ff-kube-api-access-lrvgk\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.312500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.312500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw5j5\" (UniqueName: \"kubernetes.io/projected/f7049af2-0619-4a88-ad90-e041f2bd3c5c-kube-api-access-lw5j5\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.312500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5d64\" (UniqueName: \"kubernetes.io/projected/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-kube-api-access-s5d64\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.312500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv8rp\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-kube-api-access-zv8rp\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.312500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-trusted-ca\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-bound-sa-token\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-image-registry-private-configuration\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc350c8b-482e-473a-8426-dd3f5eb125ff-tmp\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-installation-pull-secrets\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7049af2-0619-4a88-ad90-e041f2bd3c5c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc350c8b-482e-473a-8426-dd3f5eb125ff-serving-cert\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc350c8b-482e-473a-8426-dd3f5eb125ff-snapshots\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7049af2-0619-4a88-ad90-e041f2bd3c5c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.312721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.312705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-certificates\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.413671 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv8rp\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-kube-api-access-zv8rp\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.413671 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.413923 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-trusted-ca\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.413923 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-bound-sa-token\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.413923 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-image-registry-private-configuration\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.413923 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc350c8b-482e-473a-8426-dd3f5eb125ff-tmp\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.413923 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-installation-pull-secrets\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.413923 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7049af2-0619-4a88-ad90-e041f2bd3c5c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.413923 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.413819    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 20:07:15.414313 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.414054    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c99d8d86b-z4c6d: secret "image-registry-tls" not found
Jul 09 20:07:15.414313 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.414136    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls podName:9bf2fd50-8de7-4577-8f72-c5a0626c8ea0 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:15.914114006 +0000 UTC m=+227.398554002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls") pod "image-registry-7c99d8d86b-z4c6d" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0") : secret "image-registry-tls" not found
Jul 09 20:07:15.414313 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc350c8b-482e-473a-8426-dd3f5eb125ff-tmp\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.414313 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.413825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc350c8b-482e-473a-8426-dd3f5eb125ff-serving-cert\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.414313 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc350c8b-482e-473a-8426-dd3f5eb125ff-snapshots\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7049af2-0619-4a88-ad90-e041f2bd3c5c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-certificates\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-ca-trust-extracted\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc350c8b-482e-473a-8426-dd3f5eb125ff-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5rn6\" (UniqueName: \"kubernetes.io/projected/a210567a-7e11-4ddc-b0b0-a2a84accfb77-kube-api-access-j5rn6\") pod \"volume-data-source-validator-78495597f6-2qq5n\" (UID: \"a210567a-7e11-4ddc-b0b0-a2a84accfb77\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc350c8b-482e-473a-8426-dd3f5eb125ff-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrvgk\" (UniqueName: \"kubernetes.io/projected/dc350c8b-482e-473a-8426-dd3f5eb125ff-kube-api-access-lrvgk\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw5j5\" (UniqueName: \"kubernetes.io/projected/f7049af2-0619-4a88-ad90-e041f2bd3c5c-kube-api-access-lw5j5\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5d64\" (UniqueName: \"kubernetes.io/projected/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-kube-api-access-s5d64\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.414750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.414735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-trusted-ca\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.415529 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.415082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dc350c8b-482e-473a-8426-dd3f5eb125ff-snapshots\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.415596 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.415569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-certificates\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.415676 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.415645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc350c8b-482e-473a-8426-dd3f5eb125ff-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.415676 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.415668    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:15.415804 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.415720    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls podName:954d6a6b-f906-44f8-ba04-3d8194e1f7ff nodeName:}" failed. No retries permitted until 2026-07-09 20:07:15.915705332 +0000 UTC m=+227.400145311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pcq8x" (UID: "954d6a6b-f906-44f8-ba04-3d8194e1f7ff") : secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:15.415804 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.415740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc350c8b-482e-473a-8426-dd3f5eb125ff-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.416016 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.415987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-ca-trust-extracted\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.416131 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.416098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.416312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.416293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7049af2-0619-4a88-ad90-e041f2bd3c5c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.416774 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.416750    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc350c8b-482e-473a-8426-dd3f5eb125ff-serving-cert\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.416846 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.416786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7049af2-0619-4a88-ad90-e041f2bd3c5c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.416846 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.416809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-installation-pull-secrets\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.417509 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.417493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-image-registry-private-configuration\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.423131 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.423093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-bound-sa-token\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.423262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.423174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv8rp\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-kube-api-access-zv8rp\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.423367 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.423337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5rn6\" (UniqueName: \"kubernetes.io/projected/a210567a-7e11-4ddc-b0b0-a2a84accfb77-kube-api-access-j5rn6\") pod \"volume-data-source-validator-78495597f6-2qq5n\" (UID: \"a210567a-7e11-4ddc-b0b0-a2a84accfb77\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"
Jul 09 20:07:15.423981 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.423936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrvgk\" (UniqueName: \"kubernetes.io/projected/dc350c8b-482e-473a-8426-dd3f5eb125ff-kube-api-access-lrvgk\") pod \"insights-operator-68d9dd94cf-dhxkj\" (UID: \"dc350c8b-482e-473a-8426-dd3f5eb125ff\") " pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.423981 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.423939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5d64\" (UniqueName: \"kubernetes.io/projected/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-kube-api-access-s5d64\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.424130 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.424064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw5j5\" (UniqueName: \"kubernetes.io/projected/f7049af2-0619-4a88-ad90-e041f2bd3c5c-kube-api-access-lw5j5\") pod \"kube-storage-version-migrator-operator-799cb7f958-tl8sh\" (UID: \"f7049af2-0619-4a88-ad90-e041f2bd3c5c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.515609 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.515515    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"
Jul 09 20:07:15.586188 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.586161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"
Jul 09 20:07:15.591917 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.591895    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj"
Jul 09 20:07:15.642301 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.642258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh"]
Jul 09 20:07:15.645307 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:15.645275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7049af2_0619_4a88_ad90_e041f2bd3c5c.slice/crio-628d7480fc1f7294af06a72aa3d3778a2b28beb53818040e74d42256a9b9a3b0 WatchSource:0}: Error finding container 628d7480fc1f7294af06a72aa3d3778a2b28beb53818040e74d42256a9b9a3b0: Status 404 returned error can't find the container with id 628d7480fc1f7294af06a72aa3d3778a2b28beb53818040e74d42256a9b9a3b0
Jul 09 20:07:15.728509 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.728475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-dhxkj"]
Jul 09 20:07:15.731657 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:15.731630    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc350c8b_482e_473a_8426_dd3f5eb125ff.slice/crio-278165eaea222d247e437d80f13444d95605d92739c79d6a9e92e38fc6176e1d WatchSource:0}: Error finding container 278165eaea222d247e437d80f13444d95605d92739c79d6a9e92e38fc6176e1d: Status 404 returned error can't find the container with id 278165eaea222d247e437d80f13444d95605d92739c79d6a9e92e38fc6176e1d
Jul 09 20:07:15.746827 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.746803    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n"]
Jul 09 20:07:15.749500 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:15.749477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda210567a_7e11_4ddc_b0b0_a2a84accfb77.slice/crio-28a3d2bc7d24fb26e9a88ec6c2277ecb0a1d95f92309967d485e51d3d11afcce WatchSource:0}: Error finding container 28a3d2bc7d24fb26e9a88ec6c2277ecb0a1d95f92309967d485e51d3d11afcce: Status 404 returned error can't find the container with id 28a3d2bc7d24fb26e9a88ec6c2277ecb0a1d95f92309967d485e51d3d11afcce
Jul 09 20:07:15.788908 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.788841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj" event={"ID":"dc350c8b-482e-473a-8426-dd3f5eb125ff","Type":"ContainerStarted","Data":"278165eaea222d247e437d80f13444d95605d92739c79d6a9e92e38fc6176e1d"}
Jul 09 20:07:15.789926 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.789905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n" event={"ID":"a210567a-7e11-4ddc-b0b0-a2a84accfb77","Type":"ContainerStarted","Data":"28a3d2bc7d24fb26e9a88ec6c2277ecb0a1d95f92309967d485e51d3d11afcce"}
Jul 09 20:07:15.790946 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.790926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh" event={"ID":"f7049af2-0619-4a88-ad90-e041f2bd3c5c","Type":"ContainerStarted","Data":"628d7480fc1f7294af06a72aa3d3778a2b28beb53818040e74d42256a9b9a3b0"}
Jul 09 20:07:15.919944 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.919910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:15.919944 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:15.919950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:15.920139 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.920072    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 20:07:15.920139 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.920069    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:15.920139 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.920084    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c99d8d86b-z4c6d: secret "image-registry-tls" not found
Jul 09 20:07:15.920139 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.920141    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls podName:954d6a6b-f906-44f8-ba04-3d8194e1f7ff nodeName:}" failed. No retries permitted until 2026-07-09 20:07:16.920126915 +0000 UTC m=+228.404566893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pcq8x" (UID: "954d6a6b-f906-44f8-ba04-3d8194e1f7ff") : secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:15.920367 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:15.920157    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls podName:9bf2fd50-8de7-4577-8f72-c5a0626c8ea0 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:16.920150553 +0000 UTC m=+228.404590531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls") pod "image-registry-7c99d8d86b-z4c6d" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0") : secret "image-registry-tls" not found
Jul 09 20:07:16.926941 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:16.926899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:16.927431 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:16.926949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:16.927431 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:16.927046    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:16.927431 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:16.927124    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls podName:954d6a6b-f906-44f8-ba04-3d8194e1f7ff nodeName:}" failed. No retries permitted until 2026-07-09 20:07:18.927105938 +0000 UTC m=+230.411545935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pcq8x" (UID: "954d6a6b-f906-44f8-ba04-3d8194e1f7ff") : secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:16.927431 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:16.927048    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 20:07:16.927431 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:16.927170    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c99d8d86b-z4c6d: secret "image-registry-tls" not found
Jul 09 20:07:16.927431 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:16.927238    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls podName:9bf2fd50-8de7-4577-8f72-c5a0626c8ea0 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:18.927225443 +0000 UTC m=+230.411665421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls") pod "image-registry-7c99d8d86b-z4c6d" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0") : secret "image-registry-tls" not found
Jul 09 20:07:17.798418 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:17.798375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n" event={"ID":"a210567a-7e11-4ddc-b0b0-a2a84accfb77","Type":"ContainerStarted","Data":"b2fab90e111b1f280d4a066323e45153e64c3cc875753117c85da4aa85c14434"}
Jul 09 20:07:17.814254 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:17.814186    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-2qq5n" podStartSLOduration=1.485668683 podStartE2EDuration="2.814168415s" totalImagesPullingTime="1.328499732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:17.81229712 +0000 UTC m=+229.296737122" watchObservedRunningTime="2026-07-09 20:07:17.814168415 +0000 UTC m=+229.298608416"
Jul 09 20:07:18.802875 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:18.802790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh" event={"ID":"f7049af2-0619-4a88-ad90-e041f2bd3c5c","Type":"ContainerStarted","Data":"e7ce91bcb18662d960f5931ecd868f95f06beee887c2759a03132bf39e781d27"}
Jul 09 20:07:18.817567 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:18.817523    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh" podStartSLOduration=1.372772518 podStartE2EDuration="3.817505898s" totalImagesPullingTime="2.44473338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:18.817472801 +0000 UTC m=+230.301912807" watchObservedRunningTime="2026-07-09 20:07:18.817505898 +0000 UTC m=+230.301945899"
Jul 09 20:07:18.947431 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:18.947391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:18.947606 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:18.947446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:18.947606 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:18.947551    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:18.947606 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:18.947594    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 20:07:18.947705 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:18.947612    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c99d8d86b-z4c6d: secret "image-registry-tls" not found
Jul 09 20:07:18.947705 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:18.947637    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls podName:954d6a6b-f906-44f8-ba04-3d8194e1f7ff nodeName:}" failed. No retries permitted until 2026-07-09 20:07:22.947616018 +0000 UTC m=+234.432055998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pcq8x" (UID: "954d6a6b-f906-44f8-ba04-3d8194e1f7ff") : secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:18.947705 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:18.947658    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls podName:9bf2fd50-8de7-4577-8f72-c5a0626c8ea0 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:22.94764422 +0000 UTC m=+234.432084198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls") pod "image-registry-7c99d8d86b-z4c6d" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0") : secret "image-registry-tls" not found
Jul 09 20:07:19.809673 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:19.809631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj" event={"ID":"dc350c8b-482e-473a-8426-dd3f5eb125ff","Type":"ContainerStarted","Data":"a25f1ff09f4f5b42a673729273c0e0ac54ee23aeceb1792494f39e7c07ea5bab"}
Jul 09 20:07:19.824911 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:19.824859    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj" podStartSLOduration=1.767677304 podStartE2EDuration="4.824843095s" totalImagesPullingTime="3.057165791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:19.824149883 +0000 UTC m=+231.308589886" watchObservedRunningTime="2026-07-09 20:07:19.824843095 +0000 UTC m=+231.309283095"
Jul 09 20:07:20.056831 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.056799    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pwkwd"]
Jul 09 20:07:20.058991 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.058969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.061484 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.061404    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 20:07:20.061484 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.061414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 20:07:20.061619 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.061417    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6wftc\""
Jul 09 20:07:20.070135 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.070110    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pwkwd"]
Jul 09 20:07:20.158033 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.157992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-data-volume\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.158184 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.158047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-crio-socket\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.158184 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.158134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.158184 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.158164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.158317 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.158248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4dkj\" (UniqueName: \"kubernetes.io/projected/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-api-access-m4dkj\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.259060 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.259022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-crio-socket\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.259202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.259084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.259202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.259109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.259202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.259155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-crio-socket\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.259202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.259170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4dkj\" (UniqueName: \"kubernetes.io/projected/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-api-access-m4dkj\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.259376 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.259236    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:20.259376 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.259252    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 20:07:20.259376 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.259269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-data-volume\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.259376 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.259303    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:20.759281937 +0000 UTC m=+232.243721915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:20.259376 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.259322    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:20.759312206 +0000 UTC m=+232.243752208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : configmap "kube-rbac-proxy" not found
Jul 09 20:07:20.259564 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.259549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-data-volume\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.268878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.268851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4dkj\" (UniqueName: \"kubernetes.io/projected/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-api-access-m4dkj\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.762259 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.762191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.762259 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:20.762254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:20.762615 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.762336    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 20:07:20.762615 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.762370    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:20.762615 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.762397    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:21.762383606 +0000 UTC m=+233.246823586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : configmap "kube-rbac-proxy" not found
Jul 09 20:07:20.762615 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:20.762445    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:21.762426751 +0000 UTC m=+233.246866729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:21.770424 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:21.770386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:21.770424 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:21.770426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:21.770886 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:21.770532    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 20:07:21.770886 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:21.770575    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:21.770886 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:21.770609    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:23.770595719 +0000 UTC m=+235.255035698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : configmap "kube-rbac-proxy" not found
Jul 09 20:07:21.770886 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:21.770639    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:23.770625283 +0000 UTC m=+235.255065261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:22.239320 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:22.239290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t2sg7_5fc880f4-8c16-459c-8ca8-c2f1e08f35aa/dns-node-resolver/0.log"
Jul 09 20:07:22.839586 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:22.839561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqnm9_410bcb74-59c1-476b-ac5e-cbb8fe5fe94d/node-ca/0.log"
Jul 09 20:07:22.979573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:22.979527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:22.979573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:22.979584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:22.979791 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:22.979681    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:22.979791 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:22.979693    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 20:07:22.979791 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:22.979704    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c99d8d86b-z4c6d: secret "image-registry-tls" not found
Jul 09 20:07:22.979791 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:22.979748    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls podName:9bf2fd50-8de7-4577-8f72-c5a0626c8ea0 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:30.979731646 +0000 UTC m=+242.464171649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls") pod "image-registry-7c99d8d86b-z4c6d" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0") : secret "image-registry-tls" not found
Jul 09 20:07:22.979791 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:22.979762    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls podName:954d6a6b-f906-44f8-ba04-3d8194e1f7ff nodeName:}" failed. No retries permitted until 2026-07-09 20:07:30.979755033 +0000 UTC m=+242.464195011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pcq8x" (UID: "954d6a6b-f906-44f8-ba04-3d8194e1f7ff") : secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:23.639201 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:23.639171    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7sm7q_d8901041-35a4-4db0-bbbd-2c46ddc6a8fb/serve-healthcheck-canary/0.log"
Jul 09 20:07:23.785968 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:23.785929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:23.785968 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:23.785971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:23.786270 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:23.786051    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 20:07:23.786270 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:23.786092    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:23.786270 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:23.786108    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:27.786090526 +0000 UTC m=+239.270530506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : configmap "kube-rbac-proxy" not found
Jul 09 20:07:23.786270 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:23.786178    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:27.786163666 +0000 UTC m=+239.270603647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:27.814901 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:27.814855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:27.814901 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:27.814901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:27.815368 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:27.815043    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:27.815368 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:27.815072    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 20:07:27.815368 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:27.815109    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:35.815091424 +0000 UTC m=+247.299531423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : secret "insights-runtime-extractor-tls" not found
Jul 09 20:07:27.815368 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:27.815131    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm podName:1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:35.815116617 +0000 UTC m=+247.299556596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pwkwd" (UID: "1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1") : configmap "kube-rbac-proxy" not found
Jul 09 20:07:31.043858 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.043814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:31.044383 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.043953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:31.044383 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:31.044072    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:31.044383 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:31.044160    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls podName:954d6a6b-f906-44f8-ba04-3d8194e1f7ff nodeName:}" failed. No retries permitted until 2026-07-09 20:07:47.044140718 +0000 UTC m=+258.528580701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pcq8x" (UID: "954d6a6b-f906-44f8-ba04-3d8194e1f7ff") : secret "cluster-monitoring-operator-tls" not found
Jul 09 20:07:31.046401 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.046378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"image-registry-7c99d8d86b-z4c6d\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") " pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:31.107308 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.107275    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9cv67\""
Jul 09 20:07:31.116175 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.116152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:31.243630 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.243599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c99d8d86b-z4c6d"]
Jul 09 20:07:31.246694 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:31.246668    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf2fd50_8de7_4577_8f72_c5a0626c8ea0.slice/crio-af67be5c1548a0d90f36d38d2200f39e2c90a60591960039e1b62609a7458c59 WatchSource:0}: Error finding container af67be5c1548a0d90f36d38d2200f39e2c90a60591960039e1b62609a7458c59: Status 404 returned error can't find the container with id af67be5c1548a0d90f36d38d2200f39e2c90a60591960039e1b62609a7458c59
Jul 09 20:07:31.850600 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.850565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" event={"ID":"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0","Type":"ContainerStarted","Data":"3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e"}
Jul 09 20:07:31.850766 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.850613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" event={"ID":"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0","Type":"ContainerStarted","Data":"af67be5c1548a0d90f36d38d2200f39e2c90a60591960039e1b62609a7458c59"}
Jul 09 20:07:31.850766 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.850693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:07:31.869787 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:31.869734    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" podStartSLOduration=16.869716394 podStartE2EDuration="16.869716394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:31.869075489 +0000 UTC m=+243.353515500" watchObservedRunningTime="2026-07-09 20:07:31.869716394 +0000 UTC m=+243.354156395"
Jul 09 20:07:35.884374 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:35.884336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:35.884374 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:35.884374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:35.884907 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:35.884878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:35.886904 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:35.886880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pwkwd\" (UID: \"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1\") " pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:35.970973 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:35.970942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6wftc\""
Jul 09 20:07:35.978874 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:35.978854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pwkwd"
Jul 09 20:07:36.107048 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:36.107016    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pwkwd"]
Jul 09 20:07:36.110775 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:36.110734    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba714e5_f1f9_4d85_9f1e_06f468fb3dc1.slice/crio-6a5e3ce883c24058f35d7f472f2008ae3dbf0b09e2b32065066e9c32b36f50ec WatchSource:0}: Error finding container 6a5e3ce883c24058f35d7f472f2008ae3dbf0b09e2b32065066e9c32b36f50ec: Status 404 returned error can't find the container with id 6a5e3ce883c24058f35d7f472f2008ae3dbf0b09e2b32065066e9c32b36f50ec
Jul 09 20:07:36.867812 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:36.867774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwkwd" event={"ID":"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1","Type":"ContainerStarted","Data":"6a5e3ce883c24058f35d7f472f2008ae3dbf0b09e2b32065066e9c32b36f50ec"}
Jul 09 20:07:40.467064 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.467040    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c99d8d86b-z4c6d"]
Jul 09 20:07:40.506616 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.506590    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d64b75bf-7b5mc"]
Jul 09 20:07:40.509519 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.509503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.522742 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.522717    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d64b75bf-7b5mc"]
Jul 09 20:07:40.622688 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-bound-sa-token\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.622688 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f930bf-7f46-4e74-b763-70c02b37020a-trusted-ca\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.622924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90f930bf-7f46-4e74-b763-70c02b37020a-installation-pull-secrets\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.622924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90f930bf-7f46-4e74-b763-70c02b37020a-image-registry-private-configuration\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.622924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90f930bf-7f46-4e74-b763-70c02b37020a-ca-trust-extracted\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.622924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjgzp\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-kube-api-access-hjgzp\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.622924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90f930bf-7f46-4e74-b763-70c02b37020a-registry-certificates\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.623122 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.622938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-registry-tls\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724323 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-bound-sa-token\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724323 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f930bf-7f46-4e74-b763-70c02b37020a-trusted-ca\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724323 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90f930bf-7f46-4e74-b763-70c02b37020a-installation-pull-secrets\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724637 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90f930bf-7f46-4e74-b763-70c02b37020a-image-registry-private-configuration\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724637 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90f930bf-7f46-4e74-b763-70c02b37020a-ca-trust-extracted\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724637 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjgzp\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-kube-api-access-hjgzp\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724637 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90f930bf-7f46-4e74-b763-70c02b37020a-registry-certificates\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724637 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-registry-tls\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.724860 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.724798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/90f930bf-7f46-4e74-b763-70c02b37020a-ca-trust-extracted\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.725518 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.725494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/90f930bf-7f46-4e74-b763-70c02b37020a-trusted-ca\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.725641 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.725559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/90f930bf-7f46-4e74-b763-70c02b37020a-registry-certificates\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.727300 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.727272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/90f930bf-7f46-4e74-b763-70c02b37020a-image-registry-private-configuration\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.727393 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.727376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/90f930bf-7f46-4e74-b763-70c02b37020a-installation-pull-secrets\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.727475 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.727459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-registry-tls\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.742449 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.742425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-bound-sa-token\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.742705 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.742686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjgzp\" (UniqueName: \"kubernetes.io/projected/90f930bf-7f46-4e74-b763-70c02b37020a-kube-api-access-hjgzp\") pod \"image-registry-5d64b75bf-7b5mc\" (UID: \"90f930bf-7f46-4e74-b763-70c02b37020a\") " pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.817953 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.817926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:40.825144 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.825111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:07:40.827460 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.827436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff-metrics-certs\") pod \"network-metrics-daemon-jtndh\" (UID: \"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff\") " pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:07:40.889529 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.887492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwkwd" event={"ID":"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1","Type":"ContainerStarted","Data":"f8ca16d689c01ad7309b66d17ae77c16f2bf26bb2e16b96e894e98780de8f4ed"}
Jul 09 20:07:40.889529 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.887565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwkwd" event={"ID":"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1","Type":"ContainerStarted","Data":"27da9922b00294ae4cc9cd2599b5b2ed76f905c7232429550be67d95df96b430"}
Jul 09 20:07:40.951316 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:40.951104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d64b75bf-7b5mc"]
Jul 09 20:07:40.954130 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:40.954094    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f930bf_7f46_4e74_b763_70c02b37020a.slice/crio-296a71c18ea332e5c607dbaeac78fdb71244456ce58afdab81f2f4af67273d4b WatchSource:0}: Error finding container 296a71c18ea332e5c607dbaeac78fdb71244456ce58afdab81f2f4af67273d4b: Status 404 returned error can't find the container with id 296a71c18ea332e5c607dbaeac78fdb71244456ce58afdab81f2f4af67273d4b
Jul 09 20:07:41.112522 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.112481    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s29qd\""
Jul 09 20:07:41.120521 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.120497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jtndh"
Jul 09 20:07:41.265953 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.265819    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jtndh"]
Jul 09 20:07:41.270169 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:41.270137    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebc5c31_2c55_4e4c_9ac8_2aac53a656ff.slice/crio-0341f233aa50d03dfda095ed067a47a983906965a2a2310044835fa25d7301e4 WatchSource:0}: Error finding container 0341f233aa50d03dfda095ed067a47a983906965a2a2310044835fa25d7301e4: Status 404 returned error can't find the container with id 0341f233aa50d03dfda095ed067a47a983906965a2a2310044835fa25d7301e4
Jul 09 20:07:41.893971 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.893724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc" event={"ID":"90f930bf-7f46-4e74-b763-70c02b37020a","Type":"ContainerStarted","Data":"e4cf9faf21db94857fec251f87bb6a0956deaf8d15c0e647cdb677a412da47d5"}
Jul 09 20:07:41.893971 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.893796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:07:41.893971 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.893818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc" event={"ID":"90f930bf-7f46-4e74-b763-70c02b37020a","Type":"ContainerStarted","Data":"296a71c18ea332e5c607dbaeac78fdb71244456ce58afdab81f2f4af67273d4b"}
Jul 09 20:07:41.895252 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.895198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jtndh" event={"ID":"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff","Type":"ContainerStarted","Data":"0341f233aa50d03dfda095ed067a47a983906965a2a2310044835fa25d7301e4"}
Jul 09 20:07:41.914078 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:41.914005    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc" podStartSLOduration=1.913989987 podStartE2EDuration="1.913989987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:41.912100535 +0000 UTC m=+253.396540539" watchObservedRunningTime="2026-07-09 20:07:41.913989987 +0000 UTC m=+253.398429988"
Jul 09 20:07:43.903389 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:43.903353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pwkwd" event={"ID":"1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1","Type":"ContainerStarted","Data":"4bd3f2a9c2400248f79bf068981395f490f08a69dc8c89eaac27d5fd518ea68a"}
Jul 09 20:07:43.905018 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:43.904990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jtndh" event={"ID":"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff","Type":"ContainerStarted","Data":"f0cbe2cfc320e73b7749ee2a3c71cb57a734674c149d727bc6e8240490aa5385"}
Jul 09 20:07:43.905139 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:43.905036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jtndh" event={"ID":"1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff","Type":"ContainerStarted","Data":"8045d9fce74ea9eb2328eb8bdc48be5ddca7ebb3e2dc23372571fa139eff6e6f"}
Jul 09 20:07:43.920269 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:43.920231    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pwkwd" podStartSLOduration=16.883461376 podStartE2EDuration="23.920193249s" totalImagesPullingTime="7.036731873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:07:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:43.918808642 +0000 UTC m=+255.403248644" watchObservedRunningTime="2026-07-09 20:07:43.920193249 +0000 UTC m=+255.404633248"
Jul 09 20:07:43.932852 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:43.932816    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jtndh" podStartSLOduration=252.951162849 podStartE2EDuration="4m14.932804488s" totalImagesPullingTime="1.981641639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:43.932199527 +0000 UTC m=+255.416639538" watchObservedRunningTime="2026-07-09 20:07:43.932804488 +0000 UTC m=+255.417244488"
Jul 09 20:07:47.078466 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:47.078403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:47.080880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:47.080845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/954d6a6b-f906-44f8-ba04-3d8194e1f7ff-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pcq8x\" (UID: \"954d6a6b-f906-44f8-ba04-3d8194e1f7ff\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:47.313092 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:47.313061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x2x88\""
Jul 09 20:07:47.320860 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:47.320838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"
Jul 09 20:07:47.448742 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:47.448710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x"]
Jul 09 20:07:47.451391 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:47.451351    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954d6a6b_f906_44f8_ba04_3d8194e1f7ff.slice/crio-0b2c01c6ce4651cae05e5f67ab214a4de6c028d04778df16627dfb861758d2cb WatchSource:0}: Error finding container 0b2c01c6ce4651cae05e5f67ab214a4de6c028d04778df16627dfb861758d2cb: Status 404 returned error can't find the container with id 0b2c01c6ce4651cae05e5f67ab214a4de6c028d04778df16627dfb861758d2cb
Jul 09 20:07:47.918470 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:47.918432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x" event={"ID":"954d6a6b-f906-44f8-ba04-3d8194e1f7ff","Type":"ContainerStarted","Data":"0b2c01c6ce4651cae05e5f67ab214a4de6c028d04778df16627dfb861758d2cb"}
Jul 09 20:07:49.926585 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:49.926536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x" event={"ID":"954d6a6b-f906-44f8-ba04-3d8194e1f7ff","Type":"ContainerStarted","Data":"00b453705b49197314ba0fe46f819396dc53f0634f567696307c50ee3136c72e"}
Jul 09 20:07:49.944182 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:49.944130    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pcq8x" podStartSLOduration=33.048313689 podStartE2EDuration="34.944111668s" totalImagesPullingTime="1.895797979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:49.943368944 +0000 UTC m=+261.427808944" watchObservedRunningTime="2026-07-09 20:07:49.944111668 +0000 UTC m=+261.428551670"
Jul 09 20:07:50.215970 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.215893    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd9798889-qkgtm"]
Jul 09 20:07:50.218951 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.218936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.221482 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.221462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 20:07:50.222437 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.222417    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 20:07:50.222544 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.222460    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 20:07:50.222544 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.222460    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-twwfz\""
Jul 09 20:07:50.222544 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.222462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 20:07:50.222705 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.222571    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 20:07:50.222705 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.222577    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 20:07:50.222705 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.222598    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 20:07:50.226423 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.226400    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 20:07:50.230680 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.230660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd9798889-qkgtm"]
Jul 09 20:07:50.401345 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.401309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-serving-cert\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.401564 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.401355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-console-config\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.401564 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.401442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-oauth-config\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.401564 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.401504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-oauth-serving-cert\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.401564 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.401536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-trusted-ca-bundle\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.401564 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.401561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-service-ca\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.401742 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.401595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfbds\" (UniqueName: \"kubernetes.io/projected/056514be-2666-450c-983c-2188d322bb73-kube-api-access-wfbds\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.473517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.473419    2565 patch_prober.go:28] interesting pod/image-registry-7c99d8d86b-z4c6d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 20:07:50.473517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.473500    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" podUID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 20:07:50.502889 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.502863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-serving-cert\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.502994 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.502904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-console-config\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.502994 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.502933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-oauth-config\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.502994 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.502955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-oauth-serving-cert\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.502994 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.502977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-trusted-ca-bundle\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.503206 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.503139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-service-ca\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.503280 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.503229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfbds\" (UniqueName: \"kubernetes.io/projected/056514be-2666-450c-983c-2188d322bb73-kube-api-access-wfbds\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.503773 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.503749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-console-config\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.503866 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.503749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-oauth-serving-cert\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.503915 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.503881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-service-ca\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.503962 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.503949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-trusted-ca-bundle\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.505464 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.505430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-oauth-config\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.505571 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.505554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-serving-cert\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.510734 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.510712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfbds\" (UniqueName: \"kubernetes.io/projected/056514be-2666-450c-983c-2188d322bb73-kube-api-access-wfbds\") pod \"console-cd9798889-qkgtm\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") " pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.528743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.528706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:07:50.664309 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.664141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd9798889-qkgtm"]
Jul 09 20:07:50.666836 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:50.666809    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod056514be_2666_450c_983c_2188d322bb73.slice/crio-3f0998cf4da9c6c1017db2d6ca04696f794daa4f8ab399a2d5c2bb5754c9ed05 WatchSource:0}: Error finding container 3f0998cf4da9c6c1017db2d6ca04696f794daa4f8ab399a2d5c2bb5754c9ed05: Status 404 returned error can't find the container with id 3f0998cf4da9c6c1017db2d6ca04696f794daa4f8ab399a2d5c2bb5754c9ed05
Jul 09 20:07:50.930481 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:50.930447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9798889-qkgtm" event={"ID":"056514be-2666-450c-983c-2188d322bb73","Type":"ContainerStarted","Data":"3f0998cf4da9c6c1017db2d6ca04696f794daa4f8ab399a2d5c2bb5754c9ed05"}
Jul 09 20:07:53.943924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:53.943889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9798889-qkgtm" event={"ID":"056514be-2666-450c-983c-2188d322bb73","Type":"ContainerStarted","Data":"b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2"}
Jul 09 20:07:53.960308 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:53.960253    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd9798889-qkgtm" podStartSLOduration=1.344918907 podStartE2EDuration="3.960236252s" totalImagesPullingTime="2.615317345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:07:53.958961156 +0000 UTC m=+265.443401156" watchObservedRunningTime="2026-07-09 20:07:53.960236252 +0000 UTC m=+265.444676252"
Jul 09 20:07:58.216193 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.216158    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4j4qj"]
Jul 09 20:07:58.218747 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.218719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.221388 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.221365    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 20:07:58.221538 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.221387    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 20:07:58.221538 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.221478    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 20:07:58.221538 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.221529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pnzg7\""
Jul 09 20:07:58.222443 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.222426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 20:07:58.270105 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-wtmp\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270307 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-root\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270307 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270307 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-sys\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270307 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-textfile\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270307 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-tls\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbff9\" (UniqueName: \"kubernetes.io/projected/d0b50897-f773-4750-a347-a3224dc993d9-kube-api-access-rbff9\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.270473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.270394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b50897-f773-4750-a347-a3224dc993d9-metrics-client-ca\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371418 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-root\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371418 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371639 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-sys\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371639 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-textfile\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371639 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-root\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371639 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-sys\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371639 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-tls\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371639 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbff9\" (UniqueName: \"kubernetes.io/projected/d0b50897-f773-4750-a347-a3224dc993d9-kube-api-access-rbff9\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371639 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371958 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b50897-f773-4750-a347-a3224dc993d9-metrics-client-ca\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371958 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-wtmp\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371958 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-textfile\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.371958 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.371854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-wtmp\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.372146 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.372075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.372233 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.372191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0b50897-f773-4750-a347-a3224dc993d9-metrics-client-ca\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.374236 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.374197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.374292 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.374250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d0b50897-f773-4750-a347-a3224dc993d9-node-exporter-tls\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.386692 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.386660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbff9\" (UniqueName: \"kubernetes.io/projected/d0b50897-f773-4750-a347-a3224dc993d9-kube-api-access-rbff9\") pod \"node-exporter-4j4qj\" (UID: \"d0b50897-f773-4750-a347-a3224dc993d9\") " pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.528258 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.528144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4j4qj"
Jul 09 20:07:58.539073 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:07:58.539047    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b50897_f773_4750_a347_a3224dc993d9.slice/crio-024c73e66065a0b16e81473dea83f09b2a990f4abfd588befae397c244a3c892 WatchSource:0}: Error finding container 024c73e66065a0b16e81473dea83f09b2a990f4abfd588befae397c244a3c892: Status 404 returned error can't find the container with id 024c73e66065a0b16e81473dea83f09b2a990f4abfd588befae397c244a3c892
Jul 09 20:07:58.960454 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:58.960415    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4j4qj" event={"ID":"d0b50897-f773-4750-a347-a3224dc993d9","Type":"ContainerStarted","Data":"024c73e66065a0b16e81473dea83f09b2a990f4abfd588befae397c244a3c892"}
Jul 09 20:07:59.269505 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.269408    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 20:07:59.272522 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.272496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.274874 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.274843    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 20:07:59.275022 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.274862    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 20:07:59.275081 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 20:07:59.275136 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 20:07:59.275136 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275126    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 20:07:59.275310 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275126    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 20:07:59.275310 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275239    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jx4xp\""
Jul 09 20:07:59.275426 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 20:07:59.275495 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275480    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 20:07:59.275548 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.275500    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 20:07:59.284806 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.284770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 20:07:59.381424 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-web-config\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381424 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7e8a454-4674-4fbd-b3c0-49ed40e77457-config-out\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381697 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqpz4\" (UniqueName: \"kubernetes.io/projected/f7e8a454-4674-4fbd-b3c0-49ed40e77457-kube-api-access-bqpz4\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381697 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381697 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381697 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381891 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381891 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.381891 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7e8a454-4674-4fbd-b3c0-49ed40e77457-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.382127 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.382127 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.382127 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.382127 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.381972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482398 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482398 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-web-config\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7e8a454-4674-4fbd-b3c0-49ed40e77457-config-out\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqpz4\" (UniqueName: \"kubernetes.io/projected/f7e8a454-4674-4fbd-b3c0-49ed40e77457-kube-api-access-bqpz4\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:59.482537    2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:59.482580    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-trusted-ca-bundle podName:f7e8a454-4674-4fbd-b3c0-49ed40e77457 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:59.982552567 +0000 UTC m=+271.466992547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f7e8a454-4674-4fbd-b3c0-49ed40e77457") : configmap references non-existent config key: ca-bundle.crt
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.482659 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.483371 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.483371 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.483371 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7e8a454-4674-4fbd-b3c0-49ed40e77457-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.483371 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.482871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.483371 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:07:59.482942    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-main-tls podName:f7e8a454-4674-4fbd-b3c0-49ed40e77457 nodeName:}" failed. No retries permitted until 2026-07-09 20:07:59.982920282 +0000 UTC m=+271.467360274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f7e8a454-4674-4fbd-b3c0-49ed40e77457") : secret "alertmanager-main-tls" not found
Jul 09 20:07:59.483371 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.483151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.483851 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.483662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.485641 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.485573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7e8a454-4674-4fbd-b3c0-49ed40e77457-config-out\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.485829 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.485809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.485974 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.485956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.486357 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.486327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.486471 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.486389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.486772 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.486752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.486936 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.486914    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7e8a454-4674-4fbd-b3c0-49ed40e77457-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.488204 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.488170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-web-config\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.492615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.492598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqpz4\" (UniqueName: \"kubernetes.io/projected/f7e8a454-4674-4fbd-b3c0-49ed40e77457-kube-api-access-bqpz4\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.965319 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.965288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4j4qj" event={"ID":"d0b50897-f773-4750-a347-a3224dc993d9","Type":"ContainerStarted","Data":"e50224b382b0ca3e91e00dbd03e5183114ef553c4f3808de4299e9fe77c39cb3"}
Jul 09 20:07:59.986227 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.986179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.986361 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.986239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.987092 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.987064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8a454-4674-4fbd-b3c0-49ed40e77457-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:07:59.988766 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:07:59.988746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7e8a454-4674-4fbd-b3c0-49ed40e77457-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7e8a454-4674-4fbd-b3c0-49ed40e77457\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:08:00.188760 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.188677    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 20:08:00.327414 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.327383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 20:08:00.331039 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:08:00.331008    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e8a454_4674_4fbd_b3c0_49ed40e77457.slice/crio-b03ed6a97c61f3aed29798d0610a9c1daf7626f09781d9916adae4718b89da17 WatchSource:0}: Error finding container b03ed6a97c61f3aed29798d0610a9c1daf7626f09781d9916adae4718b89da17: Status 404 returned error can't find the container with id b03ed6a97c61f3aed29798d0610a9c1daf7626f09781d9916adae4718b89da17
Jul 09 20:08:00.473049 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.472966    2565 patch_prober.go:28] interesting pod/image-registry-7c99d8d86b-z4c6d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 20:08:00.473049 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.473022    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" podUID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 20:08:00.529401 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.529363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:08:00.529586 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.529421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:08:00.530952 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.530926    2565 patch_prober.go:28] interesting pod/console-cd9798889-qkgtm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body=
Jul 09 20:08:00.531096 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.530976    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-cd9798889-qkgtm" podUID="056514be-2666-450c-983c-2188d322bb73" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused"
Jul 09 20:08:00.822278 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.822243    2565 patch_prober.go:28] interesting pod/image-registry-5d64b75bf-7b5mc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 20:08:00.822438 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.822297    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc" podUID="90f930bf-7f46-4e74-b763-70c02b37020a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 20:08:00.971069 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.971036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerStarted","Data":"b03ed6a97c61f3aed29798d0610a9c1daf7626f09781d9916adae4718b89da17"}
Jul 09 20:08:00.972750 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.972715    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0b50897-f773-4750-a347-a3224dc993d9" containerID="e50224b382b0ca3e91e00dbd03e5183114ef553c4f3808de4299e9fe77c39cb3" exitCode=0
Jul 09 20:08:00.972891 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:00.972759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4j4qj" event={"ID":"d0b50897-f773-4750-a347-a3224dc993d9","Type":"ContainerDied","Data":"e50224b382b0ca3e91e00dbd03e5183114ef553c4f3808de4299e9fe77c39cb3"}
Jul 09 20:08:01.978587 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:01.978556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4j4qj" event={"ID":"d0b50897-f773-4750-a347-a3224dc993d9","Type":"ContainerStarted","Data":"1d693e4ac7d9be2fe7db0840a3445d506d792ff402f1a59d9fb19221be377ad0"}
Jul 09 20:08:01.978987 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:01.978604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4j4qj" event={"ID":"d0b50897-f773-4750-a347-a3224dc993d9","Type":"ContainerStarted","Data":"72c2390386eda68280096158302d8c3475f978ff9d30e3b8030b998482e4d977"}
Jul 09 20:08:01.980063 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:01.980036    2565 generic.go:356] "Generic (PLEG): container finished" podID="f7e8a454-4674-4fbd-b3c0-49ed40e77457" containerID="6419bcd06320a3f982d21ba8c60d8b802b54fe5b9f2475cc463083f4053ba20b" exitCode=0
Jul 09 20:08:01.980187 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:01.980101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerDied","Data":"6419bcd06320a3f982d21ba8c60d8b802b54fe5b9f2475cc463083f4053ba20b"}
Jul 09 20:08:02.001705 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:02.001653    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4j4qj" podStartSLOduration=2.62080776 podStartE2EDuration="4.001638385s" totalImagesPullingTime="1.30544541s" totalInitContainerRuntime="75.385215ms" isStatefulPod=true podCreationTimestamp="2026-07-09 20:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:02.000465545 +0000 UTC m=+273.484905573" watchObservedRunningTime="2026-07-09 20:08:02.001638385 +0000 UTC m=+273.486078386"
Jul 09 20:08:02.903734 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:02.903704    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d64b75bf-7b5mc"
Jul 09 20:08:03.991365 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:03.991282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerStarted","Data":"f3a9a701791bc518de3a80c4932258bd9da576295eb731c8528633b14f6e44e6"}
Jul 09 20:08:03.991365 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:03.991350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerStarted","Data":"bd8f5a7c35f15f5bd2e27de99c822b94e870db848a678d12a071a60a04c3191a"}
Jul 09 20:08:03.991736 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:03.991376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerStarted","Data":"4946984ebcb934cab8398f2c52b0284d58118c6cafe172b1a190809c1d30c55c"}
Jul 09 20:08:03.991736 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:03.991400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerStarted","Data":"ed26f0cee87780cc18de4f4b9f79990866812eb029b788278c6b3bd1689e35a7"}
Jul 09 20:08:03.991736 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:03.991423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerStarted","Data":"37957c72d5bbffc16ad2c624258cb05f049d50d7018848d225b89ca3e8dff38d"}
Jul 09 20:08:04.405800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.405759    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 20:08:04.410114 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.410089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.412482 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.412459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 20:08:04.412655 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.412631    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 20:08:04.413395 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 20:08:04.413395 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413389    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-379k1ffv9dche\""
Jul 09 20:08:04.413603 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413575    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 20:08:04.413711 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413605    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 20:08:04.413711 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413659    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 20:08:04.413824 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h9gnk\""
Jul 09 20:08:04.413824 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413659    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 20:08:04.413918 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.413848    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 20:08:04.414051 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.414029    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 20:08:04.414121 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.414088    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 20:08:04.414251 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.414233    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 20:08:04.414352 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.414319    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 20:08:04.414428 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.414405    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 20:08:04.414528 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.414507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 20:08:04.420081 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.418605    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 20:08:04.424796 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.424772    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 20:08:04.531416 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5kzw\" (UniqueName: \"kubernetes.io/projected/73619272-8d5f-4470-99da-4c1a2546c03f-kube-api-access-s5kzw\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531569 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-web-config\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531569 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531569 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531670 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531670 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531728 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-config\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531762 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531817 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531848 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531912 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.531912 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.532010 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73619272-8d5f-4470-99da-4c1a2546c03f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.532010 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73619272-8d5f-4470-99da-4c1a2546c03f-config-out\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.532010 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.531974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.532094 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.532034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.532094 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.532050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.532094 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.532065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.532094 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.532085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632572 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-config\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632934 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632934 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.632934 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633079 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633079 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.632998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73619272-8d5f-4470-99da-4c1a2546c03f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633079 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73619272-8d5f-4470-99da-4c1a2546c03f-config-out\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633079 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633291 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633291 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633291 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633291 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633291 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5kzw\" (UniqueName: \"kubernetes.io/projected/73619272-8d5f-4470-99da-4c1a2546c03f-kube-api-access-s5kzw\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633527 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-web-config\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633527 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633527 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633527 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.633791 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.633739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.634043 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.634010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.634500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.634478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.635920 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.635649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.635920 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.635835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-config\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.636624 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.636136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.636624 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.636438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.636624 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.636561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.636897 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.636874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.636967 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.636901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.637017 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.636963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.637801 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.637752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.638432 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.638405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73619272-8d5f-4470-99da-4c1a2546c03f-config-out\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.638843 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.638823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73619272-8d5f-4470-99da-4c1a2546c03f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.639182 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.639161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-web-config\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.639446 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.639431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73619272-8d5f-4470-99da-4c1a2546c03f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.639855 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.639834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.640006 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.639984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73619272-8d5f-4470-99da-4c1a2546c03f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.647274 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.647253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5kzw\" (UniqueName: \"kubernetes.io/projected/73619272-8d5f-4470-99da-4c1a2546c03f-kube-api-access-s5kzw\") pod \"prometheus-k8s-0\" (UID: \"73619272-8d5f-4470-99da-4c1a2546c03f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.726747 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.726721    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:04.868865 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.868831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 20:08:04.871825 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:08:04.871794    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73619272_8d5f_4470_99da_4c1a2546c03f.slice/crio-d225a60cc8e274a5ed3f8b6821e2eb896fe819cfcedb784a423d766bd4a3f5ff WatchSource:0}: Error finding container d225a60cc8e274a5ed3f8b6821e2eb896fe819cfcedb784a423d766bd4a3f5ff: Status 404 returned error can't find the container with id d225a60cc8e274a5ed3f8b6821e2eb896fe819cfcedb784a423d766bd4a3f5ff
Jul 09 20:08:04.998932 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:04.998892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7e8a454-4674-4fbd-b3c0-49ed40e77457","Type":"ContainerStarted","Data":"da046c943c570f06a4c615b68ddd02810129ffd0229897991be6befdc122fcdd"}
Jul 09 20:08:05.000462 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.000437    2565 generic.go:356] "Generic (PLEG): container finished" podID="73619272-8d5f-4470-99da-4c1a2546c03f" containerID="0d4662f91528c1239da052e2cb06d48291a01cd34d8bc2c4ec5b77cc5bf2efdd" exitCode=0
Jul 09 20:08:05.000557 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.000498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerDied","Data":"0d4662f91528c1239da052e2cb06d48291a01cd34d8bc2c4ec5b77cc5bf2efdd"}
Jul 09 20:08:05.000557 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.000551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerStarted","Data":"d225a60cc8e274a5ed3f8b6821e2eb896fe819cfcedb784a423d766bd4a3f5ff"}
Jul 09 20:08:05.023038 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.022983    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.521717928 podStartE2EDuration="6.02296647s" totalImagesPullingTime="3.479106603s" totalInitContainerRuntime="22.141939ms" isStatefulPod=false podCreationTimestamp="2026-07-09 20:07:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:05.020782418 +0000 UTC m=+276.505222454" watchObservedRunningTime="2026-07-09 20:08:05.02296647 +0000 UTC m=+276.507406471"
Jul 09 20:08:05.487518 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.487458    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" podUID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" containerName="registry" containerID="cri-o://3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e" gracePeriod=30
Jul 09 20:08:05.735094 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.735065    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:08:05.845986 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.845944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.845986 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.845996    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-certificates\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.846262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv8rp\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-kube-api-access-zv8rp\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.846262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-image-registry-private-configuration\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.846262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846137    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-ca-trust-extracted\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.846262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-installation-pull-secrets\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.846262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-trusted-ca\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.846503 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-bound-sa-token\") pod \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\" (UID: \"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0\") "
Jul 09 20:08:05.846615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846553    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 20:08:05.846756 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.846719    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 20:08:05.849245 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.849167    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:08:05.849245 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.849179    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-kube-api-access-zv8rp" (OuterVolumeSpecName: "kube-api-access-zv8rp") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "kube-api-access-zv8rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:08:05.849414 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.849243    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:08:05.849581 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.849554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:08:05.849650 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.849627    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:08:05.857819 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.857790    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" (UID: "9bf2fd50-8de7-4577-8f72-c5a0626c8ea0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:08:05.947533 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947497    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv8rp\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-kube-api-access-zv8rp\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:05.947533 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947529    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-image-registry-private-configuration\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:05.947752 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947544    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-ca-trust-extracted\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:05.947752 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947559    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-installation-pull-secrets\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:05.947752 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947575    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-trusted-ca\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:05.947752 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947588    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-bound-sa-token\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:05.947752 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947597    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-tls\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:05.947752 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:05.947607    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0-registry-certificates\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:06.007770 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.007297    2565 generic.go:356] "Generic (PLEG): container finished" podID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" containerID="3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e" exitCode=0
Jul 09 20:08:06.007770 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.007348    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d"
Jul 09 20:08:06.007770 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.007403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" event={"ID":"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0","Type":"ContainerDied","Data":"3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e"}
Jul 09 20:08:06.007770 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.007442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c99d8d86b-z4c6d" event={"ID":"9bf2fd50-8de7-4577-8f72-c5a0626c8ea0","Type":"ContainerDied","Data":"af67be5c1548a0d90f36d38d2200f39e2c90a60591960039e1b62609a7458c59"}
Jul 09 20:08:06.007770 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.007483    2565 scope.go:117] "RemoveContainer" containerID="3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e"
Jul 09 20:08:06.023043 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.023022    2565 scope.go:117] "RemoveContainer" containerID="3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e"
Jul 09 20:08:06.023423 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:08:06.023397    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e\": container with ID starting with 3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e not found: ID does not exist" containerID="3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e"
Jul 09 20:08:06.023547 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.023434    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e"} err="failed to get container status \"3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e\": rpc error: code = NotFound desc = could not find container \"3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e\": container with ID starting with 3d64b002a42eff04f686d0982d74242f02c27bb91e361aeeb73d94ae39c0a45e not found: ID does not exist"
Jul 09 20:08:06.032950 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.032920    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c99d8d86b-z4c6d"]
Jul 09 20:08:06.036740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:06.036713    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c99d8d86b-z4c6d"]
Jul 09 20:08:07.115387 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:07.115343    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" path="/var/lib/kubelet/pods/9bf2fd50-8de7-4577-8f72-c5a0626c8ea0/volumes"
Jul 09 20:08:09.023547 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:09.023506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerStarted","Data":"3ec51983ec531cec39b2a8a414f8b1bbb0b901d9b65070562286d3654fc29a3a"}
Jul 09 20:08:09.023944 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:09.023594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerStarted","Data":"28ae3c2641a56f617b28e84d453e649bbee2d42724aec1cbb709bddbce065d94"}
Jul 09 20:08:10.533413 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:10.533388    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:08:10.538045 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:10.538022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:08:11.035250 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:11.035142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerStarted","Data":"5c7db0adf08980a9e2eead151016ba8e977f7dc6d17f6470fc50817814f3e531"}
Jul 09 20:08:11.035250 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:11.035227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerStarted","Data":"90df4c4f873b0a3b7f7f8d901c982e593aca2c45fd7af55b12515307b0f9e387"}
Jul 09 20:08:11.035435 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:11.035254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerStarted","Data":"aa2d7d2d2f45667198bd92be7d7f0d7399fe1098bef6ee8bb58e31d54219a42d"}
Jul 09 20:08:11.035435 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:11.035278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73619272-8d5f-4470-99da-4c1a2546c03f","Type":"ContainerStarted","Data":"3f94eef419e2bc0955905ccbbde850bf9d8106aa2f745fec4a1602f8304a9a72"}
Jul 09 20:08:11.063646 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:11.063588    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.8450718080000001 podStartE2EDuration="7.063570941s" totalImagesPullingTime="5.199026793s" totalInitContainerRuntime="19.47234ms" isStatefulPod=false podCreationTimestamp="2026-07-09 20:08:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:11.062663697 +0000 UTC m=+282.547103708" watchObservedRunningTime="2026-07-09 20:08:11.063570941 +0000 UTC m=+282.548010938"
Jul 09 20:08:13.635834 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:08:13.635790    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s4xnm" podUID="8a24ff45-361f-4666-8ae0-fe63706f0bab"
Jul 09 20:08:14.046463 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:14.046390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:08:14.228804 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:14.228763    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd9798889-qkgtm"]
Jul 09 20:08:14.727150 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:14.727111    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:08:16.852167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:16.852132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:08:16.854680 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:16.854659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a24ff45-361f-4666-8ae0-fe63706f0bab-metrics-tls\") pod \"dns-default-s4xnm\" (UID: \"8a24ff45-361f-4666-8ae0-fe63706f0bab\") " pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:08:17.052628 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:17.052590    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9lrpv\""
Jul 09 20:08:17.057635 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:17.057608    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:08:17.201611 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:17.201548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4xnm"]
Jul 09 20:08:17.203990 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:08:17.203953    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a24ff45_361f_4666_8ae0_fe63706f0bab.slice/crio-b23b011d39e91bdd25bb4557c3f17e22f77385fa86ddcfe800772a3808c345a0 WatchSource:0}: Error finding container b23b011d39e91bdd25bb4557c3f17e22f77385fa86ddcfe800772a3808c345a0: Status 404 returned error can't find the container with id b23b011d39e91bdd25bb4557c3f17e22f77385fa86ddcfe800772a3808c345a0
Jul 09 20:08:18.063568 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:18.063528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4xnm" event={"ID":"8a24ff45-361f-4666-8ae0-fe63706f0bab","Type":"ContainerStarted","Data":"b23b011d39e91bdd25bb4557c3f17e22f77385fa86ddcfe800772a3808c345a0"}
Jul 09 20:08:19.068730 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:19.068696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4xnm" event={"ID":"8a24ff45-361f-4666-8ae0-fe63706f0bab","Type":"ContainerStarted","Data":"83aee8140cad3c09dfa077efe9a0762bbb77da6a12f7702121177d9316ce7cf7"}
Jul 09 20:08:19.069115 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:19.068747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4xnm" event={"ID":"8a24ff45-361f-4666-8ae0-fe63706f0bab","Type":"ContainerStarted","Data":"7a9132e96dc0fc1d1f0a5ce06273206778465d5bcac965a4cce05e8a9137a231"}
Jul 09 20:08:19.069115 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:19.068785    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:08:19.086558 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:19.086456    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s4xnm" podStartSLOduration=251.477406387 podStartE2EDuration="4m13.086441718s" totalImagesPullingTime="1.609035331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:08:19.085156887 +0000 UTC m=+290.569596902" watchObservedRunningTime="2026-07-09 20:08:19.086441718 +0000 UTC m=+290.570881718"
Jul 09 20:08:28.953072 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:28.953049    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:08:28.953072 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:28.953066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:08:28.959808 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:28.959789    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 20:08:29.075445 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:29.075409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s4xnm"
Jul 09 20:08:39.250688 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.250645    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cd9798889-qkgtm" podUID="056514be-2666-450c-983c-2188d322bb73" containerName="console" containerID="cri-o://b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2" gracePeriod=15
Jul 09 20:08:39.538898 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.538865    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:08:39.543119 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-console-config\") pod \"056514be-2666-450c-983c-2188d322bb73\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") "
Jul 09 20:08:39.543254 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543130    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-trusted-ca-bundle\") pod \"056514be-2666-450c-983c-2188d322bb73\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") "
Jul 09 20:08:39.543254 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543168    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-serving-cert\") pod \"056514be-2666-450c-983c-2188d322bb73\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") "
Jul 09 20:08:39.543254 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-oauth-config\") pod \"056514be-2666-450c-983c-2188d322bb73\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") "
Jul 09 20:08:39.543390 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543269    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfbds\" (UniqueName: \"kubernetes.io/projected/056514be-2666-450c-983c-2188d322bb73-kube-api-access-wfbds\") pod \"056514be-2666-450c-983c-2188d322bb73\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") "
Jul 09 20:08:39.543390 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-oauth-serving-cert\") pod \"056514be-2666-450c-983c-2188d322bb73\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") "
Jul 09 20:08:39.543390 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543318    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-service-ca\") pod \"056514be-2666-450c-983c-2188d322bb73\" (UID: \"056514be-2666-450c-983c-2188d322bb73\") "
Jul 09 20:08:39.543614 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543533    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-console-config" (OuterVolumeSpecName: "console-config") pod "056514be-2666-450c-983c-2188d322bb73" (UID: "056514be-2666-450c-983c-2188d322bb73"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 20:08:39.543695 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543627    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "056514be-2666-450c-983c-2188d322bb73" (UID: "056514be-2666-450c-983c-2188d322bb73"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 20:08:39.543753 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543689    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "056514be-2666-450c-983c-2188d322bb73" (UID: "056514be-2666-450c-983c-2188d322bb73"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 20:08:39.543872 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.543846    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-service-ca" (OuterVolumeSpecName: "service-ca") pod "056514be-2666-450c-983c-2188d322bb73" (UID: "056514be-2666-450c-983c-2188d322bb73"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 20:08:39.545626 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.545592    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "056514be-2666-450c-983c-2188d322bb73" (UID: "056514be-2666-450c-983c-2188d322bb73"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:08:39.545720 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.545629    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "056514be-2666-450c-983c-2188d322bb73" (UID: "056514be-2666-450c-983c-2188d322bb73"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:08:39.545720 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.545694    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/056514be-2666-450c-983c-2188d322bb73-kube-api-access-wfbds" (OuterVolumeSpecName: "kube-api-access-wfbds") pod "056514be-2666-450c-983c-2188d322bb73" (UID: "056514be-2666-450c-983c-2188d322bb73"). InnerVolumeSpecName "kube-api-access-wfbds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:08:39.644473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.644438    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-oauth-config\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:39.644473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.644470    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfbds\" (UniqueName: \"kubernetes.io/projected/056514be-2666-450c-983c-2188d322bb73-kube-api-access-wfbds\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:39.644473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.644483    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-oauth-serving-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:39.644729 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.644496    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-service-ca\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:39.644729 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.644507    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-console-config\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:39.644729 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.644518    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/056514be-2666-450c-983c-2188d322bb73-trusted-ca-bundle\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:39.644729 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:39.644528    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/056514be-2666-450c-983c-2188d322bb73-console-serving-cert\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:08:40.146379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.146339    2565 generic.go:356] "Generic (PLEG): container finished" podID="056514be-2666-450c-983c-2188d322bb73" containerID="b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2" exitCode=0
Jul 09 20:08:40.146379 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.146383    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd9798889-qkgtm"
Jul 09 20:08:40.146615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.146434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9798889-qkgtm" event={"ID":"056514be-2666-450c-983c-2188d322bb73","Type":"ContainerDied","Data":"b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2"}
Jul 09 20:08:40.146615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.146482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd9798889-qkgtm" event={"ID":"056514be-2666-450c-983c-2188d322bb73","Type":"ContainerDied","Data":"3f0998cf4da9c6c1017db2d6ca04696f794daa4f8ab399a2d5c2bb5754c9ed05"}
Jul 09 20:08:40.146615 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.146504    2565 scope.go:117] "RemoveContainer" containerID="b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2"
Jul 09 20:08:40.155442 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.155424    2565 scope.go:117] "RemoveContainer" containerID="b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2"
Jul 09 20:08:40.155715 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:08:40.155695    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2\": container with ID starting with b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2 not found: ID does not exist" containerID="b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2"
Jul 09 20:08:40.155786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.155724    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2"} err="failed to get container status \"b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2\": rpc error: code = NotFound desc = could not find container \"b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2\": container with ID starting with b568d6fe34306a0151a483116c0e0e000892e0fdd190f60e3377b83a22257ab2 not found: ID does not exist"
Jul 09 20:08:40.165786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.165753    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd9798889-qkgtm"]
Jul 09 20:08:40.168882 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:40.168848    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd9798889-qkgtm"]
Jul 09 20:08:41.113128 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:41.113094    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="056514be-2666-450c-983c-2188d322bb73" path="/var/lib/kubelet/pods/056514be-2666-450c-983c-2188d322bb73/volumes"
Jul 09 20:08:49.183155 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:49.183123    2565 generic.go:356] "Generic (PLEG): container finished" podID="f7049af2-0619-4a88-ad90-e041f2bd3c5c" containerID="e7ce91bcb18662d960f5931ecd868f95f06beee887c2759a03132bf39e781d27" exitCode=0
Jul 09 20:08:49.183547 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:49.183204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh" event={"ID":"f7049af2-0619-4a88-ad90-e041f2bd3c5c","Type":"ContainerDied","Data":"e7ce91bcb18662d960f5931ecd868f95f06beee887c2759a03132bf39e781d27"}
Jul 09 20:08:49.183547 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:49.183536    2565 scope.go:117] "RemoveContainer" containerID="e7ce91bcb18662d960f5931ecd868f95f06beee887c2759a03132bf39e781d27"
Jul 09 20:08:50.188729 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:50.188696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tl8sh" event={"ID":"f7049af2-0619-4a88-ad90-e041f2bd3c5c","Type":"ContainerStarted","Data":"3e9ecb3a7367bb216f73097f64c3338fdd3839dba223518832a8c183aea72658"}
Jul 09 20:08:55.211253 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:55.211201    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc350c8b-482e-473a-8426-dd3f5eb125ff" containerID="a25f1ff09f4f5b42a673729273c0e0ac54ee23aeceb1792494f39e7c07ea5bab" exitCode=0
Jul 09 20:08:55.211623 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:55.211280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj" event={"ID":"dc350c8b-482e-473a-8426-dd3f5eb125ff","Type":"ContainerDied","Data":"a25f1ff09f4f5b42a673729273c0e0ac54ee23aeceb1792494f39e7c07ea5bab"}
Jul 09 20:08:55.211660 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:55.211636    2565 scope.go:117] "RemoveContainer" containerID="a25f1ff09f4f5b42a673729273c0e0ac54ee23aeceb1792494f39e7c07ea5bab"
Jul 09 20:08:56.217139 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:08:56.217107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-dhxkj" event={"ID":"dc350c8b-482e-473a-8426-dd3f5eb125ff","Type":"ContainerStarted","Data":"72d0f970fe108d4464a2d9098831edcb6504dbfae0b02199c5e96d5afb92f038"}
Jul 09 20:09:04.727001 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:09:04.726963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:09:04.748832 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:09:04.748802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:09:05.267514 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:09:05.267483    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 20:11:02.561417 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.561333    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"]
Jul 09 20:11:02.561878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.561672    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" containerName="registry"
Jul 09 20:11:02.561878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.561684    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" containerName="registry"
Jul 09 20:11:02.561878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.561703    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="056514be-2666-450c-983c-2188d322bb73" containerName="console"
Jul 09 20:11:02.561878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.561711    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="056514be-2666-450c-983c-2188d322bb73" containerName="console"
Jul 09 20:11:02.561878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.561763    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="056514be-2666-450c-983c-2188d322bb73" containerName="console"
Jul 09 20:11:02.561878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.561772    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf2fd50-8de7-4577-8f72-c5a0626c8ea0" containerName="registry"
Jul 09 20:11:02.564618 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.564601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:02.566711 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.566692    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mjtlm\""
Jul 09 20:11:02.566942 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.566920    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 20:11:02.567719 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.567704    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 20:11:02.572121 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.572097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"]
Jul 09 20:11:02.644341 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.644301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a78a58c1-23da-4d9f-83a7-8c6db329fcd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zdcdd\" (UID: \"a78a58c1-23da-4d9f-83a7-8c6db329fcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:02.644341 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.644340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zld8l\" (UniqueName: \"kubernetes.io/projected/a78a58c1-23da-4d9f-83a7-8c6db329fcd8-kube-api-access-zld8l\") pod \"cert-manager-cainjector-559cdd8c87-zdcdd\" (UID: \"a78a58c1-23da-4d9f-83a7-8c6db329fcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:02.745793 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.745753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a78a58c1-23da-4d9f-83a7-8c6db329fcd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zdcdd\" (UID: \"a78a58c1-23da-4d9f-83a7-8c6db329fcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:02.745793 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.745791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zld8l\" (UniqueName: \"kubernetes.io/projected/a78a58c1-23da-4d9f-83a7-8c6db329fcd8-kube-api-access-zld8l\") pod \"cert-manager-cainjector-559cdd8c87-zdcdd\" (UID: \"a78a58c1-23da-4d9f-83a7-8c6db329fcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:02.754816 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.754793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a78a58c1-23da-4d9f-83a7-8c6db329fcd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zdcdd\" (UID: \"a78a58c1-23da-4d9f-83a7-8c6db329fcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:02.754947 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.754905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zld8l\" (UniqueName: \"kubernetes.io/projected/a78a58c1-23da-4d9f-83a7-8c6db329fcd8-kube-api-access-zld8l\") pod \"cert-manager-cainjector-559cdd8c87-zdcdd\" (UID: \"a78a58c1-23da-4d9f-83a7-8c6db329fcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:02.894132 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:02.894101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"
Jul 09 20:11:03.022696 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:03.022659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd"]
Jul 09 20:11:03.025856 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:11:03.025825    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda78a58c1_23da_4d9f_83a7_8c6db329fcd8.slice/crio-25a36d1105fab2b2d4ac9d169f31843a5db5b9a01325876c29e095991636c3a9 WatchSource:0}: Error finding container 25a36d1105fab2b2d4ac9d169f31843a5db5b9a01325876c29e095991636c3a9: Status 404 returned error can't find the container with id 25a36d1105fab2b2d4ac9d169f31843a5db5b9a01325876c29e095991636c3a9
Jul 09 20:11:03.027940 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:03.027924    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 20:11:03.689109 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:03.689073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd" event={"ID":"a78a58c1-23da-4d9f-83a7-8c6db329fcd8","Type":"ContainerStarted","Data":"25a36d1105fab2b2d4ac9d169f31843a5db5b9a01325876c29e095991636c3a9"}
Jul 09 20:11:06.703645 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:06.703610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd" event={"ID":"a78a58c1-23da-4d9f-83a7-8c6db329fcd8","Type":"ContainerStarted","Data":"3e1dfd47dbacb9f59cbcec8e69452c3cfa1865888013a29c103cec3debd530f8"}
Jul 09 20:11:06.720940 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:06.720892    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zdcdd" podStartSLOduration=1.87292527 podStartE2EDuration="4.720875723s" totalImagesPullingTime="2.847950453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:11:06.71955998 +0000 UTC m=+458.204000003" watchObservedRunningTime="2026-07-09 20:11:06.720875723 +0000 UTC m=+458.205315722"
Jul 09 20:11:33.210808 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.210770    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"]
Jul 09 20:11:33.213785 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.213766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.223749 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.223723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 20:11:33.223873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.223723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 20:11:33.223873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.223736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 20:11:33.223873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.223724    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 20:11:33.223873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.223740    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9l7m7\""
Jul 09 20:11:33.224087 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.224041    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 20:11:33.230968 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.230948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"]
Jul 09 20:11:33.315638 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.315608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/220af1ae-adc6-43cd-83d1-98d0b9e83547-manager-config\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.315638 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.315643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/220af1ae-adc6-43cd-83d1-98d0b9e83547-metrics-cert\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.315910 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.315671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkqdw\" (UniqueName: \"kubernetes.io/projected/220af1ae-adc6-43cd-83d1-98d0b9e83547-kube-api-access-mkqdw\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.315910 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.315773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/220af1ae-adc6-43cd-83d1-98d0b9e83547-cert\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.417053 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.417011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/220af1ae-adc6-43cd-83d1-98d0b9e83547-manager-config\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.417053 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.417053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/220af1ae-adc6-43cd-83d1-98d0b9e83547-metrics-cert\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.417349 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.417094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkqdw\" (UniqueName: \"kubernetes.io/projected/220af1ae-adc6-43cd-83d1-98d0b9e83547-kube-api-access-mkqdw\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.417349 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.417153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/220af1ae-adc6-43cd-83d1-98d0b9e83547-cert\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.417797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.417768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/220af1ae-adc6-43cd-83d1-98d0b9e83547-manager-config\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.419658 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.419634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/220af1ae-adc6-43cd-83d1-98d0b9e83547-metrics-cert\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.419738 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.419685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/220af1ae-adc6-43cd-83d1-98d0b9e83547-cert\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.434197 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.434175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkqdw\" (UniqueName: \"kubernetes.io/projected/220af1ae-adc6-43cd-83d1-98d0b9e83547-kube-api-access-mkqdw\") pod \"lws-controller-manager-5fd67cd5cb-md857\" (UID: \"220af1ae-adc6-43cd-83d1-98d0b9e83547\") " pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.523409 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.523328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:33.653248 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.653082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"]
Jul 09 20:11:33.655821 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:11:33.655795    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220af1ae_adc6_43cd_83d1_98d0b9e83547.slice/crio-07d54202f8b85773bf500a37ec357d0341a9727ea2172d7599aed862d591f56f WatchSource:0}: Error finding container 07d54202f8b85773bf500a37ec357d0341a9727ea2172d7599aed862d591f56f: Status 404 returned error can't find the container with id 07d54202f8b85773bf500a37ec357d0341a9727ea2172d7599aed862d591f56f
Jul 09 20:11:33.806733 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:33.806654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857" event={"ID":"220af1ae-adc6-43cd-83d1-98d0b9e83547","Type":"ContainerStarted","Data":"07d54202f8b85773bf500a37ec357d0341a9727ea2172d7599aed862d591f56f"}
Jul 09 20:11:36.820575 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:36.820542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857" event={"ID":"220af1ae-adc6-43cd-83d1-98d0b9e83547","Type":"ContainerStarted","Data":"4ebb362720a181d802322c327f318c4ce5b07073259f9ebb7713159477b02f37"}
Jul 09 20:11:36.821005 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:36.820640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:36.862821 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:36.862766    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857" podStartSLOduration=1.47974039 podStartE2EDuration="3.862746148s" totalImagesPullingTime="2.383005758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:11:36.860957136 +0000 UTC m=+488.345397136" watchObservedRunningTime="2026-07-09 20:11:36.862746148 +0000 UTC m=+488.347186150"
Jul 09 20:11:40.047074 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.047034    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"]
Jul 09 20:11:40.050977 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.050959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.054849 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.054823    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 20:11:40.066123 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.066101    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wc5fj\""
Jul 09 20:11:40.066354 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.066340    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 20:11:40.066579 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.066564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 20:11:40.080822 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.080798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"]
Jul 09 20:11:40.088326 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.088308    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 20:11:40.175711 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.175670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wkj8\" (UniqueName: \"kubernetes.io/projected/ca0a1644-eb79-4d57-b986-f9776c15e139-kube-api-access-8wkj8\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.175917 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.175749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca0a1644-eb79-4d57-b986-f9776c15e139-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.175917 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.175783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca0a1644-eb79-4d57-b986-f9776c15e139-manifests\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.175917 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.175809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca0a1644-eb79-4d57-b986-f9776c15e139-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.176060 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.175903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca0a1644-eb79-4d57-b986-f9776c15e139-tmp\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.277341 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.277302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wkj8\" (UniqueName: \"kubernetes.io/projected/ca0a1644-eb79-4d57-b986-f9776c15e139-kube-api-access-8wkj8\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.277498 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.277369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca0a1644-eb79-4d57-b986-f9776c15e139-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.277498 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.277406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca0a1644-eb79-4d57-b986-f9776c15e139-manifests\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.277498 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.277429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca0a1644-eb79-4d57-b986-f9776c15e139-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.277498 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.277456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca0a1644-eb79-4d57-b986-f9776c15e139-tmp\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.277869 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.277842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca0a1644-eb79-4d57-b986-f9776c15e139-manifests\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.279739 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.279719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca0a1644-eb79-4d57-b986-f9776c15e139-tmp\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.279894 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.279874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca0a1644-eb79-4d57-b986-f9776c15e139-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.280009 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.279991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca0a1644-eb79-4d57-b986-f9776c15e139-webhook-cert\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.288828 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.288809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wkj8\" (UniqueName: \"kubernetes.io/projected/ca0a1644-eb79-4d57-b986-f9776c15e139-kube-api-access-8wkj8\") pod \"opendatahub-operator-controller-manager-64f986597c-5sjh5\" (UID: \"ca0a1644-eb79-4d57-b986-f9776c15e139\") " pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.360634 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.360602    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:40.500915 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.500879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"]
Jul 09 20:11:40.505692 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:11:40.505665    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0a1644_eb79_4d57_b986_f9776c15e139.slice/crio-dfb4fd79281939816fa9e3e260fbc8eef2e89d93e9b1e835d05948bac5340fbc WatchSource:0}: Error finding container dfb4fd79281939816fa9e3e260fbc8eef2e89d93e9b1e835d05948bac5340fbc: Status 404 returned error can't find the container with id dfb4fd79281939816fa9e3e260fbc8eef2e89d93e9b1e835d05948bac5340fbc
Jul 09 20:11:40.838031 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:40.837998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5" event={"ID":"ca0a1644-eb79-4d57-b986-f9776c15e139","Type":"ContainerStarted","Data":"dfb4fd79281939816fa9e3e260fbc8eef2e89d93e9b1e835d05948bac5340fbc"}
Jul 09 20:11:43.852254 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:43.852195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5" event={"ID":"ca0a1644-eb79-4d57-b986-f9776c15e139","Type":"ContainerStarted","Data":"ba2829d0f72fe59054124c82ea939f1f4ff890b0cc3e99ae1ae2b57745236705"}
Jul 09 20:11:44.857536 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:44.857494    2565 generic.go:356] "Generic (PLEG): container finished" podID="ca0a1644-eb79-4d57-b986-f9776c15e139" containerID="ba2829d0f72fe59054124c82ea939f1f4ff890b0cc3e99ae1ae2b57745236705" exitCode=0
Jul 09 20:11:44.857953 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:44.857601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5" event={"ID":"ca0a1644-eb79-4d57-b986-f9776c15e139","Type":"ContainerDied","Data":"ba2829d0f72fe59054124c82ea939f1f4ff890b0cc3e99ae1ae2b57745236705"}
Jul 09 20:11:45.864445 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:45.864407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5" event={"ID":"ca0a1644-eb79-4d57-b986-f9776c15e139","Type":"ContainerStarted","Data":"9bea977bcb0948912816133d060d02d5ef5dcf693ffc892deaf2e6f7d57b7596"}
Jul 09 20:11:45.864909 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:45.864528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:45.893870 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:45.893819    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5" podStartSLOduration=1.57555441 podStartE2EDuration="5.893804316s" totalImagesPullingTime="3.301190936s" totalInitContainerRuntime="1.01705897s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:11:45.893644614 +0000 UTC m=+497.378084615" watchObservedRunningTime="2026-07-09 20:11:45.893804316 +0000 UTC m=+497.378244317"
Jul 09 20:11:47.827771 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:47.827745    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fd67cd5cb-md857"
Jul 09 20:11:56.871197 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:56.871166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64f986597c-5sjh5"
Jul 09 20:11:59.145068 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.145031    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"]
Jul 09 20:11:59.148845 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.148820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.152537 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.152512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 20:11:59.152537 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.152537    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 20:11:59.153732 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.153709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zh5gl\""
Jul 09 20:11:59.153832 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.153761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 20:11:59.154372 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.154357    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 20:11:59.166009 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.165980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"]
Jul 09 20:11:59.222957 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.222919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fz6\" (UniqueName: \"kubernetes.io/projected/725d75f7-1a5b-435d-9993-9a98fa8b9c74-kube-api-access-p6fz6\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.223135 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.223021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725d75f7-1a5b-435d-9993-9a98fa8b9c74-tmp\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.223135 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.223054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/725d75f7-1a5b-435d-9993-9a98fa8b9c74-tls-certs\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.323967 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.323925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725d75f7-1a5b-435d-9993-9a98fa8b9c74-tmp\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.324152 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.323980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/725d75f7-1a5b-435d-9993-9a98fa8b9c74-tls-certs\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.324152 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.324044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fz6\" (UniqueName: \"kubernetes.io/projected/725d75f7-1a5b-435d-9993-9a98fa8b9c74-kube-api-access-p6fz6\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.326380 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.326345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725d75f7-1a5b-435d-9993-9a98fa8b9c74-tmp\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.326695 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.326672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/725d75f7-1a5b-435d-9993-9a98fa8b9c74-tls-certs\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.341107 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.341073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fz6\" (UniqueName: \"kubernetes.io/projected/725d75f7-1a5b-435d-9993-9a98fa8b9c74-kube-api-access-p6fz6\") pod \"kube-auth-proxy-8d5dd4c74-8fqq9\" (UID: \"725d75f7-1a5b-435d-9993-9a98fa8b9c74\") " pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.458575 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.458484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"
Jul 09 20:11:59.600888 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.600858    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9"]
Jul 09 20:11:59.603546 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:11:59.603522    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725d75f7_1a5b_435d_9993_9a98fa8b9c74.slice/crio-a0d683a6b1efae9d2bb523096bb8b95397b30bf891011163d21e4c346c8e28bc WatchSource:0}: Error finding container a0d683a6b1efae9d2bb523096bb8b95397b30bf891011163d21e4c346c8e28bc: Status 404 returned error can't find the container with id a0d683a6b1efae9d2bb523096bb8b95397b30bf891011163d21e4c346c8e28bc
Jul 09 20:11:59.920792 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:11:59.920751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9" event={"ID":"725d75f7-1a5b-435d-9993-9a98fa8b9c74","Type":"ContainerStarted","Data":"a0d683a6b1efae9d2bb523096bb8b95397b30bf891011163d21e4c346c8e28bc"}
Jul 09 20:12:02.936255 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:12:02.936148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9" event={"ID":"725d75f7-1a5b-435d-9993-9a98fa8b9c74","Type":"ContainerStarted","Data":"2e8226ea554f4eb0276478acb97c163dbe4008b4a4010759e4715577b758650c"}
Jul 09 20:12:02.952894 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:12:02.952837    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8d5dd4c74-8fqq9" podStartSLOduration=0.885206072 podStartE2EDuration="3.952820947s" totalImagesPullingTime="3.067614875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:12:02.952585977 +0000 UTC m=+514.437025974" watchObservedRunningTime="2026-07-09 20:12:02.952820947 +0000 UTC m=+514.437260972"
Jul 09 20:13:28.978640 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:28.978607    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:13:28.979181 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:28.979002    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:13:41.726512 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.726482    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"]
Jul 09 20:13:41.729650 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.729634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"
Jul 09 20:13:41.732558 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.732529    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 09 20:13:41.732667 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.732529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lj4hc\""
Jul 09 20:13:41.733772 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.733753    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 20:13:41.733866 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.733808    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 20:13:41.743294 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.743275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"]
Jul 09 20:13:41.837407 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.837376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgfq4\" (UniqueName: \"kubernetes.io/projected/407c3f2f-547b-4e37-afe3-7cfb01e64d8b-kube-api-access-tgfq4\") pod \"dns-operator-controller-manager-864dd78c4c-j7zpr\" (UID: \"407c3f2f-547b-4e37-afe3-7cfb01e64d8b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"
Jul 09 20:13:41.937990 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.937955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgfq4\" (UniqueName: \"kubernetes.io/projected/407c3f2f-547b-4e37-afe3-7cfb01e64d8b-kube-api-access-tgfq4\") pod \"dns-operator-controller-manager-864dd78c4c-j7zpr\" (UID: \"407c3f2f-547b-4e37-afe3-7cfb01e64d8b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"
Jul 09 20:13:41.958505 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:41.958475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgfq4\" (UniqueName: \"kubernetes.io/projected/407c3f2f-547b-4e37-afe3-7cfb01e64d8b-kube-api-access-tgfq4\") pod \"dns-operator-controller-manager-864dd78c4c-j7zpr\" (UID: \"407c3f2f-547b-4e37-afe3-7cfb01e64d8b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"
Jul 09 20:13:42.039557 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:42.039469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"
Jul 09 20:13:42.177257 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:42.177232    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"]
Jul 09 20:13:42.179954 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:13:42.179927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407c3f2f_547b_4e37_afe3_7cfb01e64d8b.slice/crio-7be7def789711a33f43843f23d377de3933cee622668d74cc509a6f7057a92ec WatchSource:0}: Error finding container 7be7def789711a33f43843f23d377de3933cee622668d74cc509a6f7057a92ec: Status 404 returned error can't find the container with id 7be7def789711a33f43843f23d377de3933cee622668d74cc509a6f7057a92ec
Jul 09 20:13:42.355668 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:42.355628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr" event={"ID":"407c3f2f-547b-4e37-afe3-7cfb01e64d8b","Type":"ContainerStarted","Data":"7be7def789711a33f43843f23d377de3933cee622668d74cc509a6f7057a92ec"}
Jul 09 20:13:43.781105 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.781071    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"]
Jul 09 20:13:43.784255 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.784235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.786427 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.786408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 20:13:43.786523 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.786484    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vqwng\""
Jul 09 20:13:43.786597 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.786576    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 20:13:43.792284 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.792264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"]
Jul 09 20:13:43.855600 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.855564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7dm4\" (UniqueName: \"kubernetes.io/projected/19c84445-4f1a-4552-bbcd-eb492b4a0e57-kube-api-access-n7dm4\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.855759 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.855612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c84445-4f1a-4552-bbcd-eb492b4a0e57-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.855759 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.855672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19c84445-4f1a-4552-bbcd-eb492b4a0e57-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.956606 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.956569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c84445-4f1a-4552-bbcd-eb492b4a0e57-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.956793 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.956617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19c84445-4f1a-4552-bbcd-eb492b4a0e57-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.956793 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.956707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dm4\" (UniqueName: \"kubernetes.io/projected/19c84445-4f1a-4552-bbcd-eb492b4a0e57-kube-api-access-n7dm4\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.956913 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:13:43.956817    2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 20:13:43.956968 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:13:43.956913    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c84445-4f1a-4552-bbcd-eb492b4a0e57-plugin-serving-cert podName:19c84445-4f1a-4552-bbcd-eb492b4a0e57 nodeName:}" failed. No retries permitted until 2026-07-09 20:13:44.456887262 +0000 UTC m=+615.941327261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/19c84445-4f1a-4552-bbcd-eb492b4a0e57-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-n288q" (UID: "19c84445-4f1a-4552-bbcd-eb492b4a0e57") : secret "plugin-serving-cert" not found
Jul 09 20:13:43.957499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.957478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19c84445-4f1a-4552-bbcd-eb492b4a0e57-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:43.967476 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:43.967455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7dm4\" (UniqueName: \"kubernetes.io/projected/19c84445-4f1a-4552-bbcd-eb492b4a0e57-kube-api-access-n7dm4\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:44.461842 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:44.461802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c84445-4f1a-4552-bbcd-eb492b4a0e57-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:44.464847 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:44.464822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c84445-4f1a-4552-bbcd-eb492b4a0e57-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n288q\" (UID: \"19c84445-4f1a-4552-bbcd-eb492b4a0e57\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:44.694559 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:44.694526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"
Jul 09 20:13:44.826360 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:44.826328    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n288q"]
Jul 09 20:13:44.828634 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:13:44.828604    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19c84445_4f1a_4552_bbcd_eb492b4a0e57.slice/crio-f1490a67955e3aa2168ac1d4c4f5d74d1783ba9a5c1eac8c059777da6703dc25 WatchSource:0}: Error finding container f1490a67955e3aa2168ac1d4c4f5d74d1783ba9a5c1eac8c059777da6703dc25: Status 404 returned error can't find the container with id f1490a67955e3aa2168ac1d4c4f5d74d1783ba9a5c1eac8c059777da6703dc25
Jul 09 20:13:45.372428 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:45.372391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q" event={"ID":"19c84445-4f1a-4552-bbcd-eb492b4a0e57","Type":"ContainerStarted","Data":"f1490a67955e3aa2168ac1d4c4f5d74d1783ba9a5c1eac8c059777da6703dc25"}
Jul 09 20:13:45.373820 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:45.373799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr" event={"ID":"407c3f2f-547b-4e37-afe3-7cfb01e64d8b","Type":"ContainerStarted","Data":"ec2038a0154fb7c0b546c95ad08d4252279bea7eeb6434d5ccc3ee9835629222"}
Jul 09 20:13:45.373932 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:45.373865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"
Jul 09 20:13:45.390041 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:45.389994    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr" podStartSLOduration=1.978391481 podStartE2EDuration="4.389977434s" totalImagesPullingTime="2.411585953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:13:45.388730718 +0000 UTC m=+616.873170736" watchObservedRunningTime="2026-07-09 20:13:45.389977434 +0000 UTC m=+616.874417435"
Jul 09 20:13:56.382102 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:13:56.381997    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-j7zpr"
Jul 09 20:14:10.498697 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:10.498652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q" event={"ID":"19c84445-4f1a-4552-bbcd-eb492b4a0e57","Type":"ContainerStarted","Data":"c1407ccb29a8a9584d9ea9f446657cd712ae15828ba766ee47bd1d2d08061188"}
Jul 09 20:14:10.515723 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:10.515668    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n288q" podStartSLOduration=2.591378961 podStartE2EDuration="27.515649141s" totalImagesPullingTime="24.92427018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:14:10.514438387 +0000 UTC m=+641.998878388" watchObservedRunningTime="2026-07-09 20:14:10.515649141 +0000 UTC m=+642.000089142"
Jul 09 20:14:42.248347 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.248311    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:14:42.275476 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.275441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:14:42.275629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.275562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.278134 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.278113    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 20:14:42.282569 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.282345    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:14:42.397090 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.397054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khpws\" (UniqueName: \"kubernetes.io/projected/97ae4fcb-2f49-4755-976a-1134b1aaeaee-kube-api-access-khpws\") pod \"limitador-limitador-54d6d988d5-dqb5p\" (UID: \"97ae4fcb-2f49-4755-976a-1134b1aaeaee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.397090 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.397100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97ae4fcb-2f49-4755-976a-1134b1aaeaee-config-file\") pod \"limitador-limitador-54d6d988d5-dqb5p\" (UID: \"97ae4fcb-2f49-4755-976a-1134b1aaeaee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.498619 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.498539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khpws\" (UniqueName: \"kubernetes.io/projected/97ae4fcb-2f49-4755-976a-1134b1aaeaee-kube-api-access-khpws\") pod \"limitador-limitador-54d6d988d5-dqb5p\" (UID: \"97ae4fcb-2f49-4755-976a-1134b1aaeaee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.498619 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.498580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97ae4fcb-2f49-4755-976a-1134b1aaeaee-config-file\") pod \"limitador-limitador-54d6d988d5-dqb5p\" (UID: \"97ae4fcb-2f49-4755-976a-1134b1aaeaee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.499167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.499148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97ae4fcb-2f49-4755-976a-1134b1aaeaee-config-file\") pod \"limitador-limitador-54d6d988d5-dqb5p\" (UID: \"97ae4fcb-2f49-4755-976a-1134b1aaeaee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.506854 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.506830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khpws\" (UniqueName: \"kubernetes.io/projected/97ae4fcb-2f49-4755-976a-1134b1aaeaee-kube-api-access-khpws\") pod \"limitador-limitador-54d6d988d5-dqb5p\" (UID: \"97ae4fcb-2f49-4755-976a-1134b1aaeaee\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.585579 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.585545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:42.722648 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.722622    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:14:42.725158 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:14:42.725124    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ae4fcb_2f49_4755_976a_1134b1aaeaee.slice/crio-8c8dd7c2f317b14fc543d4d7f2b8bd1d0c02180e8abbcba4db78296b7c64f007 WatchSource:0}: Error finding container 8c8dd7c2f317b14fc543d4d7f2b8bd1d0c02180e8abbcba4db78296b7c64f007: Status 404 returned error can't find the container with id 8c8dd7c2f317b14fc543d4d7f2b8bd1d0c02180e8abbcba4db78296b7c64f007
Jul 09 20:14:42.772893 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.772823    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jrlhh"]
Jul 09 20:14:42.776817 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.776796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrlhh"
Jul 09 20:14:42.779112 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.779089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z9bp7\""
Jul 09 20:14:42.785342 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.785320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrlhh"]
Jul 09 20:14:42.903152 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:42.903122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mgv5\" (UniqueName: \"kubernetes.io/projected/5383720c-feed-4ba3-bcb6-532985fb5d3b-kube-api-access-2mgv5\") pod \"authorino-58cd955675-jrlhh\" (UID: \"5383720c-feed-4ba3-bcb6-532985fb5d3b\") " pod="kuadrant-system/authorino-58cd955675-jrlhh"
Jul 09 20:14:43.003911 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:43.003878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mgv5\" (UniqueName: \"kubernetes.io/projected/5383720c-feed-4ba3-bcb6-532985fb5d3b-kube-api-access-2mgv5\") pod \"authorino-58cd955675-jrlhh\" (UID: \"5383720c-feed-4ba3-bcb6-532985fb5d3b\") " pod="kuadrant-system/authorino-58cd955675-jrlhh"
Jul 09 20:14:43.016270 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:43.016245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mgv5\" (UniqueName: \"kubernetes.io/projected/5383720c-feed-4ba3-bcb6-532985fb5d3b-kube-api-access-2mgv5\") pod \"authorino-58cd955675-jrlhh\" (UID: \"5383720c-feed-4ba3-bcb6-532985fb5d3b\") " pod="kuadrant-system/authorino-58cd955675-jrlhh"
Jul 09 20:14:43.087047 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:43.087017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrlhh"
Jul 09 20:14:43.217336 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:43.217227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrlhh"]
Jul 09 20:14:43.220183 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:14:43.220138    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5383720c_feed_4ba3_bcb6_532985fb5d3b.slice/crio-92500e7a34a15bdea8f4beffa584eca177285aa173da40b3a67b8e5b18261167 WatchSource:0}: Error finding container 92500e7a34a15bdea8f4beffa584eca177285aa173da40b3a67b8e5b18261167: Status 404 returned error can't find the container with id 92500e7a34a15bdea8f4beffa584eca177285aa173da40b3a67b8e5b18261167
Jul 09 20:14:43.646581 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:43.646525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrlhh" event={"ID":"5383720c-feed-4ba3-bcb6-532985fb5d3b","Type":"ContainerStarted","Data":"92500e7a34a15bdea8f4beffa584eca177285aa173da40b3a67b8e5b18261167"}
Jul 09 20:14:43.648239 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:43.648156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p" event={"ID":"97ae4fcb-2f49-4755-976a-1134b1aaeaee","Type":"ContainerStarted","Data":"8c8dd7c2f317b14fc543d4d7f2b8bd1d0c02180e8abbcba4db78296b7c64f007"}
Jul 09 20:14:45.661020 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:45.660937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p" event={"ID":"97ae4fcb-2f49-4755-976a-1134b1aaeaee","Type":"ContainerStarted","Data":"004b9c1514162edef500c77648b1f3e7317a1d2e0dec80ea0b386480bb064f5a"}
Jul 09 20:14:45.661497 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:45.661026    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:14:45.678529 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:45.678475    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p" podStartSLOduration=0.99553606 podStartE2EDuration="3.678451989s" totalImagesPullingTime="2.682915929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:14:45.676453943 +0000 UTC m=+677.160893987" watchObservedRunningTime="2026-07-09 20:14:45.678451989 +0000 UTC m=+677.162891989"
Jul 09 20:14:47.670578 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:47.670492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrlhh" event={"ID":"5383720c-feed-4ba3-bcb6-532985fb5d3b","Type":"ContainerStarted","Data":"042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f"}
Jul 09 20:14:47.685273 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:47.685225    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jrlhh" podStartSLOduration=1.5148971740000001 podStartE2EDuration="5.685190953s" totalImagesPullingTime="4.170293779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:14:47.683505029 +0000 UTC m=+679.167945031" watchObservedRunningTime="2026-07-09 20:14:47.685190953 +0000 UTC m=+679.169630999"
Jul 09 20:14:48.128462 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:48.128426    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrlhh"]
Jul 09 20:14:49.679345 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:49.679287    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jrlhh" podUID="5383720c-feed-4ba3-bcb6-532985fb5d3b" containerName="authorino" containerID="cri-o://042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f" gracePeriod=30
Jul 09 20:14:49.921926 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:49.921902    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrlhh"
Jul 09 20:14:49.968899 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:49.968805    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mgv5\" (UniqueName: \"kubernetes.io/projected/5383720c-feed-4ba3-bcb6-532985fb5d3b-kube-api-access-2mgv5\") pod \"5383720c-feed-4ba3-bcb6-532985fb5d3b\" (UID: \"5383720c-feed-4ba3-bcb6-532985fb5d3b\") "
Jul 09 20:14:49.971082 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:49.971058    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5383720c-feed-4ba3-bcb6-532985fb5d3b-kube-api-access-2mgv5" (OuterVolumeSpecName: "kube-api-access-2mgv5") pod "5383720c-feed-4ba3-bcb6-532985fb5d3b" (UID: "5383720c-feed-4ba3-bcb6-532985fb5d3b"). InnerVolumeSpecName "kube-api-access-2mgv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:14:50.070411 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.070366    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mgv5\" (UniqueName: \"kubernetes.io/projected/5383720c-feed-4ba3-bcb6-532985fb5d3b-kube-api-access-2mgv5\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:14:50.685001 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.684966    2565 generic.go:356] "Generic (PLEG): container finished" podID="5383720c-feed-4ba3-bcb6-532985fb5d3b" containerID="042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f" exitCode=0
Jul 09 20:14:50.685433 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.685010    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jrlhh"
Jul 09 20:14:50.685433 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.685027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrlhh" event={"ID":"5383720c-feed-4ba3-bcb6-532985fb5d3b","Type":"ContainerDied","Data":"042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f"}
Jul 09 20:14:50.685433 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.685057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jrlhh" event={"ID":"5383720c-feed-4ba3-bcb6-532985fb5d3b","Type":"ContainerDied","Data":"92500e7a34a15bdea8f4beffa584eca177285aa173da40b3a67b8e5b18261167"}
Jul 09 20:14:50.685433 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.685074    2565 scope.go:117] "RemoveContainer" containerID="042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f"
Jul 09 20:14:50.693466 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.693446    2565 scope.go:117] "RemoveContainer" containerID="042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f"
Jul 09 20:14:50.693715 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:14:50.693696    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f\": container with ID starting with 042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f not found: ID does not exist" containerID="042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f"
Jul 09 20:14:50.693766 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.693723    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f"} err="failed to get container status \"042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f\": rpc error: code = NotFound desc = could not find container \"042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f\": container with ID starting with 042afb8b28ca624a9c713c6fea4b6a2504430a4a650c7923c169f850de447f5f not found: ID does not exist"
Jul 09 20:14:50.705005 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.704983    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrlhh"]
Jul 09 20:14:50.708665 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:50.708644    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jrlhh"]
Jul 09 20:14:51.114083 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:51.114048    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5383720c-feed-4ba3-bcb6-532985fb5d3b" path="/var/lib/kubelet/pods/5383720c-feed-4ba3-bcb6-532985fb5d3b/volumes"
Jul 09 20:14:56.666678 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:14:56.666640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"
Jul 09 20:15:12.501761 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.501723    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r8sgz"]
Jul 09 20:15:12.502257 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.502054    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5383720c-feed-4ba3-bcb6-532985fb5d3b" containerName="authorino"
Jul 09 20:15:12.502257 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.502065    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5383720c-feed-4ba3-bcb6-532985fb5d3b" containerName="authorino"
Jul 09 20:15:12.502257 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.502132    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5383720c-feed-4ba3-bcb6-532985fb5d3b" containerName="authorino"
Jul 09 20:15:12.504201 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.504185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r8sgz"
Jul 09 20:15:12.506587 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.506565    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z9bp7\""
Jul 09 20:15:12.512332 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.512308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r8sgz"]
Jul 09 20:15:12.684573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.684539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcjbw\" (UniqueName: \"kubernetes.io/projected/b3639fe7-57ec-4f01-8470-2c50b26dd0c4-kube-api-access-tcjbw\") pod \"authorino-5d4b67c446-r8sgz\" (UID: \"b3639fe7-57ec-4f01-8470-2c50b26dd0c4\") " pod="kuadrant-system/authorino-5d4b67c446-r8sgz"
Jul 09 20:15:12.769910 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.769821    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r8sgz"]
Jul 09 20:15:12.770107 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:15:12.770089    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tcjbw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-r8sgz" podUID="b3639fe7-57ec-4f01-8470-2c50b26dd0c4"
Jul 09 20:15:12.783471 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.783447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r8sgz"
Jul 09 20:15:12.785841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.785819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcjbw\" (UniqueName: \"kubernetes.io/projected/b3639fe7-57ec-4f01-8470-2c50b26dd0c4-kube-api-access-tcjbw\") pod \"authorino-5d4b67c446-r8sgz\" (UID: \"b3639fe7-57ec-4f01-8470-2c50b26dd0c4\") " pod="kuadrant-system/authorino-5d4b67c446-r8sgz"
Jul 09 20:15:12.789378 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.789361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r8sgz"
Jul 09 20:15:12.802453 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.802432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcjbw\" (UniqueName: \"kubernetes.io/projected/b3639fe7-57ec-4f01-8470-2c50b26dd0c4-kube-api-access-tcjbw\") pod \"authorino-5d4b67c446-r8sgz\" (UID: \"b3639fe7-57ec-4f01-8470-2c50b26dd0c4\") " pod="kuadrant-system/authorino-5d4b67c446-r8sgz"
Jul 09 20:15:12.988061 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.988021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcjbw\" (UniqueName: \"kubernetes.io/projected/b3639fe7-57ec-4f01-8470-2c50b26dd0c4-kube-api-access-tcjbw\") pod \"b3639fe7-57ec-4f01-8470-2c50b26dd0c4\" (UID: \"b3639fe7-57ec-4f01-8470-2c50b26dd0c4\") "
Jul 09 20:15:12.990417 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:12.990393    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3639fe7-57ec-4f01-8470-2c50b26dd0c4-kube-api-access-tcjbw" (OuterVolumeSpecName: "kube-api-access-tcjbw") pod "b3639fe7-57ec-4f01-8470-2c50b26dd0c4" (UID: "b3639fe7-57ec-4f01-8470-2c50b26dd0c4"). InnerVolumeSpecName "kube-api-access-tcjbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:15:13.089116 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:13.089075    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcjbw\" (UniqueName: \"kubernetes.io/projected/b3639fe7-57ec-4f01-8470-2c50b26dd0c4-kube-api-access-tcjbw\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:15:13.787317 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:13.787287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r8sgz"
Jul 09 20:15:13.812973 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:13.812941    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r8sgz"]
Jul 09 20:15:13.815405 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:13.815376    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r8sgz"]
Jul 09 20:15:15.114779 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:15.114747    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3639fe7-57ec-4f01-8470-2c50b26dd0c4" path="/var/lib/kubelet/pods/b3639fe7-57ec-4f01-8470-2c50b26dd0c4/volumes"
Jul 09 20:15:58.678161 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:15:58.678126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:16:16.901880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:16:16.901841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:16:27.808367 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:16:27.808330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:16:51.905382 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:16:51.905297    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:17:05.208512 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.208476    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"]
Jul 09 20:17:05.210766 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.210749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.214444 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.214414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 20:17:05.215543 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.215519    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 20:17:05.215646 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.215552    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 20:17:05.215646 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.215584    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2qhc4\""
Jul 09 20:17:05.221063 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.221040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"]
Jul 09 20:17:05.285200 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.285168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.285394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.285205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.285394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.285284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0da871b6-2fdc-46b0-8150-71608df845f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.285394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.285318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.285394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.285347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgwp7\" (UniqueName: \"kubernetes.io/projected/0da871b6-2fdc-46b0-8150-71608df845f4-kube-api-access-xgwp7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.285538 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.285396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386276 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386453 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgwp7\" (UniqueName: \"kubernetes.io/projected/0da871b6-2fdc-46b0-8150-71608df845f4-kube-api-access-xgwp7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386453 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386547 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386593 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386593 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0da871b6-2fdc-46b0-8150-71608df845f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386688 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.386889 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.386869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.388736 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.388718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0da871b6-2fdc-46b0-8150-71608df845f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.389081 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.389061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0da871b6-2fdc-46b0-8150-71608df845f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.393840 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.393817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgwp7\" (UniqueName: \"kubernetes.io/projected/0da871b6-2fdc-46b0-8150-71608df845f4-kube-api-access-xgwp7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj\" (UID: \"0da871b6-2fdc-46b0-8150-71608df845f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.521280 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.521176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:05.654902 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.654875    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"]
Jul 09 20:17:05.657292 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:17:05.657267    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da871b6_2fdc_46b0_8150_71608df845f4.slice/crio-5e1d04ff84a0ea2353568f55cb4b664adef1c9f0c83e1b8d7d00c8196e630b8a WatchSource:0}: Error finding container 5e1d04ff84a0ea2353568f55cb4b664adef1c9f0c83e1b8d7d00c8196e630b8a: Status 404 returned error can't find the container with id 5e1d04ff84a0ea2353568f55cb4b664adef1c9f0c83e1b8d7d00c8196e630b8a
Jul 09 20:17:05.658887 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:05.658859    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 20:17:06.275288 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:06.275245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj" event={"ID":"0da871b6-2fdc-46b0-8150-71608df845f4","Type":"ContainerStarted","Data":"5e1d04ff84a0ea2353568f55cb4b664adef1c9f0c83e1b8d7d00c8196e630b8a"}
Jul 09 20:17:06.815483 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:06.815444    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:17:07.281462 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:07.281369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj" event={"ID":"0da871b6-2fdc-46b0-8150-71608df845f4","Type":"ContainerStarted","Data":"ac04a29e7368e5ebeafcc68e62426637335f614ae79d369397297954cbfd2525"}
Jul 09 20:17:07.298343 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:07.298288    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj" podStartSLOduration=0.969517455 podStartE2EDuration="2.298268171s" totalImagesPullingTime="1.328750716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:17:07.296813514 +0000 UTC m=+818.781253519" watchObservedRunningTime="2026-07-09 20:17:07.298268171 +0000 UTC m=+818.782708219"
Jul 09 20:17:15.521990 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:15.521946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:15.522494 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:15.522024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:15.534873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:15.534847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:16.009336 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:16.009302    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:17:16.334498 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:16.334469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj"
Jul 09 20:17:19.696012 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.695974    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"]
Jul 09 20:17:19.699453 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.699433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.701925 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.701901    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 20:17:19.707166 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.707135    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"]
Jul 09 20:17:19.819538 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.819493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.819724 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.819551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.819724 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.819615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.819724 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.819688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.819724 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.819716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.819863 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.819757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnftb\" (UniqueName: \"kubernetes.io/projected/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-kube-api-access-mnftb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.920954 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.920904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921159 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.920971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921159 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.921045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921159 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.921067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921159 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.921132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnftb\" (UniqueName: \"kubernetes.io/projected/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-kube-api-access-mnftb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921467 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.921160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921526 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.921474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921526 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.921487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.921621 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.921528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.923493 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.923465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.923791 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.923771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:19.930015 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:19.929993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnftb\" (UniqueName: \"kubernetes.io/projected/828e9dce-474c-4a2d-b13f-3aa8a3aa3b05-kube-api-access-mnftb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg\" (UID: \"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:20.010320 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:20.010198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:20.149177 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:20.149145    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"]
Jul 09 20:17:20.151942 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:17:20.151911    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod828e9dce_474c_4a2d_b13f_3aa8a3aa3b05.slice/crio-fede6771e556e978eb75043fd38dcdc60667cfa6d4075e364813f4f7e3760101 WatchSource:0}: Error finding container fede6771e556e978eb75043fd38dcdc60667cfa6d4075e364813f4f7e3760101: Status 404 returned error can't find the container with id fede6771e556e978eb75043fd38dcdc60667cfa6d4075e364813f4f7e3760101
Jul 09 20:17:20.342898 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:20.342864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg" event={"ID":"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05","Type":"ContainerStarted","Data":"fede6771e556e978eb75043fd38dcdc60667cfa6d4075e364813f4f7e3760101"}
Jul 09 20:17:21.348908 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:21.348875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg" event={"ID":"828e9dce-474c-4a2d-b13f-3aa8a3aa3b05","Type":"ContainerStarted","Data":"54122e45515c61463d83edced11122dfd3d5a6ba814602d646f7d81fe7ae7126"}
Jul 09 20:17:21.365718 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:21.365664    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg" podStartSLOduration=2.168215927 podStartE2EDuration="2.365644148s" totalImagesPullingTime="197.428221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:17:21.364925665 +0000 UTC m=+832.849365667" watchObservedRunningTime="2026-07-09 20:17:21.365644148 +0000 UTC m=+832.850084149"
Jul 09 20:17:23.463608 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:23.463572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:17:30.010797 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:30.010757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:30.011187 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:30.010809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:30.023280 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:30.023249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:17:30.402860 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:17:30.402826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg"
Jul 09 20:18:23.902575 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:23.902490    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d65c679b7-4nfqt"]
Jul 09 20:18:23.905910 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:23.905887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:23.909097 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:23.909075    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 20:18:23.909253 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:23.909075    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z9bp7\""
Jul 09 20:18:23.912353 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:23.912325    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d65c679b7-4nfqt"]
Jul 09 20:18:24.009856 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.009815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptmv\" (UniqueName: \"kubernetes.io/projected/ae0ce082-9455-4d6e-b44a-bd51d8fc3a68-kube-api-access-tptmv\") pod \"authorino-6d65c679b7-4nfqt\" (UID: \"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68\") " pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:24.010028 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.009969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae0ce082-9455-4d6e-b44a-bd51d8fc3a68-tls-cert\") pod \"authorino-6d65c679b7-4nfqt\" (UID: \"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68\") " pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:24.111089 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.111050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae0ce082-9455-4d6e-b44a-bd51d8fc3a68-tls-cert\") pod \"authorino-6d65c679b7-4nfqt\" (UID: \"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68\") " pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:24.111295 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.111103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptmv\" (UniqueName: \"kubernetes.io/projected/ae0ce082-9455-4d6e-b44a-bd51d8fc3a68-kube-api-access-tptmv\") pod \"authorino-6d65c679b7-4nfqt\" (UID: \"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68\") " pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:24.113841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.113812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae0ce082-9455-4d6e-b44a-bd51d8fc3a68-tls-cert\") pod \"authorino-6d65c679b7-4nfqt\" (UID: \"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68\") " pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:24.118623 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.118599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptmv\" (UniqueName: \"kubernetes.io/projected/ae0ce082-9455-4d6e-b44a-bd51d8fc3a68-kube-api-access-tptmv\") pod \"authorino-6d65c679b7-4nfqt\" (UID: \"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68\") " pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:24.231046 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.230952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d65c679b7-4nfqt"
Jul 09 20:18:24.365483 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.365457    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d65c679b7-4nfqt"]
Jul 09 20:18:24.367604 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:18:24.367575    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae0ce082_9455_4d6e_b44a_bd51d8fc3a68.slice/crio-8f33bd554bc134156d551c6ca0f35b08c8220c82712377b3288e91ade156d5c2 WatchSource:0}: Error finding container 8f33bd554bc134156d551c6ca0f35b08c8220c82712377b3288e91ade156d5c2: Status 404 returned error can't find the container with id 8f33bd554bc134156d551c6ca0f35b08c8220c82712377b3288e91ade156d5c2
Jul 09 20:18:24.641608 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:24.641553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d65c679b7-4nfqt" event={"ID":"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68","Type":"ContainerStarted","Data":"8f33bd554bc134156d551c6ca0f35b08c8220c82712377b3288e91ade156d5c2"}
Jul 09 20:18:25.648488 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:25.648449    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d65c679b7-4nfqt" event={"ID":"ae0ce082-9455-4d6e-b44a-bd51d8fc3a68","Type":"ContainerStarted","Data":"916066e9cdd26bffdfc30023e4ceb89058ebb734b50ea17b5d740f5b5207e55b"}
Jul 09 20:18:25.668446 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:25.668389    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d65c679b7-4nfqt" podStartSLOduration=2.219407475 podStartE2EDuration="2.668369936s" totalImagesPullingTime="448.962461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:18:25.666497028 +0000 UTC m=+897.150937031" watchObservedRunningTime="2026-07-09 20:18:25.668369936 +0000 UTC m=+897.152809972"
Jul 09 20:18:29.017289 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:29.017253    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:18:29.017946 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:29.017924    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:18:55.019232 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:18:55.019178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:19:05.614408 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:19:05.614365    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:19:16.809083 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:19:16.809044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:19:25.516597 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:19:25.516520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:19:36.005715 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:19:36.005672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:20:03.605403 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:20:03.605313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:20:18.313364 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:20:18.313333    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:20:51.903049 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:20:51.903013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:21:02.398549 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:21:02.398514    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:21:13.705277 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:21:13.705240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:21:21.204133 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:21:21.204044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:21:32.699353 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:21:32.699292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:21:42.103799 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:21:42.103757    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:21:53.505310 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:21:53.505272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:22:04.210291 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:22:04.210251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:22:25.917347 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:22:25.917310    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:22:35.215081 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:22:35.215044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:22:57.707427 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:22:57.707336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:23:08.896976 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:23:08.896936    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:23:25.404580 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:23:25.404545    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:23:29.044908 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:23:29.044878    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:23:29.046395 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:23:29.046373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:23:35.407823 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:23:35.407782    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:23:45.207805 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:23:45.207768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:23:54.811722 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:23:54.811687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:24:05.002616 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:24:05.002581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:25:51.715396 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:25:51.715313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:26:01.706262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:26:01.705318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:26:19.801394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:26:19.801355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:26:29.609346 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:26:29.609312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:26:41.114536 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:26:41.114503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:26:52.906115 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:26:52.906084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:27:01.308696 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:27:01.308658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:27:11.404457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:27:11.404418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:27:23.310522 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:27:23.310441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:27:31.404268 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:27:31.404236    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:27:43.403035 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:27:43.403003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:28:08.617628 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:08.617584    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:28:16.210868 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:16.210831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:28:26.904894 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:26.904853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:28:29.073299 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:29.073067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:28:29.081497 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:29.081478    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:28:36.503616 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:36.503581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:28:45.610597 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:45.610565    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:28:58.115267 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:28:58.115232    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:29:11.915925 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:29:11.915886    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:29:22.610257 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:29:22.610220    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:29:36.304018 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:29:36.303984    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:29:46.005980 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:29:46.005947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:29:56.911498 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:29:56.911454    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:30:14.211138 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:30:14.211101    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:30:24.400907 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:30:24.400821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:30:35.802006 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:30:35.801963    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:30:45.800902 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:30:45.800867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:31:03.815011 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:31:03.814971    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:31:16.513324 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:31:16.513292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:31:29.514578 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:31:29.514539    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:31:43.107775 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:31:43.107738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:31:51.613342 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:31:51.613260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:32:02.039618 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:32:02.039577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:32:38.902740 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:32:38.902704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:32:50.421082 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:32:50.421041    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:33:29.106528 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:33:29.106499    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:33:29.111866 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:33:29.111832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:34:11.003158 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:34:11.003120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:34:20.802984 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:34:20.802949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:34:32.104653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:34:32.104614    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:34:40.707354 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:34:40.707318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:35:12.705405 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:12.705300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:35:19.206497 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.206457    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"]
Jul 09 20:35:19.209899 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.209874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.213268 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.213245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-92a49739\"/\"openshift-service-ca.crt\""
Jul 09 20:35:19.213268 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.213259    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-92a49739\"/\"kube-root-ca.crt\""
Jul 09 20:35:19.213452 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.213303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-92a49739\"/\"e2e-lifecycle-model-92a49739-kserve-self-signed-certs\""
Jul 09 20:35:19.213452 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.213246    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-92a49739\"/\"default-dockercfg-54s88\""
Jul 09 20:35:19.219563 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.219537    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"]
Jul 09 20:35:19.320286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.320248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42494cc1-56ff-4b43-acc8-d65ef0f06596-tls-certs\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.320286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.320289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-dshm\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.320517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.320409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p744p\" (UniqueName: \"kubernetes.io/projected/42494cc1-56ff-4b43-acc8-d65ef0f06596-kube-api-access-p744p\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.320517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.320441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-model-cache\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.320517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.320464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-home\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.320517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.320507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-tmp-dir\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.421653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.421591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42494cc1-56ff-4b43-acc8-d65ef0f06596-tls-certs\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.421653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.421654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-dshm\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.421907 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.421717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p744p\" (UniqueName: \"kubernetes.io/projected/42494cc1-56ff-4b43-acc8-d65ef0f06596-kube-api-access-p744p\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.421907 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.421747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-model-cache\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.421907 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.421765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-home\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.421907 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.421789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-tmp-dir\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.422226 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.422178    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-model-cache\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.422354 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.422240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-home\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.422354 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.422302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-tmp-dir\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.424117 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.424094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-dshm\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.424361 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.424344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42494cc1-56ff-4b43-acc8-d65ef0f06596-tls-certs\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.429381 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.429362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p744p\" (UniqueName: \"kubernetes.io/projected/42494cc1-56ff-4b43-acc8-d65ef0f06596-kube-api-access-p744p\") pod \"e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") " pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.520767 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.520682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:19.654027 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:19.654001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"]
Jul 09 20:35:19.656548 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:35:19.656515    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42494cc1_56ff_4b43_acc8_d65ef0f06596.slice/crio-850cf1e4dc1bc0d986753533522f9ec62947bbe06d87bb8be207b8bfdd150fa1 WatchSource:0}: Error finding container 850cf1e4dc1bc0d986753533522f9ec62947bbe06d87bb8be207b8bfdd150fa1: Status 404 returned error can't find the container with id 850cf1e4dc1bc0d986753533522f9ec62947bbe06d87bb8be207b8bfdd150fa1
Jul 09 20:35:20.263312 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:20.263274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m" event={"ID":"42494cc1-56ff-4b43-acc8-d65ef0f06596","Type":"ContainerStarted","Data":"690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94"}
Jul 09 20:35:20.263672 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:20.263329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m" event={"ID":"42494cc1-56ff-4b43-acc8-d65ef0f06596","Type":"ContainerStarted","Data":"850cf1e4dc1bc0d986753533522f9ec62947bbe06d87bb8be207b8bfdd150fa1"}
Jul 09 20:35:20.279169 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:20.279124    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m" podStartSLOduration=1.279109534 podStartE2EDuration="1.279109534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:35:20.27809562 +0000 UTC m=+1911.762535621" watchObservedRunningTime="2026-07-09 20:35:20.279109534 +0000 UTC m=+1911.763549533"
Jul 09 20:35:21.603600 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:21.603563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:35:29.521822 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:29.521778    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:29.522294 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:29.521845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:29.534846 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:29.534827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:30.318906 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:30.318875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:35:47.608590 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:47.608550    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:35:58.606543 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:35:58.606506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:36:03.866476 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:03.866440    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"]
Jul 09 20:36:08.707941 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:08.707905    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:36:18.887629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:18.887562    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m" podUID="42494cc1-56ff-4b43-acc8-d65ef0f06596" containerName="main" containerID="cri-o://690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94" gracePeriod=45
Jul 09 20:36:19.145253 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.145170    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:36:19.269477 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269440    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p744p\" (UniqueName: \"kubernetes.io/projected/42494cc1-56ff-4b43-acc8-d65ef0f06596-kube-api-access-p744p\") pod \"42494cc1-56ff-4b43-acc8-d65ef0f06596\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") "
Jul 09 20:36:19.269662 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269506    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-tmp-dir\") pod \"42494cc1-56ff-4b43-acc8-d65ef0f06596\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") "
Jul 09 20:36:19.269662 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269529    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-dshm\") pod \"42494cc1-56ff-4b43-acc8-d65ef0f06596\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") "
Jul 09 20:36:19.269662 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-model-cache\") pod \"42494cc1-56ff-4b43-acc8-d65ef0f06596\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") "
Jul 09 20:36:19.269662 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269624    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-home\") pod \"42494cc1-56ff-4b43-acc8-d65ef0f06596\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") "
Jul 09 20:36:19.269662 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42494cc1-56ff-4b43-acc8-d65ef0f06596-tls-certs\") pod \"42494cc1-56ff-4b43-acc8-d65ef0f06596\" (UID: \"42494cc1-56ff-4b43-acc8-d65ef0f06596\") "
Jul 09 20:36:19.269911 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269822    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42494cc1-56ff-4b43-acc8-d65ef0f06596" (UID: "42494cc1-56ff-4b43-acc8-d65ef0f06596"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:36:19.269973 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269908    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-home" (OuterVolumeSpecName: "home") pod "42494cc1-56ff-4b43-acc8-d65ef0f06596" (UID: "42494cc1-56ff-4b43-acc8-d65ef0f06596"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:36:19.270030 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.269993    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-model-cache" (OuterVolumeSpecName: "model-cache") pod "42494cc1-56ff-4b43-acc8-d65ef0f06596" (UID: "42494cc1-56ff-4b43-acc8-d65ef0f06596"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:36:19.272012 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.271985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42494cc1-56ff-4b43-acc8-d65ef0f06596-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42494cc1-56ff-4b43-acc8-d65ef0f06596" (UID: "42494cc1-56ff-4b43-acc8-d65ef0f06596"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:36:19.272012 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.271998    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-dshm" (OuterVolumeSpecName: "dshm") pod "42494cc1-56ff-4b43-acc8-d65ef0f06596" (UID: "42494cc1-56ff-4b43-acc8-d65ef0f06596"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:36:19.272012 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.271983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42494cc1-56ff-4b43-acc8-d65ef0f06596-kube-api-access-p744p" (OuterVolumeSpecName: "kube-api-access-p744p") pod "42494cc1-56ff-4b43-acc8-d65ef0f06596" (UID: "42494cc1-56ff-4b43-acc8-d65ef0f06596"). InnerVolumeSpecName "kube-api-access-p744p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:36:19.370799 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.370761    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p744p\" (UniqueName: \"kubernetes.io/projected/42494cc1-56ff-4b43-acc8-d65ef0f06596-kube-api-access-p744p\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:36:19.370799 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.370792    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:36:19.370799 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.370801    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:36:19.371075 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.370810    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:36:19.371075 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.370819    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42494cc1-56ff-4b43-acc8-d65ef0f06596-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:36:19.371075 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.370826    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42494cc1-56ff-4b43-acc8-d65ef0f06596-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:36:19.538964 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.538873    2565 generic.go:356] "Generic (PLEG): container finished" podID="42494cc1-56ff-4b43-acc8-d65ef0f06596" containerID="690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94" exitCode=0
Jul 09 20:36:19.538964 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.538947    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"
Jul 09 20:36:19.539156 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.538957    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m" event={"ID":"42494cc1-56ff-4b43-acc8-d65ef0f06596","Type":"ContainerDied","Data":"690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94"}
Jul 09 20:36:19.539156 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.539005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m" event={"ID":"42494cc1-56ff-4b43-acc8-d65ef0f06596","Type":"ContainerDied","Data":"850cf1e4dc1bc0d986753533522f9ec62947bbe06d87bb8be207b8bfdd150fa1"}
Jul 09 20:36:19.539156 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.539023    2565 scope.go:117] "RemoveContainer" containerID="690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94"
Jul 09 20:36:19.548202 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.548183    2565 scope.go:117] "RemoveContainer" containerID="690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94"
Jul 09 20:36:19.548472 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:36:19.548454    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94\": container with ID starting with 690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94 not found: ID does not exist" containerID="690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94"
Jul 09 20:36:19.548518 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.548481    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94"} err="failed to get container status \"690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94\": rpc error: code = NotFound desc = could not find container \"690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94\": container with ID starting with 690e463d04858744e29be07cfce9ec035169263791a3111035b5b60d35326a94 not found: ID does not exist"
Jul 09 20:36:19.559908 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.559885    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"]
Jul 09 20:36:19.564048 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:19.564028    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-92a49739/e2e-lifecycle-model-92a49739-kserve-758dc85f55-h6p8m"]
Jul 09 20:36:21.114728 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:21.114693    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42494cc1-56ff-4b43-acc8-d65ef0f06596" path="/var/lib/kubelet/pods/42494cc1-56ff-4b43-acc8-d65ef0f06596/volumes"
Jul 09 20:36:44.006109 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:44.006071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:36:58.106579 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:36:58.106538    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:37:08.004953 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:37:08.004912    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:37:53.439515 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:37:53.439440    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:38:05.306703 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:05.306669    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:38:06.709531 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.709501    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"]
Jul 09 20:38:06.709912 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.709840    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42494cc1-56ff-4b43-acc8-d65ef0f06596" containerName="main"
Jul 09 20:38:06.709912 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.709851    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="42494cc1-56ff-4b43-acc8-d65ef0f06596" containerName="main"
Jul 09 20:38:06.709912 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.709910    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="42494cc1-56ff-4b43-acc8-d65ef0f06596" containerName="main"
Jul 09 20:38:06.712977 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.712960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.715616 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.715595    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c0edf2\"/\"kube-root-ca.crt\""
Jul 09 20:38:06.716598 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.716579    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c0edf2\"/\"default-dockercfg-qr7kh\""
Jul 09 20:38:06.716653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.716602    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c0edf2\"/\"openshift-service-ca.crt\""
Jul 09 20:38:06.716727 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.716704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c0edf2\"/\"test-model-c0edf2-kserve-self-signed-certs\""
Jul 09 20:38:06.721385 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.721358    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"]
Jul 09 20:38:06.762471 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.762433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v55tz\" (UniqueName: \"kubernetes.io/projected/05712317-a7b0-4b9c-a77a-68a403c76359-kube-api-access-v55tz\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.762680 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.762490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-tmp-dir\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.762680 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.762510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-dshm\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.762680 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.762563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-home\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.762680 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.762605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05712317-a7b0-4b9c-a77a-68a403c76359-tls-certs\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.762680 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.762630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-model-cache\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.863910 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.863863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-home\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864089 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.863946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05712317-a7b0-4b9c-a77a-68a403c76359-tls-certs\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864089 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.863976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-model-cache\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864089 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.864031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v55tz\" (UniqueName: \"kubernetes.io/projected/05712317-a7b0-4b9c-a77a-68a403c76359-kube-api-access-v55tz\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864089 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.864082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-tmp-dir\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864319 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.864108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-dshm\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864419 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.864396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-home\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864489 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.864415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-model-cache\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.864489 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.864470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-tmp-dir\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.866505 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.866486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-dshm\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.866743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.866727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05712317-a7b0-4b9c-a77a-68a403c76359-tls-certs\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:06.871960 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:06.871938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v55tz\" (UniqueName: \"kubernetes.io/projected/05712317-a7b0-4b9c-a77a-68a403c76359-kube-api-access-v55tz\") pod \"test-model-c0edf2-kserve-d6b774f49-bz79v\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") " pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:07.022814 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:07.022714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:07.160844 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:07.160805    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"]
Jul 09 20:38:07.164073 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:38:07.164041    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05712317_a7b0_4b9c_a77a_68a403c76359.slice/crio-002801970cb6d8c79e07a0ff6f2ee48d6b3aa86e0afbf74dd7379e4563a5dc12 WatchSource:0}: Error finding container 002801970cb6d8c79e07a0ff6f2ee48d6b3aa86e0afbf74dd7379e4563a5dc12: Status 404 returned error can't find the container with id 002801970cb6d8c79e07a0ff6f2ee48d6b3aa86e0afbf74dd7379e4563a5dc12
Jul 09 20:38:08.027981 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:08.027944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v" event={"ID":"05712317-a7b0-4b9c-a77a-68a403c76359","Type":"ContainerStarted","Data":"0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0"}
Jul 09 20:38:08.027981 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:08.027989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v" event={"ID":"05712317-a7b0-4b9c-a77a-68a403c76359","Type":"ContainerStarted","Data":"002801970cb6d8c79e07a0ff6f2ee48d6b3aa86e0afbf74dd7379e4563a5dc12"}
Jul 09 20:38:08.044517 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:08.044450    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v" podStartSLOduration=2.044430895 podStartE2EDuration="2.044430895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:38:08.042422933 +0000 UTC m=+2079.526862933" watchObservedRunningTime="2026-07-09 20:38:08.044430895 +0000 UTC m=+2079.528870896"
Jul 09 20:38:17.023191 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:17.023150    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:17.023581 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:17.023229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:17.035537 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:17.035508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:17.092846 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:17.092811    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:38:21.301722 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:21.301681    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:38:29.135337 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:29.135307    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:38:29.142354 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:29.142333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:38:35.417201 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.417162    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"]
Jul 09 20:38:35.420592 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.420573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.422985 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.422961    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-00edb0\"/\"default-dockercfg-rrnp9\""
Jul 09 20:38:35.424021 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.424000    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-00edb0\"/\"kube-root-ca.crt\""
Jul 09 20:38:35.424140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.424036    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-00edb0\"/\"test-model-00edb0-kserve-self-signed-certs\""
Jul 09 20:38:35.424140 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.424053    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-00edb0\"/\"openshift-service-ca.crt\""
Jul 09 20:38:35.429681 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.429655    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"]
Jul 09 20:38:35.544222 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.544170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fb0028d-6762-48c6-aa37-df710e0150ea-tls-certs\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.544397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.544250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-dshm\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.544397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.544286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvvhr\" (UniqueName: \"kubernetes.io/projected/0fb0028d-6762-48c6-aa37-df710e0150ea-kube-api-access-kvvhr\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.544397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.544306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-home\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.544397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.544350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-tmp-dir\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.544397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.544367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-model-cache\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.645298 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fb0028d-6762-48c6-aa37-df710e0150ea-tls-certs\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.645298 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-dshm\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.645556 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvhr\" (UniqueName: \"kubernetes.io/projected/0fb0028d-6762-48c6-aa37-df710e0150ea-kube-api-access-kvvhr\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.645556 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-home\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.645556 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-tmp-dir\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.645556 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-model-cache\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.645899 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-home\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.646016 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-tmp-dir\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.646016 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.645911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-model-cache\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.647711 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.647692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-dshm\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.648008 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.647990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fb0028d-6762-48c6-aa37-df710e0150ea-tls-certs\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.653822 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.653801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvvhr\" (UniqueName: \"kubernetes.io/projected/0fb0028d-6762-48c6-aa37-df710e0150ea-kube-api-access-kvvhr\") pod \"test-model-00edb0-kserve-7457594ddc-ld95z\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") " pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.731150 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.731055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:35.867641 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:35.867615    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"]
Jul 09 20:38:35.869933 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:38:35.869895    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fb0028d_6762_48c6_aa37_df710e0150ea.slice/crio-e5ff6b1aec9882b2662fdf4fc78774f67d3dac7f140698fc7e4f62c0fb3d4c10 WatchSource:0}: Error finding container e5ff6b1aec9882b2662fdf4fc78774f67d3dac7f140698fc7e4f62c0fb3d4c10: Status 404 returned error can't find the container with id e5ff6b1aec9882b2662fdf4fc78774f67d3dac7f140698fc7e4f62c0fb3d4c10
Jul 09 20:38:36.164585 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:36.164545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z" event={"ID":"0fb0028d-6762-48c6-aa37-df710e0150ea","Type":"ContainerStarted","Data":"f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f"}
Jul 09 20:38:36.164585 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:36.164590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z" event={"ID":"0fb0028d-6762-48c6-aa37-df710e0150ea","Type":"ContainerStarted","Data":"e5ff6b1aec9882b2662fdf4fc78774f67d3dac7f140698fc7e4f62c0fb3d4c10"}
Jul 09 20:38:36.181085 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:36.181034    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z" podStartSLOduration=1.181014431 podStartE2EDuration="1.181014431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:38:36.180620111 +0000 UTC m=+2107.665060106" watchObservedRunningTime="2026-07-09 20:38:36.181014431 +0000 UTC m=+2107.665454433"
Jul 09 20:38:40.005873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:40.005833    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:38:45.731201 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:45.731157    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:45.731724 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:45.731249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:45.744333 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:45.744304    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:46.221736 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:46.221703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:38:55.002302 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:55.002259    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:38:56.345551 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:56.345520    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"]
Jul 09 20:38:57.312376 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:38:57.312340    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"]
Jul 09 20:39:10.507505 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:10.507463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:39:11.367371 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.367322    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v" podUID="05712317-a7b0-4b9c-a77a-68a403c76359" containerName="main" containerID="cri-o://0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0" gracePeriod=45
Jul 09 20:39:11.620188 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.620120    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:39:11.689535 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-dshm\") pod \"05712317-a7b0-4b9c-a77a-68a403c76359\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") "
Jul 09 20:39:11.689743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689565    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-home\") pod \"05712317-a7b0-4b9c-a77a-68a403c76359\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") "
Jul 09 20:39:11.689743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v55tz\" (UniqueName: \"kubernetes.io/projected/05712317-a7b0-4b9c-a77a-68a403c76359-kube-api-access-v55tz\") pod \"05712317-a7b0-4b9c-a77a-68a403c76359\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") "
Jul 09 20:39:11.689743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-model-cache\") pod \"05712317-a7b0-4b9c-a77a-68a403c76359\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") "
Jul 09 20:39:11.689743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-tmp-dir\") pod \"05712317-a7b0-4b9c-a77a-68a403c76359\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") "
Jul 09 20:39:11.689743 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05712317-a7b0-4b9c-a77a-68a403c76359-tls-certs\") pod \"05712317-a7b0-4b9c-a77a-68a403c76359\" (UID: \"05712317-a7b0-4b9c-a77a-68a403c76359\") "
Jul 09 20:39:11.689987 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-home" (OuterVolumeSpecName: "home") pod "05712317-a7b0-4b9c-a77a-68a403c76359" (UID: "05712317-a7b0-4b9c-a77a-68a403c76359"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:11.690044 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.689989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-model-cache" (OuterVolumeSpecName: "model-cache") pod "05712317-a7b0-4b9c-a77a-68a403c76359" (UID: "05712317-a7b0-4b9c-a77a-68a403c76359"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:11.690095 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.690025    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "05712317-a7b0-4b9c-a77a-68a403c76359" (UID: "05712317-a7b0-4b9c-a77a-68a403c76359"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:11.690095 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.690072    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:11.692048 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.692015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05712317-a7b0-4b9c-a77a-68a403c76359-kube-api-access-v55tz" (OuterVolumeSpecName: "kube-api-access-v55tz") pod "05712317-a7b0-4b9c-a77a-68a403c76359" (UID: "05712317-a7b0-4b9c-a77a-68a403c76359"). InnerVolumeSpecName "kube-api-access-v55tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:39:11.692048 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.692032    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05712317-a7b0-4b9c-a77a-68a403c76359-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "05712317-a7b0-4b9c-a77a-68a403c76359" (UID: "05712317-a7b0-4b9c-a77a-68a403c76359"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:39:11.692192 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.692078    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-dshm" (OuterVolumeSpecName: "dshm") pod "05712317-a7b0-4b9c-a77a-68a403c76359" (UID: "05712317-a7b0-4b9c-a77a-68a403c76359"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:11.791039 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.791004    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:11.791039 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.791031    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/05712317-a7b0-4b9c-a77a-68a403c76359-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:11.791039 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.791041    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:11.791039 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.791050    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v55tz\" (UniqueName: \"kubernetes.io/projected/05712317-a7b0-4b9c-a77a-68a403c76359-kube-api-access-v55tz\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:11.791331 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:11.791059    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/05712317-a7b0-4b9c-a77a-68a403c76359-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:12.330767 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.330731    2565 generic.go:356] "Generic (PLEG): container finished" podID="05712317-a7b0-4b9c-a77a-68a403c76359" containerID="0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0" exitCode=0
Jul 09 20:39:12.330951 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.330773    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"
Jul 09 20:39:12.330951 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.330781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v" event={"ID":"05712317-a7b0-4b9c-a77a-68a403c76359","Type":"ContainerDied","Data":"0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0"}
Jul 09 20:39:12.330951 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.330811    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v" event={"ID":"05712317-a7b0-4b9c-a77a-68a403c76359","Type":"ContainerDied","Data":"002801970cb6d8c79e07a0ff6f2ee48d6b3aa86e0afbf74dd7379e4563a5dc12"}
Jul 09 20:39:12.330951 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.330829    2565 scope.go:117] "RemoveContainer" containerID="0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0"
Jul 09 20:39:12.333502 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.333473    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z" podUID="0fb0028d-6762-48c6-aa37-df710e0150ea" containerName="main" containerID="cri-o://f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f" gracePeriod=45
Jul 09 20:39:12.340358 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.340340    2565 scope.go:117] "RemoveContainer" containerID="0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0"
Jul 09 20:39:12.340612 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:39:12.340587    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0\": container with ID starting with 0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0 not found: ID does not exist" containerID="0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0"
Jul 09 20:39:12.340702 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.340617    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0"} err="failed to get container status \"0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0\": rpc error: code = NotFound desc = could not find container \"0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0\": container with ID starting with 0e6992933962dac5f4e3cdfed2ad5775efa38c5ecfe4792e6a751861a24495a0 not found: ID does not exist"
Jul 09 20:39:12.353167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.353140    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"]
Jul 09 20:39:12.355556 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.355535    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c0edf2/test-model-c0edf2-kserve-d6b774f49-bz79v"]
Jul 09 20:39:12.587722 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.587665    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:39:12.598914 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.598896    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-home\") pod \"0fb0028d-6762-48c6-aa37-df710e0150ea\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") "
Jul 09 20:39:12.598997 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.598929    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fb0028d-6762-48c6-aa37-df710e0150ea-tls-certs\") pod \"0fb0028d-6762-48c6-aa37-df710e0150ea\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") "
Jul 09 20:39:12.598997 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.598962    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-tmp-dir\") pod \"0fb0028d-6762-48c6-aa37-df710e0150ea\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") "
Jul 09 20:39:12.599101 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599000    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-model-cache\") pod \"0fb0028d-6762-48c6-aa37-df710e0150ea\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") "
Jul 09 20:39:12.599101 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-dshm\") pod \"0fb0028d-6762-48c6-aa37-df710e0150ea\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") "
Jul 09 20:39:12.599206 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599104    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvvhr\" (UniqueName: \"kubernetes.io/projected/0fb0028d-6762-48c6-aa37-df710e0150ea-kube-api-access-kvvhr\") pod \"0fb0028d-6762-48c6-aa37-df710e0150ea\" (UID: \"0fb0028d-6762-48c6-aa37-df710e0150ea\") "
Jul 09 20:39:12.599206 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599188    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-home" (OuterVolumeSpecName: "home") pod "0fb0028d-6762-48c6-aa37-df710e0150ea" (UID: "0fb0028d-6762-48c6-aa37-df710e0150ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:12.599338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599289    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "0fb0028d-6762-48c6-aa37-df710e0150ea" (UID: "0fb0028d-6762-48c6-aa37-df710e0150ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:12.599338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599307    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0fb0028d-6762-48c6-aa37-df710e0150ea" (UID: "0fb0028d-6762-48c6-aa37-df710e0150ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:12.599500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599480    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:12.599570 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599502    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:12.599570 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.599510    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:12.601445 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.601413    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fb0028d-6762-48c6-aa37-df710e0150ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0fb0028d-6762-48c6-aa37-df710e0150ea" (UID: "0fb0028d-6762-48c6-aa37-df710e0150ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:39:12.601445 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.601418    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fb0028d-6762-48c6-aa37-df710e0150ea-kube-api-access-kvvhr" (OuterVolumeSpecName: "kube-api-access-kvvhr") pod "0fb0028d-6762-48c6-aa37-df710e0150ea" (UID: "0fb0028d-6762-48c6-aa37-df710e0150ea"). InnerVolumeSpecName "kube-api-access-kvvhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:39:12.601445 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.601412    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-dshm" (OuterVolumeSpecName: "dshm") pod "0fb0028d-6762-48c6-aa37-df710e0150ea" (UID: "0fb0028d-6762-48c6-aa37-df710e0150ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:39:12.700343 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.700172    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fb0028d-6762-48c6-aa37-df710e0150ea-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:12.700343 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.700201    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvvhr\" (UniqueName: \"kubernetes.io/projected/0fb0028d-6762-48c6-aa37-df710e0150ea-kube-api-access-kvvhr\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:12.700343 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:12.700228    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fb0028d-6762-48c6-aa37-df710e0150ea-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:39:13.114820 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.114778    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05712317-a7b0-4b9c-a77a-68a403c76359" path="/var/lib/kubelet/pods/05712317-a7b0-4b9c-a77a-68a403c76359/volumes"
Jul 09 20:39:13.336629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.336600    2565 generic.go:356] "Generic (PLEG): container finished" podID="0fb0028d-6762-48c6-aa37-df710e0150ea" containerID="f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f" exitCode=0
Jul 09 20:39:13.336841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.336647    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"
Jul 09 20:39:13.336841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.336688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z" event={"ID":"0fb0028d-6762-48c6-aa37-df710e0150ea","Type":"ContainerDied","Data":"f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f"}
Jul 09 20:39:13.336841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.336744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z" event={"ID":"0fb0028d-6762-48c6-aa37-df710e0150ea","Type":"ContainerDied","Data":"e5ff6b1aec9882b2662fdf4fc78774f67d3dac7f140698fc7e4f62c0fb3d4c10"}
Jul 09 20:39:13.336841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.336769    2565 scope.go:117] "RemoveContainer" containerID="f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f"
Jul 09 20:39:13.345500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.345482    2565 scope.go:117] "RemoveContainer" containerID="f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f"
Jul 09 20:39:13.345761 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:39:13.345744    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f\": container with ID starting with f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f not found: ID does not exist" containerID="f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f"
Jul 09 20:39:13.345831 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.345775    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f"} err="failed to get container status \"f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f\": rpc error: code = NotFound desc = could not find container \"f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f\": container with ID starting with f0808c36abc86c2a8773964905d17b753e5308b8268b0313746d32bc46cafa0f not found: ID does not exist"
Jul 09 20:39:13.351513 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.351491    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"]
Jul 09 20:39:13.355638 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:13.355618    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-00edb0/test-model-00edb0-kserve-7457594ddc-ld95z"]
Jul 09 20:39:15.120252 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:15.120188    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb0028d-6762-48c6-aa37-df710e0150ea" path="/var/lib/kubelet/pods/0fb0028d-6762-48c6-aa37-df710e0150ea/volumes"
Jul 09 20:39:43.497947 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:43.497911    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:39:58.501819 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:39:58.501774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:40:16.607355 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:40:16.607320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:40:30.030187 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:40:30.030146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:40:44.104958 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:40:44.104919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:41:05.809853 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.809764    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"]
Jul 09 20:41:05.810439 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.810303    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05712317-a7b0-4b9c-a77a-68a403c76359" containerName="main"
Jul 09 20:41:05.810439 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.810326    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="05712317-a7b0-4b9c-a77a-68a403c76359" containerName="main"
Jul 09 20:41:05.810439 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.810355    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb0028d-6762-48c6-aa37-df710e0150ea" containerName="main"
Jul 09 20:41:05.810439 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.810364    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb0028d-6762-48c6-aa37-df710e0150ea" containerName="main"
Jul 09 20:41:05.810645 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.810449    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="05712317-a7b0-4b9c-a77a-68a403c76359" containerName="main"
Jul 09 20:41:05.810645 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.810459    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb0028d-6762-48c6-aa37-df710e0150ea" containerName="main"
Jul 09 20:41:05.813459 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.813437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:05.816945 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.816920    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56db7\"/\"auth-test-model-a56db7-kserve-self-signed-certs\""
Jul 09 20:41:05.817036 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.816969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a56db7\"/\"openshift-service-ca.crt\""
Jul 09 20:41:05.817036 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.816925    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a56db7\"/\"kube-root-ca.crt\""
Jul 09 20:41:05.817036 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.816974    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56db7\"/\"default-dockercfg-dzkwf\""
Jul 09 20:41:05.827695 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.823729    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"]
Jul 09 20:41:05.952141 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.952106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/543d0575-7090-4b62-ad18-2fda737e30cf-kube-api-access-7wwpp\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:05.952355 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.952149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-tmp-dir\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:05.952355 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.952183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-home\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:05.952487 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.952359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-model-cache\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:05.952487 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.952422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-dshm\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:05.952487 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:05.952447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543d0575-7090-4b62-ad18-2fda737e30cf-tls-certs\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053106 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-model-cache\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-dshm\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543d0575-7090-4b62-ad18-2fda737e30cf-tls-certs\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/543d0575-7090-4b62-ad18-2fda737e30cf-kube-api-access-7wwpp\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-tmp-dir\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-home\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053635 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-model-cache\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053635 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-tmp-dir\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.053722 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.053659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-home\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.055762 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.055732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-dshm\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.055945 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.055929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543d0575-7090-4b62-ad18-2fda737e30cf-tls-certs\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.060765 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.060715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/543d0575-7090-4b62-ad18-2fda737e30cf-kube-api-access-7wwpp\") pod \"auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") " pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.123949 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.123906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:06.257419 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.257394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"]
Jul 09 20:41:06.260086 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:41:06.260051    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod543d0575_7090_4b62_ad18_2fda737e30cf.slice/crio-efbc25120993446e33feb7784500037c86d3f7d3749148c4eb96bf9e640a5e79 WatchSource:0}: Error finding container efbc25120993446e33feb7784500037c86d3f7d3749148c4eb96bf9e640a5e79: Status 404 returned error can't find the container with id efbc25120993446e33feb7784500037c86d3f7d3749148c4eb96bf9e640a5e79
Jul 09 20:41:06.843812 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.843774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6" event={"ID":"543d0575-7090-4b62-ad18-2fda737e30cf","Type":"ContainerStarted","Data":"a120d30762c6843b31521168d02ec33086d6141fc67fca84b7b4382b5799d7f3"}
Jul 09 20:41:06.844248 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.843822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6" event={"ID":"543d0575-7090-4b62-ad18-2fda737e30cf","Type":"ContainerStarted","Data":"efbc25120993446e33feb7784500037c86d3f7d3749148c4eb96bf9e640a5e79"}
Jul 09 20:41:06.862389 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:06.862337    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6" podStartSLOduration=1.862321676 podStartE2EDuration="1.862321676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:41:06.861841715 +0000 UTC m=+2258.346281729" watchObservedRunningTime="2026-07-09 20:41:06.862321676 +0000 UTC m=+2258.346761677"
Jul 09 20:41:09.205689 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:09.205653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:41:16.124893 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:16.124855    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:16.125460 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:16.124922    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:16.137737 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:16.137712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:16.900983 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:16.900946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:41:26.706423 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.706380    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"]
Jul 09 20:41:26.710088 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.710065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.713418 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.713397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"kube-root-ca.crt\""
Jul 09 20:41:26.713418 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.713412    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"default-dockercfg-l24hp\""
Jul 09 20:41:26.713614 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.713490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"auth-test-model-8c2e89-kserve-self-signed-certs\""
Jul 09 20:41:26.713741 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.713651    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"openshift-service-ca.crt\""
Jul 09 20:41:26.719439 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.719415    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"]
Jul 09 20:41:26.732728 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.732706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-home\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.732841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.732743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb21cbf8-4f62-4752-a11e-165a1d158209-tls-certs\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.732841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.732774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-tmp-dir\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.732936 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.732840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-model-cache\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.732936 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.732869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjj94\" (UniqueName: \"kubernetes.io/projected/eb21cbf8-4f62-4752-a11e-165a1d158209-kube-api-access-hjj94\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.732936 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.732902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-dshm\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.833960 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.833916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-tmp-dir\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.833971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-model-cache\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.834002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjj94\" (UniqueName: \"kubernetes.io/projected/eb21cbf8-4f62-4752-a11e-165a1d158209-kube-api-access-hjj94\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.834029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-dshm\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.834090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-home\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834286 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.834126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb21cbf8-4f62-4752-a11e-165a1d158209-tls-certs\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834538 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.834386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-tmp-dir\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834538 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.834472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-home\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.834676 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.834655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-model-cache\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.836577 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.836557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-dshm\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.836749 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.836731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb21cbf8-4f62-4752-a11e-165a1d158209-tls-certs\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:26.842271 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:26.842246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjj94\" (UniqueName: \"kubernetes.io/projected/eb21cbf8-4f62-4752-a11e-165a1d158209-kube-api-access-hjj94\") pod \"auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") " pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:27.021601 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:27.021491    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:27.157425 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:27.157395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"]
Jul 09 20:41:27.159443 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:41:27.159408    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb21cbf8_4f62_4752_a11e_165a1d158209.slice/crio-240369aeaab2b6b011d0059500589ee979b38f2c000b0ac067632052d53b413a WatchSource:0}: Error finding container 240369aeaab2b6b011d0059500589ee979b38f2c000b0ac067632052d53b413a: Status 404 returned error can't find the container with id 240369aeaab2b6b011d0059500589ee979b38f2c000b0ac067632052d53b413a
Jul 09 20:41:27.945717 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:27.945675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4" event={"ID":"eb21cbf8-4f62-4752-a11e-165a1d158209","Type":"ContainerStarted","Data":"0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def"}
Jul 09 20:41:27.946237 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:27.945731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4" event={"ID":"eb21cbf8-4f62-4752-a11e-165a1d158209","Type":"ContainerStarted","Data":"240369aeaab2b6b011d0059500589ee979b38f2c000b0ac067632052d53b413a"}
Jul 09 20:41:27.962280 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:27.962224    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4" podStartSLOduration=1.9621905210000001 podStartE2EDuration="1.962190521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:41:27.960108779 +0000 UTC m=+2279.444548773" watchObservedRunningTime="2026-07-09 20:41:27.962190521 +0000 UTC m=+2279.446630560"
Jul 09 20:41:31.004448 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:31.004408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:41:37.022197 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:37.022154    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:37.022747 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:37.022459    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:37.034816 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:37.034785    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:38.002096 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:38.002069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:41:51.309199 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:41:51.309155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:42:10.502087 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:42:10.502038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:42:25.802426 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:42:25.802341    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:42:44.103009 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:42:44.102975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:43:01.105890 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:01.105852    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:43:18.803040 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:18.802998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:43:29.163471 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:29.163442    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:43:29.180091 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:29.180070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h4fcj_90d468c6-af6a-4e86-b4a6-0dacef723e27/ovn-acl-logging/0.log"
Jul 09 20:43:33.907035 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:33.907001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:43:38.376473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:38.376439    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"]
Jul 09 20:43:39.305564 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:39.305519    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"]
Jul 09 20:43:48.604546 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.604502    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"]
Jul 09 20:43:48.608192 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.608166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.610882 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.610828    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56db7\"/\"sub-test-model-a56db7-kserve-self-signed-certs\""
Jul 09 20:43:48.616273 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.616251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"]
Jul 09 20:43:48.782299 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.782252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-home\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.782500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.782311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-tmp-dir\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.782500 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.782479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-model-cache\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.782628 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.782525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-dshm\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.782628 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.782566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e446394-bbdb-46d7-8290-d0cc40764931-tls-certs\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.782628 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.782598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqsj\" (UniqueName: \"kubernetes.io/projected/9e446394-bbdb-46d7-8290-d0cc40764931-kube-api-access-nrqsj\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.883922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.883823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-home\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.883922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.883882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-tmp-dir\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.884181 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.883975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-model-cache\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.884181 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.884004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-dshm\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.884181 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.884028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e446394-bbdb-46d7-8290-d0cc40764931-tls-certs\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.884181 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.884054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqsj\" (UniqueName: \"kubernetes.io/projected/9e446394-bbdb-46d7-8290-d0cc40764931-kube-api-access-nrqsj\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.884410 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.884309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-home\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.884410 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.884371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-tmp-dir\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.884410 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.884388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-model-cache\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.886429 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.886409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-dshm\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.886593 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.886576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e446394-bbdb-46d7-8290-d0cc40764931-tls-certs\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.891720 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.891700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqsj\" (UniqueName: \"kubernetes.io/projected/9e446394-bbdb-46d7-8290-d0cc40764931-kube-api-access-nrqsj\") pod \"sub-test-model-a56db7-kserve-786c5f467c-j4ssl\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") " pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:48.918002 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:48.917959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:49.051537 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:49.051507    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"]
Jul 09 20:43:49.053390 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:43:49.053364    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e446394_bbdb_46d7_8290_d0cc40764931.slice/crio-5e037b5d1d4f94418fccd24ef228051b74f0ca22bdb1c2f3c78a238a9aa4f900 WatchSource:0}: Error finding container 5e037b5d1d4f94418fccd24ef228051b74f0ca22bdb1c2f3c78a238a9aa4f900: Status 404 returned error can't find the container with id 5e037b5d1d4f94418fccd24ef228051b74f0ca22bdb1c2f3c78a238a9aa4f900
Jul 09 20:43:49.614516 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:49.614481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl" event={"ID":"9e446394-bbdb-46d7-8290-d0cc40764931","Type":"ContainerStarted","Data":"f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b"}
Jul 09 20:43:49.614913 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:49.614523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl" event={"ID":"9e446394-bbdb-46d7-8290-d0cc40764931","Type":"ContainerStarted","Data":"5e037b5d1d4f94418fccd24ef228051b74f0ca22bdb1c2f3c78a238a9aa4f900"}
Jul 09 20:43:49.631382 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:49.631326    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl" podStartSLOduration=1.6313094289999999 podStartE2EDuration="1.631309429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:43:49.629630533 +0000 UTC m=+2421.114070536" watchObservedRunningTime="2026-07-09 20:43:49.631309429 +0000 UTC m=+2421.115749430"
Jul 09 20:43:52.403953 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:52.403909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:43:53.396954 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.396903    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6" podUID="543d0575-7090-4b62-ad18-2fda737e30cf" containerName="main" containerID="cri-o://a120d30762c6843b31521168d02ec33086d6141fc67fca84b7b4382b5799d7f3" gracePeriod=45
Jul 09 20:43:53.636269 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.636206    2565 generic.go:356] "Generic (PLEG): container finished" podID="543d0575-7090-4b62-ad18-2fda737e30cf" containerID="a120d30762c6843b31521168d02ec33086d6141fc67fca84b7b4382b5799d7f3" exitCode=0
Jul 09 20:43:53.636609 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.636247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6" event={"ID":"543d0575-7090-4b62-ad18-2fda737e30cf","Type":"ContainerDied","Data":"a120d30762c6843b31521168d02ec33086d6141fc67fca84b7b4382b5799d7f3"}
Jul 09 20:43:53.653632 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.653557    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:43:53.831968 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.831930    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-model-cache\") pod \"543d0575-7090-4b62-ad18-2fda737e30cf\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") "
Jul 09 20:43:53.832144 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.831988    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-tmp-dir\") pod \"543d0575-7090-4b62-ad18-2fda737e30cf\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") "
Jul 09 20:43:53.832144 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832020    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543d0575-7090-4b62-ad18-2fda737e30cf-tls-certs\") pod \"543d0575-7090-4b62-ad18-2fda737e30cf\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") "
Jul 09 20:43:53.832144 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832062    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/543d0575-7090-4b62-ad18-2fda737e30cf-kube-api-access-7wwpp\") pod \"543d0575-7090-4b62-ad18-2fda737e30cf\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") "
Jul 09 20:43:53.832144 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-home\") pod \"543d0575-7090-4b62-ad18-2fda737e30cf\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") "
Jul 09 20:43:53.832403 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832206    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-dshm\") pod \"543d0575-7090-4b62-ad18-2fda737e30cf\" (UID: \"543d0575-7090-4b62-ad18-2fda737e30cf\") "
Jul 09 20:43:53.832403 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832258    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "543d0575-7090-4b62-ad18-2fda737e30cf" (UID: "543d0575-7090-4b62-ad18-2fda737e30cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:53.832403 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832339    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "543d0575-7090-4b62-ad18-2fda737e30cf" (UID: "543d0575-7090-4b62-ad18-2fda737e30cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:53.832549 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-home" (OuterVolumeSpecName: "home") pod "543d0575-7090-4b62-ad18-2fda737e30cf" (UID: "543d0575-7090-4b62-ad18-2fda737e30cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:53.832588 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832555    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:53.832588 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832576    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:53.832664 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.832591    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:53.834465 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.834441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-dshm" (OuterVolumeSpecName: "dshm") pod "543d0575-7090-4b62-ad18-2fda737e30cf" (UID: "543d0575-7090-4b62-ad18-2fda737e30cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:53.834557 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.834495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543d0575-7090-4b62-ad18-2fda737e30cf-kube-api-access-7wwpp" (OuterVolumeSpecName: "kube-api-access-7wwpp") pod "543d0575-7090-4b62-ad18-2fda737e30cf" (UID: "543d0575-7090-4b62-ad18-2fda737e30cf"). InnerVolumeSpecName "kube-api-access-7wwpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:43:53.834597 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.834581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/543d0575-7090-4b62-ad18-2fda737e30cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "543d0575-7090-4b62-ad18-2fda737e30cf" (UID: "543d0575-7090-4b62-ad18-2fda737e30cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:43:53.933305 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.933223    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/543d0575-7090-4b62-ad18-2fda737e30cf-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:53.933305 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.933257    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/543d0575-7090-4b62-ad18-2fda737e30cf-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:53.933305 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:53.933274    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/543d0575-7090-4b62-ad18-2fda737e30cf-kube-api-access-7wwpp\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:54.329721 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.329678    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4" podUID="eb21cbf8-4f62-4752-a11e-165a1d158209" containerName="main" containerID="cri-o://0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def" gracePeriod=45
Jul 09 20:43:54.588972 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.588914    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:43:54.642074 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.642037    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"
Jul 09 20:43:54.642074 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.642059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6" event={"ID":"543d0575-7090-4b62-ad18-2fda737e30cf","Type":"ContainerDied","Data":"efbc25120993446e33feb7784500037c86d3f7d3749148c4eb96bf9e640a5e79"}
Jul 09 20:43:54.642614 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.642115    2565 scope.go:117] "RemoveContainer" containerID="a120d30762c6843b31521168d02ec33086d6141fc67fca84b7b4382b5799d7f3"
Jul 09 20:43:54.643577 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.643553    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb21cbf8-4f62-4752-a11e-165a1d158209" containerID="0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def" exitCode=0
Jul 09 20:43:54.643854 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.643594    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"
Jul 09 20:43:54.643854 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.643633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4" event={"ID":"eb21cbf8-4f62-4752-a11e-165a1d158209","Type":"ContainerDied","Data":"0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def"}
Jul 09 20:43:54.643854 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.643683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4" event={"ID":"eb21cbf8-4f62-4752-a11e-165a1d158209","Type":"ContainerDied","Data":"240369aeaab2b6b011d0059500589ee979b38f2c000b0ac067632052d53b413a"}
Jul 09 20:43:54.653829 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.652720    2565 scope.go:117] "RemoveContainer" containerID="0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def"
Jul 09 20:43:54.662328 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.662285    2565 scope.go:117] "RemoveContainer" containerID="0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def"
Jul 09 20:43:54.662602 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:43:54.662584    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def\": container with ID starting with 0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def not found: ID does not exist" containerID="0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def"
Jul 09 20:43:54.662653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.662611    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def"} err="failed to get container status \"0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def\": rpc error: code = NotFound desc = could not find container \"0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def\": container with ID starting with 0fc84398d54775a137b21a28b3e0ca48d8b8a767ae33e997efb7defef20c8def not found: ID does not exist"
Jul 09 20:43:54.668230 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.668180    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"]
Jul 09 20:43:54.673920 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.673900    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/auth-test-model-a56db7-kserve-76b8d9f7c9-kj2s6"]
Jul 09 20:43:54.741167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741134    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-home\") pod \"eb21cbf8-4f62-4752-a11e-165a1d158209\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") "
Jul 09 20:43:54.741347 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-tmp-dir\") pod \"eb21cbf8-4f62-4752-a11e-165a1d158209\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") "
Jul 09 20:43:54.741347 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741290    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-model-cache\") pod \"eb21cbf8-4f62-4752-a11e-165a1d158209\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") "
Jul 09 20:43:54.741457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741354    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb21cbf8-4f62-4752-a11e-165a1d158209-tls-certs\") pod \"eb21cbf8-4f62-4752-a11e-165a1d158209\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") "
Jul 09 20:43:54.741457 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjj94\" (UniqueName: \"kubernetes.io/projected/eb21cbf8-4f62-4752-a11e-165a1d158209-kube-api-access-hjj94\") pod \"eb21cbf8-4f62-4752-a11e-165a1d158209\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") "
Jul 09 20:43:54.741601 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-home" (OuterVolumeSpecName: "home") pod "eb21cbf8-4f62-4752-a11e-165a1d158209" (UID: "eb21cbf8-4f62-4752-a11e-165a1d158209"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:54.741601 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741481    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-dshm\") pod \"eb21cbf8-4f62-4752-a11e-165a1d158209\" (UID: \"eb21cbf8-4f62-4752-a11e-165a1d158209\") "
Jul 09 20:43:54.741601 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741547    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb21cbf8-4f62-4752-a11e-165a1d158209" (UID: "eb21cbf8-4f62-4752-a11e-165a1d158209"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:54.741601 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.741581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb21cbf8-4f62-4752-a11e-165a1d158209" (UID: "eb21cbf8-4f62-4752-a11e-165a1d158209"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:54.742094 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.742074    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:54.742191 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.742110    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:54.742191 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.742124    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:54.743786 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.743765    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-dshm" (OuterVolumeSpecName: "dshm") pod "eb21cbf8-4f62-4752-a11e-165a1d158209" (UID: "eb21cbf8-4f62-4752-a11e-165a1d158209"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:43:54.743889 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.743795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb21cbf8-4f62-4752-a11e-165a1d158209-kube-api-access-hjj94" (OuterVolumeSpecName: "kube-api-access-hjj94") pod "eb21cbf8-4f62-4752-a11e-165a1d158209" (UID: "eb21cbf8-4f62-4752-a11e-165a1d158209"). InnerVolumeSpecName "kube-api-access-hjj94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:43:54.743889 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.743863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb21cbf8-4f62-4752-a11e-165a1d158209-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb21cbf8-4f62-4752-a11e-165a1d158209" (UID: "eb21cbf8-4f62-4752-a11e-165a1d158209"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:43:54.843459 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.843365    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb21cbf8-4f62-4752-a11e-165a1d158209-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:54.843459 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.843402    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjj94\" (UniqueName: \"kubernetes.io/projected/eb21cbf8-4f62-4752-a11e-165a1d158209-kube-api-access-hjj94\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:54.843459 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.843412    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb21cbf8-4f62-4752-a11e-165a1d158209-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:43:54.964292 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.964263    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"]
Jul 09 20:43:54.967869 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:54.967835    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/auth-test-model-8c2e89-kserve-7d9895fb95-dw4n4"]
Jul 09 20:43:55.115678 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:55.115597    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543d0575-7090-4b62-ad18-2fda737e30cf" path="/var/lib/kubelet/pods/543d0575-7090-4b62-ad18-2fda737e30cf/volumes"
Jul 09 20:43:55.115989 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:55.115976    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb21cbf8-4f62-4752-a11e-165a1d158209" path="/var/lib/kubelet/pods/eb21cbf8-4f62-4752-a11e-165a1d158209/volumes"
Jul 09 20:43:58.918396 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:58.918361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:58.918840 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:58.918500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:58.931045 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:58.931017    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:43:59.679961 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:43:59.679929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:44:21.311506 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.311473    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"]
Jul 09 20:44:21.311966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.311804    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543d0575-7090-4b62-ad18-2fda737e30cf" containerName="main"
Jul 09 20:44:21.311966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.311814    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="543d0575-7090-4b62-ad18-2fda737e30cf" containerName="main"
Jul 09 20:44:21.311966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.311824    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb21cbf8-4f62-4752-a11e-165a1d158209" containerName="main"
Jul 09 20:44:21.311966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.311829    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb21cbf8-4f62-4752-a11e-165a1d158209" containerName="main"
Jul 09 20:44:21.311966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.311887    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb21cbf8-4f62-4752-a11e-165a1d158209" containerName="main"
Jul 09 20:44:21.311966 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.311898    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="543d0575-7090-4b62-ad18-2fda737e30cf" containerName="main"
Jul 09 20:44:21.314813 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.314796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.317351 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.317324    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"kube-root-ca.crt\""
Jul 09 20:44:21.318317 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.318295    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"openshift-service-ca.crt\""
Jul 09 20:44:21.318451 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.318326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"sub-test-model-8c2e89-kserve-self-signed-certs\""
Jul 09 20:44:21.318451 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.318335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"default-dockercfg-l24hp\""
Jul 09 20:44:21.324397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.324374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"]
Jul 09 20:44:21.386827 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.386795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-home\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.386969 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.386833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tmp-dir\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.386969 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.386852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tls-certs\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.386969 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.386869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf29f\" (UniqueName: \"kubernetes.io/projected/07e930bf-dbcd-414a-b1ae-87ad8edb254f-kube-api-access-jf29f\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.386969 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.386936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-dshm\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.387127 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.386977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-model-cache\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488328 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-home\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488328 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tmp-dir\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488582 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tls-certs\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488582 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf29f\" (UniqueName: \"kubernetes.io/projected/07e930bf-dbcd-414a-b1ae-87ad8edb254f-kube-api-access-jf29f\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488582 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-dshm\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488582 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-model-cache\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488779 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tmp-dir\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488862 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-home\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.488906 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.488855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-model-cache\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.490819 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.490788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-dshm\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.491053 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.491034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tls-certs\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.496573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.496548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf29f\" (UniqueName: \"kubernetes.io/projected/07e930bf-dbcd-414a-b1ae-87ad8edb254f-kube-api-access-jf29f\") pod \"sub-test-model-8c2e89-kserve-856b86f47c-rjk6m\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") " pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.625578 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.625477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:21.757801 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.757775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"]
Jul 09 20:44:21.760433 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:44:21.760397    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07e930bf_dbcd_414a_b1ae_87ad8edb254f.slice/crio-81cc3940359a627562d4f6074becdbba2fc655afffa72e9f8b4d31a715d9f1b4 WatchSource:0}: Error finding container 81cc3940359a627562d4f6074becdbba2fc655afffa72e9f8b4d31a715d9f1b4: Status 404 returned error can't find the container with id 81cc3940359a627562d4f6074becdbba2fc655afffa72e9f8b4d31a715d9f1b4
Jul 09 20:44:21.771851 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:21.771826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m" event={"ID":"07e930bf-dbcd-414a-b1ae-87ad8edb254f","Type":"ContainerStarted","Data":"81cc3940359a627562d4f6074becdbba2fc655afffa72e9f8b4d31a715d9f1b4"}
Jul 09 20:44:22.777885 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:22.777849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m" event={"ID":"07e930bf-dbcd-414a-b1ae-87ad8edb254f","Type":"ContainerStarted","Data":"176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d"}
Jul 09 20:44:22.794272 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:22.794226    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m" podStartSLOduration=1.794197316 podStartE2EDuration="1.794197316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:44:22.792659888 +0000 UTC m=+2454.277099900" watchObservedRunningTime="2026-07-09 20:44:22.794197316 +0000 UTC m=+2454.278637317"
Jul 09 20:44:26.299930 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:26.299895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:44:31.625833 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:31.625781    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:31.626315 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:31.625872    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:31.638623 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:31.638594    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:31.839787 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:31.839752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:44:43.210598 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:44:43.210551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:45:02.135674 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:02.135628    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"]
Jul 09 20:45:03.397487 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:03.397446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"]
Jul 09 20:45:06.104086 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:06.104050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:45:08.399878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.399847    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"]
Jul 09 20:45:08.403397 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.403373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.405867 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.405842    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a56db7\"/\"rate-test-model-a56db7-kserve-self-signed-certs\""
Jul 09 20:45:08.411878 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.411556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"]
Jul 09 20:45:08.524425 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.524392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-home\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.524425 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.524431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-dshm\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.524651 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.524500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gplgs\" (UniqueName: \"kubernetes.io/projected/bf5293db-64a4-46f4-af71-639e9994d52f-kube-api-access-gplgs\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.524651 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.524562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5293db-64a4-46f4-af71-639e9994d52f-tls-certs\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.524651 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.524637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-model-cache\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.524651 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.524653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-tmp-dir\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625383 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-home\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625383 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-dshm\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625673 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gplgs\" (UniqueName: \"kubernetes.io/projected/bf5293db-64a4-46f4-af71-639e9994d52f-kube-api-access-gplgs\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625673 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5293db-64a4-46f4-af71-639e9994d52f-tls-certs\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625673 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-model-cache\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625673 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-tmp-dir\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625894 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-home\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.625958 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-model-cache\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.626006 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.625951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-tmp-dir\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.627932 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.627909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-dshm\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.628159 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.628142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5293db-64a4-46f4-af71-639e9994d52f-tls-certs\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.633341 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.633323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gplgs\" (UniqueName: \"kubernetes.io/projected/bf5293db-64a4-46f4-af71-639e9994d52f-kube-api-access-gplgs\") pod \"rate-test-model-a56db7-kserve-857946bc99-tcrcp\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") " pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.714896 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.714787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:08.849042 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:08.849015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"]
Jul 09 20:45:08.852084 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:45:08.852051    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf5293db_64a4_46f4_af71_639e9994d52f.slice/crio-c2f62e5fc75f0bcf0fa0c3ab0c89a12ce4899e7197d63f0378eed00621eadc14 WatchSource:0}: Error finding container c2f62e5fc75f0bcf0fa0c3ab0c89a12ce4899e7197d63f0378eed00621eadc14: Status 404 returned error can't find the container with id c2f62e5fc75f0bcf0fa0c3ab0c89a12ce4899e7197d63f0378eed00621eadc14
Jul 09 20:45:09.000131 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:09.000035    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp" event={"ID":"bf5293db-64a4-46f4-af71-639e9994d52f","Type":"ContainerStarted","Data":"1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077"}
Jul 09 20:45:09.000131 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:09.000085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp" event={"ID":"bf5293db-64a4-46f4-af71-639e9994d52f","Type":"ContainerStarted","Data":"c2f62e5fc75f0bcf0fa0c3ab0c89a12ce4899e7197d63f0378eed00621eadc14"}
Jul 09 20:45:09.017542 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:09.017488    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp" podStartSLOduration=1.017472749 podStartE2EDuration="1.017472749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:45:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:45:09.014846129 +0000 UTC m=+2500.499286142" watchObservedRunningTime="2026-07-09 20:45:09.017472749 +0000 UTC m=+2500.501912795"
Jul 09 20:45:17.155933 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.155894    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl" podUID="9e446394-bbdb-46d7-8290-d0cc40764931" containerName="main" containerID="cri-o://f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b" gracePeriod=45
Jul 09 20:45:17.409451 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.409382    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:45:17.508035 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.507998    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-home\") pod \"9e446394-bbdb-46d7-8290-d0cc40764931\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") "
Jul 09 20:45:17.508035 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-model-cache\") pod \"9e446394-bbdb-46d7-8290-d0cc40764931\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") "
Jul 09 20:45:17.508318 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508098    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e446394-bbdb-46d7-8290-d0cc40764931-tls-certs\") pod \"9e446394-bbdb-46d7-8290-d0cc40764931\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") "
Jul 09 20:45:17.508318 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-dshm\") pod \"9e446394-bbdb-46d7-8290-d0cc40764931\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") "
Jul 09 20:45:17.508318 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508149    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrqsj\" (UniqueName: \"kubernetes.io/projected/9e446394-bbdb-46d7-8290-d0cc40764931-kube-api-access-nrqsj\") pod \"9e446394-bbdb-46d7-8290-d0cc40764931\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") "
Jul 09 20:45:17.508318 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508183    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-tmp-dir\") pod \"9e446394-bbdb-46d7-8290-d0cc40764931\" (UID: \"9e446394-bbdb-46d7-8290-d0cc40764931\") "
Jul 09 20:45:17.508573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-home" (OuterVolumeSpecName: "home") pod "9e446394-bbdb-46d7-8290-d0cc40764931" (UID: "9e446394-bbdb-46d7-8290-d0cc40764931"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:17.508573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508389    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-model-cache" (OuterVolumeSpecName: "model-cache") pod "9e446394-bbdb-46d7-8290-d0cc40764931" (UID: "9e446394-bbdb-46d7-8290-d0cc40764931"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:17.508573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508502    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:17.508573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508524    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:17.508573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.508504    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9e446394-bbdb-46d7-8290-d0cc40764931" (UID: "9e446394-bbdb-46d7-8290-d0cc40764931"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:17.510499 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.510465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e446394-bbdb-46d7-8290-d0cc40764931-kube-api-access-nrqsj" (OuterVolumeSpecName: "kube-api-access-nrqsj") pod "9e446394-bbdb-46d7-8290-d0cc40764931" (UID: "9e446394-bbdb-46d7-8290-d0cc40764931"). InnerVolumeSpecName "kube-api-access-nrqsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:45:17.510631 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.510508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-dshm" (OuterVolumeSpecName: "dshm") pod "9e446394-bbdb-46d7-8290-d0cc40764931" (UID: "9e446394-bbdb-46d7-8290-d0cc40764931"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:17.510722 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.510690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e446394-bbdb-46d7-8290-d0cc40764931-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9e446394-bbdb-46d7-8290-d0cc40764931" (UID: "9e446394-bbdb-46d7-8290-d0cc40764931"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:45:17.609232 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.609188    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e446394-bbdb-46d7-8290-d0cc40764931-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:17.609232 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.609230    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:17.609232 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.609241    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrqsj\" (UniqueName: \"kubernetes.io/projected/9e446394-bbdb-46d7-8290-d0cc40764931-kube-api-access-nrqsj\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:17.609508 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:17.609250    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e446394-bbdb-46d7-8290-d0cc40764931-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:18.043806 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.043769    2565 generic.go:356] "Generic (PLEG): container finished" podID="9e446394-bbdb-46d7-8290-d0cc40764931" containerID="f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b" exitCode=0
Jul 09 20:45:18.043975 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.043813    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"
Jul 09 20:45:18.043975 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.043816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl" event={"ID":"9e446394-bbdb-46d7-8290-d0cc40764931","Type":"ContainerDied","Data":"f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b"}
Jul 09 20:45:18.043975 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.043929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl" event={"ID":"9e446394-bbdb-46d7-8290-d0cc40764931","Type":"ContainerDied","Data":"5e037b5d1d4f94418fccd24ef228051b74f0ca22bdb1c2f3c78a238a9aa4f900"}
Jul 09 20:45:18.043975 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.043952    2565 scope.go:117] "RemoveContainer" containerID="f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b"
Jul 09 20:45:18.053891 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.053872    2565 scope.go:117] "RemoveContainer" containerID="f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b"
Jul 09 20:45:18.054258 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:45:18.054233    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b\": container with ID starting with f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b not found: ID does not exist" containerID="f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b"
Jul 09 20:45:18.054385 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.054265    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b"} err="failed to get container status \"f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b\": rpc error: code = NotFound desc = could not find container \"f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b\": container with ID starting with f8315d4609abd7f1495090e525cad440a7ce480095743df9b90a5fdc5af9f39b not found: ID does not exist"
Jul 09 20:45:18.066513 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.066481    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"]
Jul 09 20:45:18.071167 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.071136    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/sub-test-model-a56db7-kserve-786c5f467c-j4ssl"]
Jul 09 20:45:18.417831 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.417784    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m" podUID="07e930bf-dbcd-414a-b1ae-87ad8edb254f" containerName="main" containerID="cri-o://176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d" gracePeriod=45
Jul 09 20:45:18.673943 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.673881    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:45:18.715778 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.715745    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:18.715922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.715790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:18.719711 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.719684    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-home\") pod \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") "
Jul 09 20:45:18.719847 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.719721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-dshm\") pod \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") "
Jul 09 20:45:18.719847 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.719784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tmp-dir\") pod \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") "
Jul 09 20:45:18.719964 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.719868    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf29f\" (UniqueName: \"kubernetes.io/projected/07e930bf-dbcd-414a-b1ae-87ad8edb254f-kube-api-access-jf29f\") pod \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") "
Jul 09 20:45:18.719964 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.719891    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tls-certs\") pod \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") "
Jul 09 20:45:18.719964 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.719923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-model-cache\") pod \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\" (UID: \"07e930bf-dbcd-414a-b1ae-87ad8edb254f\") "
Jul 09 20:45:18.720100 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.719979    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-home" (OuterVolumeSpecName: "home") pod "07e930bf-dbcd-414a-b1ae-87ad8edb254f" (UID: "07e930bf-dbcd-414a-b1ae-87ad8edb254f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:18.720203 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.720161    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07e930bf-dbcd-414a-b1ae-87ad8edb254f" (UID: "07e930bf-dbcd-414a-b1ae-87ad8edb254f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:18.720338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.720224    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:18.720338 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.720274    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-model-cache" (OuterVolumeSpecName: "model-cache") pod "07e930bf-dbcd-414a-b1ae-87ad8edb254f" (UID: "07e930bf-dbcd-414a-b1ae-87ad8edb254f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:18.722254 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.722190    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07e930bf-dbcd-414a-b1ae-87ad8edb254f" (UID: "07e930bf-dbcd-414a-b1ae-87ad8edb254f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:45:18.722461 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.722432    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e930bf-dbcd-414a-b1ae-87ad8edb254f-kube-api-access-jf29f" (OuterVolumeSpecName: "kube-api-access-jf29f") pod "07e930bf-dbcd-414a-b1ae-87ad8edb254f" (UID: "07e930bf-dbcd-414a-b1ae-87ad8edb254f"). InnerVolumeSpecName "kube-api-access-jf29f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:45:18.722461 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.722434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-dshm" (OuterVolumeSpecName: "dshm") pod "07e930bf-dbcd-414a-b1ae-87ad8edb254f" (UID: "07e930bf-dbcd-414a-b1ae-87ad8edb254f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:45:18.728152 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.728132    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:18.821143 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.821104    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:18.821143 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.821135    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf29f\" (UniqueName: \"kubernetes.io/projected/07e930bf-dbcd-414a-b1ae-87ad8edb254f-kube-api-access-jf29f\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:18.821143 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.821147    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07e930bf-dbcd-414a-b1ae-87ad8edb254f-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:18.821407 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.821159    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:18.821407 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:18.821170    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07e930bf-dbcd-414a-b1ae-87ad8edb254f-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:45:19.049747 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.049633    2565 generic.go:356] "Generic (PLEG): container finished" podID="07e930bf-dbcd-414a-b1ae-87ad8edb254f" containerID="176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d" exitCode=0
Jul 09 20:45:19.049747 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.049680    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"
Jul 09 20:45:19.049747 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.049724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m" event={"ID":"07e930bf-dbcd-414a-b1ae-87ad8edb254f","Type":"ContainerDied","Data":"176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d"}
Jul 09 20:45:19.050026 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.049769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m" event={"ID":"07e930bf-dbcd-414a-b1ae-87ad8edb254f","Type":"ContainerDied","Data":"81cc3940359a627562d4f6074becdbba2fc655afffa72e9f8b4d31a715d9f1b4"}
Jul 09 20:45:19.050026 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.049791    2565 scope.go:117] "RemoveContainer" containerID="176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d"
Jul 09 20:45:19.059170 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.059153    2565 scope.go:117] "RemoveContainer" containerID="176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d"
Jul 09 20:45:19.059473 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:45:19.059450    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d\": container with ID starting with 176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d not found: ID does not exist" containerID="176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d"
Jul 09 20:45:19.059542 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.059481    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d"} err="failed to get container status \"176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d\": rpc error: code = NotFound desc = could not find container \"176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d\": container with ID starting with 176a3b2f2e066dcbd9e22d3e687d376f086aa8049530a8338fe6ba9ef505044d not found: ID does not exist"
Jul 09 20:45:19.063302 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.063285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:45:19.071394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.071372    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"]
Jul 09 20:45:19.076029 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.076011    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/sub-test-model-8c2e89-kserve-856b86f47c-rjk6m"]
Jul 09 20:45:19.116069 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.116040    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e930bf-dbcd-414a-b1ae-87ad8edb254f" path="/var/lib/kubelet/pods/07e930bf-dbcd-414a-b1ae-87ad8edb254f/volumes"
Jul 09 20:45:19.116455 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:19.116433    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e446394-bbdb-46d7-8290-d0cc40764931" path="/var/lib/kubelet/pods/9e446394-bbdb-46d7-8290-d0cc40764931/volumes"
Jul 09 20:45:23.908715 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:23.908668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:45:34.416471 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.416432    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"]
Jul 09 20:45:34.417326 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.417302    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e446394-bbdb-46d7-8290-d0cc40764931" containerName="main"
Jul 09 20:45:34.417423 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.417329    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e446394-bbdb-46d7-8290-d0cc40764931" containerName="main"
Jul 09 20:45:34.417423 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.417382    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e930bf-dbcd-414a-b1ae-87ad8edb254f" containerName="main"
Jul 09 20:45:34.417423 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.417392    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e930bf-dbcd-414a-b1ae-87ad8edb254f" containerName="main"
Jul 09 20:45:34.417652 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.417636    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e446394-bbdb-46d7-8290-d0cc40764931" containerName="main"
Jul 09 20:45:34.417718 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.417665    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e930bf-dbcd-414a-b1ae-87ad8edb254f" containerName="main"
Jul 09 20:45:34.423414 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.423377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.426232 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.426184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"default-dockercfg-l24hp\""
Jul 09 20:45:34.426478 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.426448    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"kube-root-ca.crt\""
Jul 09 20:45:34.426855 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.426826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"]
Jul 09 20:45:34.427311 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.427276    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"rate-test-model-8c2e89-kserve-self-signed-certs\""
Jul 09 20:45:34.427416 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.427329    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8c2e89\"/\"openshift-service-ca.crt\""
Jul 09 20:45:34.567841 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.567806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-dshm\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.568106 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.567956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-model-cache\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.568106 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.568001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-tmp-dir\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.568106 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.568032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-home\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.568277 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.568105    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399b18-ba17-47c5-b251-d15c800f383a-tls-certs\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.568277 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.568139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf9ms\" (UniqueName: \"kubernetes.io/projected/cb399b18-ba17-47c5-b251-d15c800f383a-kube-api-access-rf9ms\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.668924 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.668825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-dshm\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669102 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.668934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-model-cache\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669102 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.668957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-tmp-dir\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669102 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.668974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-home\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669102 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.669008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399b18-ba17-47c5-b251-d15c800f383a-tls-certs\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669102 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.669038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9ms\" (UniqueName: \"kubernetes.io/projected/cb399b18-ba17-47c5-b251-d15c800f383a-kube-api-access-rf9ms\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.669369    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-model-cache\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669434 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.669404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-tmp-dir\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.669473 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.669436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-home\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.671402 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.671381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-dshm\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.671567 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.671549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399b18-ba17-47c5-b251-d15c800f383a-tls-certs\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.676355 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.676337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf9ms\" (UniqueName: \"kubernetes.io/projected/cb399b18-ba17-47c5-b251-d15c800f383a-kube-api-access-rf9ms\") pod \"rate-test-model-8c2e89-kserve-5858f58f79-jrcl8\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") " pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.734475 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.734441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:34.867943 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:34.867791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"]
Jul 09 20:45:34.870170 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:45:34.870141    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb399b18_ba17_47c5_b251_d15c800f383a.slice/crio-63ad2135f2870be8eec79075d51d11614b43f32ce6123503148a5b55f9f3a2a0 WatchSource:0}: Error finding container 63ad2135f2870be8eec79075d51d11614b43f32ce6123503148a5b55f9f3a2a0: Status 404 returned error can't find the container with id 63ad2135f2870be8eec79075d51d11614b43f32ce6123503148a5b55f9f3a2a0
Jul 09 20:45:35.124201 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:35.124164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8" event={"ID":"cb399b18-ba17-47c5-b251-d15c800f383a","Type":"ContainerStarted","Data":"f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd"}
Jul 09 20:45:35.124201 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:35.124222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8" event={"ID":"cb399b18-ba17-47c5-b251-d15c800f383a","Type":"ContainerStarted","Data":"63ad2135f2870be8eec79075d51d11614b43f32ce6123503148a5b55f9f3a2a0"}
Jul 09 20:45:35.142665 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:35.142609    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8" podStartSLOduration=1.142592555 podStartE2EDuration="1.142592555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:45:35.140712429 +0000 UTC m=+2526.625152429" watchObservedRunningTime="2026-07-09 20:45:35.142592555 +0000 UTC m=+2526.627032556"
Jul 09 20:45:39.902677 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:39.902628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:45:44.735119 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:44.735083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:44.735629 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:44.735135    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:44.747914 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:44.747891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:45:45.181279 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:45:45.181251    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:46:02.602820 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:02.602786    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:46:18.002086 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:18.002049    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:46:24.610098 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:24.610062    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"]
Jul 09 20:46:25.584855 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:25.584813    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"]
Jul 09 20:46:33.004720 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:33.004682    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:46:39.630715 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.630650    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp" podUID="bf5293db-64a4-46f4-af71-639e9994d52f" containerName="main" containerID="cri-o://1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077" gracePeriod=45
Jul 09 20:46:39.873736 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.873713    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:46:39.876618 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876595    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-home\") pod \"bf5293db-64a4-46f4-af71-639e9994d52f\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") "
Jul 09 20:46:39.876745 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-dshm\") pod \"bf5293db-64a4-46f4-af71-639e9994d52f\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") "
Jul 09 20:46:39.876745 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5293db-64a4-46f4-af71-639e9994d52f-tls-certs\") pod \"bf5293db-64a4-46f4-af71-639e9994d52f\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") "
Jul 09 20:46:39.876745 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876705    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-model-cache\") pod \"bf5293db-64a4-46f4-af71-639e9994d52f\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") "
Jul 09 20:46:39.876915 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-tmp-dir\") pod \"bf5293db-64a4-46f4-af71-639e9994d52f\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") "
Jul 09 20:46:39.876915 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876798    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-home" (OuterVolumeSpecName: "home") pod "bf5293db-64a4-46f4-af71-639e9994d52f" (UID: "bf5293db-64a4-46f4-af71-639e9994d52f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:39.876915 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876847    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gplgs\" (UniqueName: \"kubernetes.io/projected/bf5293db-64a4-46f4-af71-639e9994d52f-kube-api-access-gplgs\") pod \"bf5293db-64a4-46f4-af71-639e9994d52f\" (UID: \"bf5293db-64a4-46f4-af71-639e9994d52f\") "
Jul 09 20:46:39.877056 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.876999    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bf5293db-64a4-46f4-af71-639e9994d52f" (UID: "bf5293db-64a4-46f4-af71-639e9994d52f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:39.877056 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.877024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-model-cache" (OuterVolumeSpecName: "model-cache") pod "bf5293db-64a4-46f4-af71-639e9994d52f" (UID: "bf5293db-64a4-46f4-af71-639e9994d52f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:39.877188 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.877171    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:39.877326 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.877236    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:39.877326 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.877251    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:39.878941 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.878913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-dshm" (OuterVolumeSpecName: "dshm") pod "bf5293db-64a4-46f4-af71-639e9994d52f" (UID: "bf5293db-64a4-46f4-af71-639e9994d52f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:39.879048 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.878989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf5293db-64a4-46f4-af71-639e9994d52f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bf5293db-64a4-46f4-af71-639e9994d52f" (UID: "bf5293db-64a4-46f4-af71-639e9994d52f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:46:39.879048 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.879028    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf5293db-64a4-46f4-af71-639e9994d52f-kube-api-access-gplgs" (OuterVolumeSpecName: "kube-api-access-gplgs") pod "bf5293db-64a4-46f4-af71-639e9994d52f" (UID: "bf5293db-64a4-46f4-af71-639e9994d52f"). InnerVolumeSpecName "kube-api-access-gplgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:46:39.977985 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.977951    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gplgs\" (UniqueName: \"kubernetes.io/projected/bf5293db-64a4-46f4-af71-639e9994d52f-kube-api-access-gplgs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:39.977985 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.977978    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf5293db-64a4-46f4-af71-639e9994d52f-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:39.977985 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:39.977989    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf5293db-64a4-46f4-af71-639e9994d52f-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:40.423265 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.423235    2565 generic.go:356] "Generic (PLEG): container finished" podID="bf5293db-64a4-46f4-af71-639e9994d52f" containerID="1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077" exitCode=0
Jul 09 20:46:40.423449 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.423267    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"
Jul 09 20:46:40.423449 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.423283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp" event={"ID":"bf5293db-64a4-46f4-af71-639e9994d52f","Type":"ContainerDied","Data":"1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077"}
Jul 09 20:46:40.423449 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.423323    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp" event={"ID":"bf5293db-64a4-46f4-af71-639e9994d52f","Type":"ContainerDied","Data":"c2f62e5fc75f0bcf0fa0c3ab0c89a12ce4899e7197d63f0378eed00621eadc14"}
Jul 09 20:46:40.423449 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.423341    2565 scope.go:117] "RemoveContainer" containerID="1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077"
Jul 09 20:46:40.432567 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.432548    2565 scope.go:117] "RemoveContainer" containerID="1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077"
Jul 09 20:46:40.432890 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:46:40.432867    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077\": container with ID starting with 1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077 not found: ID does not exist" containerID="1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077"
Jul 09 20:46:40.432964 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.432899    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077"} err="failed to get container status \"1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077\": rpc error: code = NotFound desc = could not find container \"1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077\": container with ID starting with 1159efd4565eb9a398734982bb19bb63a3ea92c66cd96de373a5b29ba20b2077 not found: ID does not exist"
Jul 09 20:46:40.443707 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.443678    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"]
Jul 09 20:46:40.449022 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.448995    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a56db7/rate-test-model-a56db7-kserve-857946bc99-tcrcp"]
Jul 09 20:46:40.605107 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.605047    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8" podUID="cb399b18-ba17-47c5-b251-d15c800f383a" containerName="main" containerID="cri-o://f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd" gracePeriod=45
Jul 09 20:46:40.852974 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.852952    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:46:40.886495 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399b18-ba17-47c5-b251-d15c800f383a-tls-certs\") pod \"cb399b18-ba17-47c5-b251-d15c800f383a\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") "
Jul 09 20:46:40.886645 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf9ms\" (UniqueName: \"kubernetes.io/projected/cb399b18-ba17-47c5-b251-d15c800f383a-kube-api-access-rf9ms\") pod \"cb399b18-ba17-47c5-b251-d15c800f383a\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") "
Jul 09 20:46:40.886645 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-home\") pod \"cb399b18-ba17-47c5-b251-d15c800f383a\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") "
Jul 09 20:46:40.886645 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-tmp-dir\") pod \"cb399b18-ba17-47c5-b251-d15c800f383a\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") "
Jul 09 20:46:40.886811 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-model-cache\") pod \"cb399b18-ba17-47c5-b251-d15c800f383a\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") "
Jul 09 20:46:40.886811 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-dshm\") pod \"cb399b18-ba17-47c5-b251-d15c800f383a\" (UID: \"cb399b18-ba17-47c5-b251-d15c800f383a\") "
Jul 09 20:46:40.886918 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886874    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-home" (OuterVolumeSpecName: "home") pod "cb399b18-ba17-47c5-b251-d15c800f383a" (UID: "cb399b18-ba17-47c5-b251-d15c800f383a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:40.886918 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886885    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb399b18-ba17-47c5-b251-d15c800f383a" (UID: "cb399b18-ba17-47c5-b251-d15c800f383a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:40.887013 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.886926    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb399b18-ba17-47c5-b251-d15c800f383a" (UID: "cb399b18-ba17-47c5-b251-d15c800f383a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:40.887064 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.887015    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-tmp-dir\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:40.887064 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.887035    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-model-cache\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:40.887064 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.887049    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-home\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:40.888766 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.888743    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb399b18-ba17-47c5-b251-d15c800f383a-kube-api-access-rf9ms" (OuterVolumeSpecName: "kube-api-access-rf9ms") pod "cb399b18-ba17-47c5-b251-d15c800f383a" (UID: "cb399b18-ba17-47c5-b251-d15c800f383a"). InnerVolumeSpecName "kube-api-access-rf9ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:46:40.888964 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.888943    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-dshm" (OuterVolumeSpecName: "dshm") pod "cb399b18-ba17-47c5-b251-d15c800f383a" (UID: "cb399b18-ba17-47c5-b251-d15c800f383a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 20:46:40.889143 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.889121    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb399b18-ba17-47c5-b251-d15c800f383a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb399b18-ba17-47c5-b251-d15c800f383a" (UID: "cb399b18-ba17-47c5-b251-d15c800f383a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 20:46:40.987918 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.987837    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb399b18-ba17-47c5-b251-d15c800f383a-dshm\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:40.987918 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.987864    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb399b18-ba17-47c5-b251-d15c800f383a-tls-certs\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:40.987918 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:40.987876    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf9ms\" (UniqueName: \"kubernetes.io/projected/cb399b18-ba17-47c5-b251-d15c800f383a-kube-api-access-rf9ms\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:41.115877 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.115848    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf5293db-64a4-46f4-af71-639e9994d52f" path="/var/lib/kubelet/pods/bf5293db-64a4-46f4-af71-639e9994d52f/volumes"
Jul 09 20:46:41.430108 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.430078    2565 generic.go:356] "Generic (PLEG): container finished" podID="cb399b18-ba17-47c5-b251-d15c800f383a" containerID="f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd" exitCode=0
Jul 09 20:46:41.430337 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.430132    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"
Jul 09 20:46:41.430337 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.430137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8" event={"ID":"cb399b18-ba17-47c5-b251-d15c800f383a","Type":"ContainerDied","Data":"f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd"}
Jul 09 20:46:41.430337 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.430255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8" event={"ID":"cb399b18-ba17-47c5-b251-d15c800f383a","Type":"ContainerDied","Data":"63ad2135f2870be8eec79075d51d11614b43f32ce6123503148a5b55f9f3a2a0"}
Jul 09 20:46:41.430337 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.430279    2565 scope.go:117] "RemoveContainer" containerID="f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd"
Jul 09 20:46:41.438653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.438635    2565 scope.go:117] "RemoveContainer" containerID="f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd"
Jul 09 20:46:41.438923 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:46:41.438897    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd\": container with ID starting with f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd not found: ID does not exist" containerID="f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd"
Jul 09 20:46:41.438997 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.438931    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd"} err="failed to get container status \"f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd\": rpc error: code = NotFound desc = could not find container \"f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd\": container with ID starting with f882c62fdb2ae3561f3582cc1be1d606a112d5bcfc3f8f1c478bccd038110ddd not found: ID does not exist"
Jul 09 20:46:41.445468 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.445446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"]
Jul 09 20:46:41.449068 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:41.449045    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8c2e89/rate-test-model-8c2e89-kserve-5858f58f79-jrcl8"]
Jul 09 20:46:42.187240 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.187176    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"]
Jul 09 20:46:42.187713 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.187664    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb399b18-ba17-47c5-b251-d15c800f383a" containerName="main"
Jul 09 20:46:42.187713 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.187683    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb399b18-ba17-47c5-b251-d15c800f383a" containerName="main"
Jul 09 20:46:42.187832 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.187715    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf5293db-64a4-46f4-af71-639e9994d52f" containerName="main"
Jul 09 20:46:42.187832 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.187724    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf5293db-64a4-46f4-af71-639e9994d52f" containerName="main"
Jul 09 20:46:42.187832 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.187819    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb399b18-ba17-47c5-b251-d15c800f383a" containerName="main"
Jul 09 20:46:42.187832 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.187830    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf5293db-64a4-46f4-af71-639e9994d52f" containerName="main"
Jul 09 20:46:42.192350 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.192327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:42.194799 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.194770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-p45sw\""
Jul 09 20:46:42.196486 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.196460    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"]
Jul 09 20:46:42.299160 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.299121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8h6\" (UniqueName: \"kubernetes.io/projected/b30fb21b-fe25-456c-a75f-b0dd53ca19bb-kube-api-access-ts8h6\") pod \"test-curl-7310-140396087790448\" (UID: \"b30fb21b-fe25-456c-a75f-b0dd53ca19bb\") " pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:42.400670 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.400575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8h6\" (UniqueName: \"kubernetes.io/projected/b30fb21b-fe25-456c-a75f-b0dd53ca19bb-kube-api-access-ts8h6\") pod \"test-curl-7310-140396087790448\" (UID: \"b30fb21b-fe25-456c-a75f-b0dd53ca19bb\") " pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:42.408252 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.408205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8h6\" (UniqueName: \"kubernetes.io/projected/b30fb21b-fe25-456c-a75f-b0dd53ca19bb-kube-api-access-ts8h6\") pod \"test-curl-7310-140396087790448\" (UID: \"b30fb21b-fe25-456c-a75f-b0dd53ca19bb\") " pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:42.502641 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.502550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:42.630655 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.630626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"]
Jul 09 20:46:42.632586 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:46:42.632561    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb30fb21b_fe25_456c_a75f_b0dd53ca19bb.slice/crio-8b8b5b9f84e789748739a6964f2bd6df2ef0853550320c9dc1fb1458f70c52e2 WatchSource:0}: Error finding container 8b8b5b9f84e789748739a6964f2bd6df2ef0853550320c9dc1fb1458f70c52e2: Status 404 returned error can't find the container with id 8b8b5b9f84e789748739a6964f2bd6df2ef0853550320c9dc1fb1458f70c52e2
Jul 09 20:46:42.633956 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:42.633934    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 20:46:43.115717 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:43.115684    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb399b18-ba17-47c5-b251-d15c800f383a" path="/var/lib/kubelet/pods/cb399b18-ba17-47c5-b251-d15c800f383a/volumes"
Jul 09 20:46:43.441422 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:43.441392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087790448" event={"ID":"b30fb21b-fe25-456c-a75f-b0dd53ca19bb","Type":"ContainerStarted","Data":"b749241ca5fd8c0e746abb2f37448bb8e18dee35a8ce8bc050a995670e22582c"}
Jul 09 20:46:43.441849 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:43.441435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087790448" event={"ID":"b30fb21b-fe25-456c-a75f-b0dd53ca19bb","Type":"ContainerStarted","Data":"8b8b5b9f84e789748739a6964f2bd6df2ef0853550320c9dc1fb1458f70c52e2"}
Jul 09 20:46:43.455791 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:43.455747    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/test-curl-7310-140396087790448" podStartSLOduration=0.732148384 podStartE2EDuration="1.455729851s" totalImagesPullingTime="723.581467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:46:43.454154351 +0000 UTC m=+2594.938594353" watchObservedRunningTime="2026-07-09 20:46:43.455729851 +0000 UTC m=+2594.940169852"
Jul 09 20:46:43.562036 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:43.562006    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7310-140396087790448_b30fb21b-fe25-456c-a75f-b0dd53ca19bb/test-curl-7310-140396087790448/0.log"
Jul 09 20:46:44.447526 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:44.447485    2565 generic.go:356] "Generic (PLEG): container finished" podID="b30fb21b-fe25-456c-a75f-b0dd53ca19bb" containerID="b749241ca5fd8c0e746abb2f37448bb8e18dee35a8ce8bc050a995670e22582c" exitCode=0
Jul 09 20:46:44.447959 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:44.447562    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7310-140396087790448" event={"ID":"b30fb21b-fe25-456c-a75f-b0dd53ca19bb","Type":"ContainerDied","Data":"b749241ca5fd8c0e746abb2f37448bb8e18dee35a8ce8bc050a995670e22582c"}
Jul 09 20:46:45.584601 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:45.584572    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:45.614942 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:45.614901    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"]
Jul 09 20:46:45.617573 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:45.617542    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7310-140396087790448"]
Jul 09 20:46:45.629194 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:45.629173    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts8h6\" (UniqueName: \"kubernetes.io/projected/b30fb21b-fe25-456c-a75f-b0dd53ca19bb-kube-api-access-ts8h6\") pod \"b30fb21b-fe25-456c-a75f-b0dd53ca19bb\" (UID: \"b30fb21b-fe25-456c-a75f-b0dd53ca19bb\") "
Jul 09 20:46:45.631472 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:45.631448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b30fb21b-fe25-456c-a75f-b0dd53ca19bb-kube-api-access-ts8h6" (OuterVolumeSpecName: "kube-api-access-ts8h6") pod "b30fb21b-fe25-456c-a75f-b0dd53ca19bb" (UID: "b30fb21b-fe25-456c-a75f-b0dd53ca19bb"). InnerVolumeSpecName "kube-api-access-ts8h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 20:46:45.730952 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:45.730857    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts8h6\" (UniqueName: \"kubernetes.io/projected/b30fb21b-fe25-456c-a75f-b0dd53ca19bb-kube-api-access-ts8h6\") on node \"ip-10-0-139-14.ec2.internal\" DevicePath \"\""
Jul 09 20:46:46.458707 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:46.458673    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:46.458707 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:46.458698    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b8b5b9f84e789748739a6964f2bd6df2ef0853550320c9dc1fb1458f70c52e2"
Jul 09 20:46:46.470257 ip-10-0-139-14 kubenswrapper[2565]: E0709 20:46:46.470204    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7310-140396087790448\" is forbidden: User \"system:node:ip-10-0-139-14.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-14.ec2.internal' and this object" podUID="b30fb21b-fe25-456c-a75f-b0dd53ca19bb" pod="openshift-ingress/test-curl-7310-140396087790448"
Jul 09 20:46:47.115327 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:47.115284    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b30fb21b-fe25-456c-a75f-b0dd53ca19bb" path="/var/lib/kubelet/pods/b30fb21b-fe25-456c-a75f-b0dd53ca19bb/volumes"
Jul 09 20:46:50.503911 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:46:50.503829    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:47:00.035096 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:00.035039    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d65c679b7-4nfqt_ae0ce082-9455-4d6e-b44a-bd51d8fc3a68/authorino/0.log"
Jul 09 20:47:03.312425 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:03.312386    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqb5p"]
Jul 09 20:47:05.571478 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:05.571448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-5sjh5_ca0a1644-eb79-4d57-b986-f9776c15e139/copy-manifests/0.log"
Jul 09 20:47:05.589767 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:05.589730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-5sjh5_ca0a1644-eb79-4d57-b986-f9776c15e139/manager/0.log"
Jul 09 20:47:07.625291 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:07.625259    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d65c679b7-4nfqt_ae0ce082-9455-4d6e-b44a-bd51d8fc3a68/authorino/0.log"
Jul 09 20:47:07.862873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:07.862841    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-j7zpr_407c3f2f-547b-4e37-afe3-7cfb01e64d8b/manager/0.log"
Jul 09 20:47:07.987171 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:07.987097    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n288q_19c84445-4f1a-4552-bbcd-eb492b4a0e57/kuadrant-console-plugin/0.log"
Jul 09 20:47:08.365885 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:08.365856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dqb5p_97ae4fcb-2f49-4755-976a-1134b1aaeaee/limitador/0.log"
Jul 09 20:47:09.096853 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:09.096807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d5dd4c74-8fqq9_725d75f7-1a5b-435d-9993-9a98fa8b9c74/kube-auth-proxy/0.log"
Jul 09 20:47:10.401091 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:10.401056    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7cjzj_0da871b6-2fdc-46b0-8150-71608df845f4/main/0.log"
Jul 09 20:47:10.630317 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:10.630284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-nh2wg_828e9dce-474c-4a2d-b13f-3aa8a3aa3b05/main/0.log"
Jul 09 20:47:14.312004 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.311966    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-76kn5/must-gather-98zjq"]
Jul 09 20:47:14.312409 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.312332    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b30fb21b-fe25-456c-a75f-b0dd53ca19bb" containerName="test-curl-7310-140396087790448"
Jul 09 20:47:14.312409 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.312346    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b30fb21b-fe25-456c-a75f-b0dd53ca19bb" containerName="test-curl-7310-140396087790448"
Jul 09 20:47:14.312409 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.312402    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b30fb21b-fe25-456c-a75f-b0dd53ca19bb" containerName="test-curl-7310-140396087790448"
Jul 09 20:47:14.315623 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.315600    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.318242 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.318195    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-76kn5\"/\"kube-root-ca.crt\""
Jul 09 20:47:14.318373 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.318251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-76kn5\"/\"openshift-service-ca.crt\""
Jul 09 20:47:14.318373 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.318325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-76kn5\"/\"default-dockercfg-cblvf\""
Jul 09 20:47:14.323807 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.323781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kn5/must-gather-98zjq"]
Jul 09 20:47:14.495158 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.495119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vtl\" (UniqueName: \"kubernetes.io/projected/d43ce60e-d5cd-46a9-a978-29c8fdef6038-kube-api-access-l4vtl\") pod \"must-gather-98zjq\" (UID: \"d43ce60e-d5cd-46a9-a978-29c8fdef6038\") " pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.495344 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.495175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d43ce60e-d5cd-46a9-a978-29c8fdef6038-must-gather-output\") pod \"must-gather-98zjq\" (UID: \"d43ce60e-d5cd-46a9-a978-29c8fdef6038\") " pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.596282 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.596178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vtl\" (UniqueName: \"kubernetes.io/projected/d43ce60e-d5cd-46a9-a978-29c8fdef6038-kube-api-access-l4vtl\") pod \"must-gather-98zjq\" (UID: \"d43ce60e-d5cd-46a9-a978-29c8fdef6038\") " pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.596282 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.596252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d43ce60e-d5cd-46a9-a978-29c8fdef6038-must-gather-output\") pod \"must-gather-98zjq\" (UID: \"d43ce60e-d5cd-46a9-a978-29c8fdef6038\") " pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.596653 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.596631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d43ce60e-d5cd-46a9-a978-29c8fdef6038-must-gather-output\") pod \"must-gather-98zjq\" (UID: \"d43ce60e-d5cd-46a9-a978-29c8fdef6038\") " pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.604544 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.604516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vtl\" (UniqueName: \"kubernetes.io/projected/d43ce60e-d5cd-46a9-a978-29c8fdef6038-kube-api-access-l4vtl\") pod \"must-gather-98zjq\" (UID: \"d43ce60e-d5cd-46a9-a978-29c8fdef6038\") " pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.626060 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.626028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kn5/must-gather-98zjq"
Jul 09 20:47:14.767685 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:14.767662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kn5/must-gather-98zjq"]
Jul 09 20:47:14.769907 ip-10-0-139-14 kubenswrapper[2565]: W0709 20:47:14.769873    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd43ce60e_d5cd_46a9_a978_29c8fdef6038.slice/crio-0dd2be36d00a49d7173ce4182c9b03cd30ffed8616680e74e1ea8e7ad614ebbc WatchSource:0}: Error finding container 0dd2be36d00a49d7173ce4182c9b03cd30ffed8616680e74e1ea8e7ad614ebbc: Status 404 returned error can't find the container with id 0dd2be36d00a49d7173ce4182c9b03cd30ffed8616680e74e1ea8e7ad614ebbc
Jul 09 20:47:15.595903 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:15.595869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kn5/must-gather-98zjq" event={"ID":"d43ce60e-d5cd-46a9-a978-29c8fdef6038","Type":"ContainerStarted","Data":"0dd2be36d00a49d7173ce4182c9b03cd30ffed8616680e74e1ea8e7ad614ebbc"}
Jul 09 20:47:16.604526 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:16.604483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kn5/must-gather-98zjq" event={"ID":"d43ce60e-d5cd-46a9-a978-29c8fdef6038","Type":"ContainerStarted","Data":"878b5b931f9a3a693afc1bdb58634cac103106f0d191cbb14f0fcbdc538f902a"}
Jul 09 20:47:16.604526 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:16.604525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kn5/must-gather-98zjq" event={"ID":"d43ce60e-d5cd-46a9-a978-29c8fdef6038","Type":"ContainerStarted","Data":"bcab5d42cfd8d3098629ef686aef946a72deda4136860e9041cdc5492c86fc88"}
Jul 09 20:47:16.619315 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:16.619259    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-76kn5/must-gather-98zjq" podStartSLOduration=1.841438432 podStartE2EDuration="2.619239463s" totalImagesPullingTime="777.801031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 20:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:47:16.618434886 +0000 UTC m=+2628.102874887" watchObservedRunningTime="2026-07-09 20:47:16.619239463 +0000 UTC m=+2628.103679464"
Jul 09 20:47:17.201192 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:17.201150    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nt2zq_e54656f1-7f4a-45df-baed-7d9ba120876c/global-pull-secret-syncer/0.log"
Jul 09 20:47:17.288582 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:17.288539    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sfb7k_f6955bbb-5870-4a78-9a96-f0bd49a7e5f8/konnectivity-agent/0.log"
Jul 09 20:47:17.346087 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:17.346046    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-14.ec2.internal_51adeb82ef9cf7027b389777ed26ae92/haproxy/0.log"
Jul 09 20:47:22.492997 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:22.492955    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d65c679b7-4nfqt_ae0ce082-9455-4d6e-b44a-bd51d8fc3a68/authorino/0.log"
Jul 09 20:47:22.554236 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:22.554135    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-j7zpr_407c3f2f-547b-4e37-afe3-7cfb01e64d8b/manager/0.log"
Jul 09 20:47:22.593421 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:22.593388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n288q_19c84445-4f1a-4552-bbcd-eb492b4a0e57/kuadrant-console-plugin/0.log"
Jul 09 20:47:22.819800 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:22.819767    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dqb5p_97ae4fcb-2f49-4755-976a-1134b1aaeaee/limitador/0.log"
Jul 09 20:47:24.396315 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.396290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7e8a454-4674-4fbd-b3c0-49ed40e77457/alertmanager/0.log"
Jul 09 20:47:24.456699 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.456659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7e8a454-4674-4fbd-b3c0-49ed40e77457/config-reloader/0.log"
Jul 09 20:47:24.488864 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.488836    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7e8a454-4674-4fbd-b3c0-49ed40e77457/kube-rbac-proxy-web/0.log"
Jul 09 20:47:24.525364 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.525328    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7e8a454-4674-4fbd-b3c0-49ed40e77457/kube-rbac-proxy/0.log"
Jul 09 20:47:24.553005 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.552978    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7e8a454-4674-4fbd-b3c0-49ed40e77457/kube-rbac-proxy-metric/0.log"
Jul 09 20:47:24.582130 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.582040    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7e8a454-4674-4fbd-b3c0-49ed40e77457/prom-label-proxy/0.log"
Jul 09 20:47:24.617965 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.617938    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f7e8a454-4674-4fbd-b3c0-49ed40e77457/init-config-reloader/0.log"
Jul 09 20:47:24.710788 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.708599    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-pcq8x_954d6a6b-f906-44f8-ba04-3d8194e1f7ff/cluster-monitoring-operator/0.log"
Jul 09 20:47:24.935445 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.935406    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4j4qj_d0b50897-f773-4750-a347-a3224dc993d9/node-exporter/0.log"
Jul 09 20:47:24.985259 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:24.979020    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4j4qj_d0b50897-f773-4750-a347-a3224dc993d9/kube-rbac-proxy/0.log"
Jul 09 20:47:25.020387 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.020274    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4j4qj_d0b50897-f773-4750-a347-a3224dc993d9/init-textfile/0.log"
Jul 09 20:47:25.339922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.339889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73619272-8d5f-4470-99da-4c1a2546c03f/prometheus/0.log"
Jul 09 20:47:25.361643 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.361604    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73619272-8d5f-4470-99da-4c1a2546c03f/config-reloader/0.log"
Jul 09 20:47:25.387410 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.387380    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73619272-8d5f-4470-99da-4c1a2546c03f/thanos-sidecar/0.log"
Jul 09 20:47:25.413605 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.413562    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73619272-8d5f-4470-99da-4c1a2546c03f/kube-rbac-proxy-web/0.log"
Jul 09 20:47:25.437773 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.437744    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73619272-8d5f-4470-99da-4c1a2546c03f/kube-rbac-proxy/0.log"
Jul 09 20:47:25.460754 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.460727    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73619272-8d5f-4470-99da-4c1a2546c03f/kube-rbac-proxy-thanos/0.log"
Jul 09 20:47:25.484355 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:25.484285    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73619272-8d5f-4470-99da-4c1a2546c03f/init-config-reloader/0.log"
Jul 09 20:47:27.447963 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.447921    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"]
Jul 09 20:47:27.454201 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.454175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.458919 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.458553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"]
Jul 09 20:47:27.551561 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.551522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmgtf\" (UniqueName: \"kubernetes.io/projected/7757e58f-6f65-4e1c-ad19-84997c44ca6b-kube-api-access-zmgtf\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.551876 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.551852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-sys\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.552054 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.552037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-podres\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.552252 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.552232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-proc\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.552419 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.552403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-lib-modules\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.654141 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.654102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-podres\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.654405 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.654379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-podres\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.654572 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.654556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-proc\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.654753 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.654738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-lib-modules\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.655047 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.654696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-proc\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.655137 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.654936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-lib-modules\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.655205 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.655191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmgtf\" (UniqueName: \"kubernetes.io/projected/7757e58f-6f65-4e1c-ad19-84997c44ca6b-kube-api-access-zmgtf\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.655464 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.655306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-sys\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.655464 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.655427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7757e58f-6f65-4e1c-ad19-84997c44ca6b-sys\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.663352 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.663293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmgtf\" (UniqueName: \"kubernetes.io/projected/7757e58f-6f65-4e1c-ad19-84997c44ca6b-kube-api-access-zmgtf\") pod \"perf-node-gather-daemonset-cbwgz\" (UID: \"7757e58f-6f65-4e1c-ad19-84997c44ca6b\") " pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.772194 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.772109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:27.951880 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:27.951781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"]
Jul 09 20:47:28.692028 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:28.691990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz" event={"ID":"7757e58f-6f65-4e1c-ad19-84997c44ca6b","Type":"ContainerStarted","Data":"a88aa903e8b6694ba72fb4c7702ab79307ad13b2b5df0754dcdd9aefe7b54d22"}
Jul 09 20:47:28.692584 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:28.692048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz" event={"ID":"7757e58f-6f65-4e1c-ad19-84997c44ca6b","Type":"ContainerStarted","Data":"57ef8f32da39ca6ff6202a178e7145e049523e99c0b9ce268d32dd2cfb8b0bf3"}
Jul 09 20:47:28.692584 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:28.692089    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:28.734361 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:28.734296    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz" podStartSLOduration=1.734274644 podStartE2EDuration="1.734274644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 20:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 20:47:28.731495298 +0000 UTC m=+2640.215935299" watchObservedRunningTime="2026-07-09 20:47:28.734274644 +0000 UTC m=+2640.218714648"
Jul 09 20:47:28.861918 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:28.861881    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-2qq5n_a210567a-7e11-4ddc-b0b0-a2a84accfb77/volume-data-source-validator/0.log"
Jul 09 20:47:29.974530 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:29.974486    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4xnm_8a24ff45-361f-4666-8ae0-fe63706f0bab/dns/0.log"
Jul 09 20:47:29.996887 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:29.996846    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4xnm_8a24ff45-361f-4666-8ae0-fe63706f0bab/kube-rbac-proxy/0.log"
Jul 09 20:47:30.125796 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:30.125766    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t2sg7_5fc880f4-8c16-459c-8ca8-c2f1e08f35aa/dns-node-resolver/0.log"
Jul 09 20:47:30.669085 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:30.669035    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d64b75bf-7b5mc_90f930bf-7f46-4e74-b763-70c02b37020a/registry/0.log"
Jul 09 20:47:30.692677 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:30.692646    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kqnm9_410bcb74-59c1-476b-ac5e-cbb8fe5fe94d/node-ca/0.log"
Jul 09 20:47:31.805260 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:31.805227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d5dd4c74-8fqq9_725d75f7-1a5b-435d-9993-9a98fa8b9c74/kube-auth-proxy/0.log"
Jul 09 20:47:32.700570 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:32.700541    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7sm7q_d8901041-35a4-4db0-bbbd-2c46ddc6a8fb/serve-healthcheck-canary/0.log"
Jul 09 20:47:33.269262 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:33.269224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dhxkj_dc350c8b-482e-473a-8426-dd3f5eb125ff/insights-operator/0.log"
Jul 09 20:47:33.269768 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:33.269489    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-dhxkj_dc350c8b-482e-473a-8426-dd3f5eb125ff/insights-operator/1.log"
Jul 09 20:47:33.391922 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:33.391881    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwkwd_1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1/kube-rbac-proxy/0.log"
Jul 09 20:47:33.415394 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:33.415368    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwkwd_1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1/exporter/0.log"
Jul 09 20:47:33.451814 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:33.451774    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pwkwd_1ba714e5-f1f9-4d85-9f1e-06f468fb3dc1/extractor/0.log"
Jul 09 20:47:34.713933 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:34.713891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-76kn5/perf-node-gather-daemonset-cbwgz"
Jul 09 20:47:36.110249 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:36.110190    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-5sjh5_ca0a1644-eb79-4d57-b986-f9776c15e139/manager/0.log"
Jul 09 20:47:36.130873 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:36.130847    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64f986597c-5sjh5_ca0a1644-eb79-4d57-b986-f9776c15e139/copy-manifests/0.log"
Jul 09 20:47:37.702476 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:37.702447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fd67cd5cb-md857_220af1ae-adc6-43cd-83d1-98d0b9e83547/manager/0.log"
Jul 09 20:47:38.572469 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:38.572438    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d5dd4c74-8fqq9_725d75f7-1a5b-435d-9993-9a98fa8b9c74/kube-auth-proxy/0.log"
Jul 09 20:47:40.064881 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:40.064850    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d5dd4c74-8fqq9_725d75f7-1a5b-435d-9993-9a98fa8b9c74/kube-auth-proxy/0.log"
Jul 09 20:47:43.369143 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:43.369112    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tl8sh_f7049af2-0619-4a88-ad90-e041f2bd3c5c/kube-storage-version-migrator-operator/1.log"
Jul 09 20:47:43.371025 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:43.370997    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tl8sh_f7049af2-0619-4a88-ad90-e041f2bd3c5c/kube-storage-version-migrator-operator/0.log"
Jul 09 20:47:44.364529 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.364494    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s28c_01b0228b-9a43-413f-afb7-c839f9e9713b/kube-multus-additional-cni-plugins/0.log"
Jul 09 20:47:44.384642 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.384613    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s28c_01b0228b-9a43-413f-afb7-c839f9e9713b/egress-router-binary-copy/0.log"
Jul 09 20:47:44.406423 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.406398    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s28c_01b0228b-9a43-413f-afb7-c839f9e9713b/cni-plugins/0.log"
Jul 09 20:47:44.427288 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.427264    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s28c_01b0228b-9a43-413f-afb7-c839f9e9713b/bond-cni-plugin/0.log"
Jul 09 20:47:44.450025 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.449996    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s28c_01b0228b-9a43-413f-afb7-c839f9e9713b/routeoverride-cni/0.log"
Jul 09 20:47:44.472654 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.472625    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s28c_01b0228b-9a43-413f-afb7-c839f9e9713b/whereabouts-cni-bincopy/0.log"
Jul 09 20:47:44.495373 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.495343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s28c_01b0228b-9a43-413f-afb7-c839f9e9713b/whereabouts-cni/0.log"
Jul 09 20:47:44.891590 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.891532    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z9c6q_cbfe789b-fa2d-453a-a5f4-9563e45ac656/kube-multus/0.log"
Jul 09 20:47:44.913479 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.913452    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jtndh_1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff/network-metrics-daemon/0.log"
Jul 09 20:47:44.932588 ip-10-0-139-14 kubenswrapper[2565]: I0709 20:47:44.932559    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jtndh_1ebc5c31-2c55-4e4c-9ac8-2aac53a656ff/kube-rbac-proxy/0.log"